For questions related to data compression in the context of artificial intelligence.
Questions tagged [data-compression]
13 questions
6
votes
2 answers
What is the current research in artificial intelligence in the field of data compression?
What is the current research in artificial intelligence and machine learning in the field of data compression?
I have done my research on the PAQ series of compressors, some of which use neural networks for context mixing.
user15736
- 71
- 2
6
votes
4 answers
Is it possible for a neural network to be used to compress data?
When training a neural network, we often run into the issue of overfitting.
However, is it possible to put overfitting to use? Basically, my idea is, instead of storing a large dataset in a database, you can just train a neural network on the entire…
Bryan Tan
- 183
- 8
4
votes
1 answer
How can I compress the states of a reinforcement learning agent?
I'm working on a problem that involves an RL agent with very large states. These states consist of several pieces of information about the agent. The states are not images, so techniques like convolutional neural networks will not work here.
Is…
Saeid Ghafouri
- 125
- 1
- 6
4
votes
2 answers
Can a data compression function be used to make predictions?
I've heard that prediction is equivalent to data compression.
Is there a way to take a compression function and use it to create an AI that predicts?
Jesus is Lord
- 189
- 6
3
votes
1 answer
Proposal for AGI model
I've been doing a bit of research into formal models for AGI, searching for fertile ground for developing new ideas. One area that didn't seem too thoroughly explored was in designing agents that “reason scientifically”, by which I mean agents that…
bishop-fish
- 131
- 5
2
votes
2 answers
Do text compression tests qualify winRar or 7zip as intelligent?
I read this paper Text Compression as a Test for Artificial Intelligence, Mahoney, 1999.
So far I understood the following:
Text Compression tests can be used as an alternative to Turing Tests for intelligence.
The Bits per character score obtained…
Aether
- 285
- 2
- 7
2
votes
0 answers
Did the Hutter Prize help research in artificial intelligence in any way?
Wikipedia states:
The Hutter Prize is a cash prize funded by Marcus Hutter which rewards data compression improvements on a specific 1 GB English text file.
The goal of the Hutter Prize is to encourage research in artificial intelligence (AI). The…
Franck Dernoncourt
- 3,473
- 2
- 21
- 39
1
vote
0 answers
KL annealing for a VAE does not work, what now?
I am trying to train a variational auto-encoder where x ≈ f_VAE(x) = x_hat. In my real problem, I have 100-400 dimensional data that I would like to compress to around 30 latent variables. For now I have a toy problem where I have 14 dimensional…
Patrickens
- 131
- 2
1
vote
0 answers
Generative systems based on Schmidhuber's compression framework
In Driven by Compression Progress:
A Simple Principle Explains Essential Aspects of
Subjective Beauty, Novelty, Surprise,
Interestingness, Attention, Curiosity, Creativity,
Art, Science, Music, Jokes Jürgen Schmidhuber describes, using the idea of…
2080
- 121
- 3
0
votes
0 answers
Seeking advice for MLP architectures and training strategies for texture reconstruction (mipmap upscaling) focused on residual compression
I am working on a project involving texture compression and reconstruction, specifically targeting mipmap upscaling for game development assets. I'm encountering challenges in achieving the desired prediction accuracy and am seeking advice on neural…
0
votes
0 answers
Does SVD of sparse matrices have some special properties?
If I have a big, but sparse matrix and I decompose it using SVD, would the three matrices have some special properties other than their regular ones ?
0
votes
1 answer
How to reconstruct a new image using pre-trained autoencoder?
When a single image is assigned for training, an auto-encoder should be able to gradient-descend and find the full set of satisfactory weights that will reconstruct this image.
Suppose a second image is now assigned to the autoencoder:
Can the…
James
- 167
- 4
0
votes
1 answer
How it is possible to compress audio with the image representation of an audio?
In most of the speech compression using machine/deep learning, I have seen that, in order to process an audio file, we need to convert it into a mel spectrogram format, then this spectrogram is analyzed.
Do we apply the compression process on this…
Nervous Hero
- 195
- 1
- 6