Most Popular
1500 questions
6
votes
3 answers
Perfect play in information incomplete games
As titled, is there such thing as perfect play (or at least "perfectly optimal") in a game with incomplete information? Or at least a proof as to show why there cannot?
Naively (and seemingly obviously), the answer would be a resounding no, since…
k.c. sayz 'k.c sayz'
- 2,121
- 13
- 27
6
votes
1 answer
Is there a widely accepted definition of the width of a neural network?
The depth of a neural network is equal to the total number of layers in the neural network (excluding the input layer by convention). A neural network with "many layers" is called a deep neural network.
On the other hand, the width is the name of a…
hanugm
- 4,102
- 3
- 29
- 63
6
votes
1 answer
Why should one ever use ReLU instead of PReLU?
To me, it seems that PReLU is strictly better than ReLU. It does not have the dying ReLU problem, it allows negative values and it has trainable parameters (which are computationally negligible to adjust). Only if we want the network to output…
algebruh
- 161
- 2
6
votes
2 answers
How to check whether my loss function is convex or not?
Loss functions are useful in calculating loss and then we can update the weights of a neural network. The loss function is thus useful in training neural networks.
Consider the following excerpt from this answer
In principle, differentiability is…
hanugm
- 4,102
- 3
- 29
- 63
6
votes
3 answers
What is Lipschitz constraint and why it is enforced on discriminator?
The following is the abstract for the research paper titled Improved Training of Wasserstein GANs
Generative Adversarial Networks (GANs) are powerful generative models,
but suffer from training instability. The recently proposed
Wasserstein GAN…
hanugm
- 4,102
- 3
- 29
- 63
6
votes
2 answers
Would a general-purpose AI need to collaborate?
Human beings are more productive in groups than individually, possibly due to the fact that there is a limit to how much one human brain can improve itself in terms of speed of computation and areas of expertise.
By contrast, if a machine with…
user289661
- 419
- 4
- 11
6
votes
4 answers
What does deep learning offer with respect to standard machine learning?
I've been reading a lot about DL. I can understand to an extent how it works, in theory at least, and how it's technically different from conventional ML. But what I'm looking for is more of a "conceptual" meaning.
Let's say you're designing a…
Mahmoud Abdel-Mon'em
- 113
- 8
6
votes
1 answer
Is there a theoretical maximum for intelligence?
From Artificial Intelligence: A Modern Approach, Third Edition, Chapter 26:
Note that the concept of ultraintelligent machines assumes that intelligence is an especially important attribute, and if you have enough of it, all problems can be solved.…
Left SE On 10_6_19
- 1,670
- 10
- 23
6
votes
2 answers
Can an AI be made to maintain a train of thought?
This mostly refers to human-like or chatbot AI, but could maybe be used in other applications (math or something?).
Basically, it occurred to me, that when I'm thinking or speaking, there is a constant feedback loop, in which I am formulating which…
Sebastian Hahn
- 119
- 2
6
votes
1 answer
Proof that there always exists a dominating policy in an MDP
I think that it is common knowledge that for any infinite horizon discounted MDP $(S, A, P, r, \gamma)$, there always exists a dominating policy $\pi$, i.e. a policy $\pi$ such that for all policies $\pi'$: $$V_\pi (s) \geq V_{\pi'}(s) \quad…
MMM
- 185
- 3
6
votes
1 answer
Can a purely policy convolution neural network based game learn to play better than its opponents?
This question has come from my experiment of building a cnn based tic-tac-toe game that I'm using as a beginner machine learning project. The game works purely on policy networks, more specifically -
During training, at the end of each game, it…
Achilles
- 263
- 1
- 5
6
votes
1 answer
How does visual cortex share convolution weight
TL;DR
If we buy into the idea visual cortex functions like a convolutional neural network, then there's a problem makes me scratch my head: how does brain force weight sharing as in convolutional network?
Okay, explain more
Obviously, there's no way…
Kh40tiK
- 161
- 3
6
votes
1 answer
Are there any advantages of the local attention against convolutions?
Transformer architectures, based on the self-attention mechanism, have achieved outstanding performance in a variety of applications.
The main advantage of this approach is that the given token can interact with any token in the input sequence and…
spiridon_the_sun_rotator
- 2,852
- 12
- 17
6
votes
1 answer
Why can't I reproduce the experiments in the original paper that introduced the Firefly Algorithm?
I have been trying to reproduce the experiments done in the original: Firefly Algorithm for multimodal optimization (2010) by Xin-She Yang, but so far unsuccessfully. For the moment being, I'm okay if anyone points me in the right direction.
I wrote…
Jairo
- 91
- 1
6
votes
2 answers
Which machine learning algorithm could I use to break up a poem by lines?
I want to create a network to predict the break up of poetry lines. The program would receive as input an unbroken poem, and would output the poem broken into lines.
For example, an unbroken poem could be
And then the day came, when the risk to…
TastySpaceApple
- 163
- 3