Most Popular
1500 questions
20
votes
1 answer
What is the difference between tree search and graph search?
I have read various answers to this question at different places, but I am still missing something.
What I have understood is that a graph search holds a closed list, with all expanded nodes, so they don't get explored again. However, if you apply…
xava
- 433
- 1
- 4
- 10
20
votes
2 answers
What is the difference between an observation and a state in reinforcement learning?
I'm studying reinforcement learning. It seems that "state" and "observation" mean exactly the same thing. They both capture the current state of the game.
Is there a difference between the two terms? Is the observation maybe the state after the…
echo
- 713
- 1
- 6
- 12
20
votes
3 answers
How are Artificial Neural Networks and the Biological Neural Networks similar and different?
I've heard multiple times that "Neural Networks are the best approximation we have to model the human brain", and I think it is commonly known that Neural Networks are modelled after our brain.
I strongly suspect that this model has been simplified,…
Andreas Storvik Strauman
- 491
- 3
- 15
20
votes
2 answers
How to implement an "unknown" class in multi-class classification with neural networks?
For example, I need to detect classes for MNIST data. But I want to have not 10 classes for digits, but also I want to have 11th class "not a digit", so that any letter, any other type of image, or random noise would be classified as "not a digit".…
Sergey Kravchenko
- 321
- 1
- 2
- 5
20
votes
5 answers
How can I design and train a neural network to play a card game (similar to Magic: The Gathering)?
Introduction
I am currently writing an engine to play a card game, as there is no engine yet for this particular game.
About the game
The game is similar to Magic: The Gathering. There is a commander, which has health and abilities. Players have an…
pcaston2
- 321
- 1
- 2
- 5
20
votes
5 answers
What exactly are genetic algorithms and what sort of problems are they good for?
I've noticed that a few questions on this site mention genetic algorithms and it made me realize that I don't really know much about those.
I have heard the term before, but it's not something I've ever used, so I don't have much idea about how they…
Disenchanted Lurker
- 853
- 9
- 18
20
votes
1 answer
Why is automated theorem proving so hard?
The problem of automated theorem proving (ATP) seems to be very similar to playing board games (e.g. chess, go, etc.): it can also be naturally stated as a problem of a decision tree traversal. However, there is a dramatic difference in progress on…
Ivan Ivanov
- 201
- 1
- 3
20
votes
11 answers
What purpose would be served by developing AI's that experience human-like emotions?
In a recent Wall Street Journal article, Yann LeCunn makes the following statement:
The next step in achieving human-level ai is creating intelligent—but not autonomous—machines. The AI system in your car will get you safely home, but won’t choose…
mindcrime
- 3,797
- 1
- 15
- 31
20
votes
1 answer
Would Google's self-driving-car stop when it sees somebody with a T-shirt with a stop sign printed on it?
In Hidden Obstacles for Google’s Self-Driving Cars article we can read that:
Google’s cars can detect and respond to stop signs that aren’t on its map, a feature that was introduced to deal with temporary signs used at construction sites.
Google…
kenorb
- 10,525
- 6
- 45
- 95
20
votes
3 answers
Are there any computational models of mirror neurons?
From Wikipedia:
A mirror neuron is a neuron that fires both when an animal acts and when the animal observes the same action performed by another.
Mirror neurons are related to imitation learning, a very useful feature that is missing in current…
rcpinto
- 2,148
- 1
- 17
- 31
20
votes
2 answers
What limits, if any, does the halting problem put on Artificial Intelligence?
Given the proven halting problem for Turing machines, can we infer limits on the ability of strong Artificial Intelligence?
WilliamKF
- 2,533
- 1
- 26
- 31
20
votes
3 answers
Are Asimov's Laws flawed by design, or are they feasible in practice?
Isaac Asimov's famous Three Laws of Robotics originated in the context of Asimov's science fiction stories. In those stories, the three laws serve as a safety measure, in order to avoid untimely or manipulated situations from exploding in…
3442
- 768
- 4
- 11
20
votes
1 answer
How to deal with a huge action space, where, at every step, there is a variable number of legal actions?
I am working on creating an RL-based AI for a certain board game. Just as a general overview of the game so that you understand what it's all about: It's a discrete turn-based game with a board of size $n \times n$ ($n$ depending on the number of…
ytolochko
- 385
- 2
- 6
19
votes
3 answers
What are the mathematical prerequisites for an AI researcher?
What are the mathematical prerequisites for understanding the core part of various algorithms involved in artificial intelligence and developing one's own algorithms?
Please, refer to some specific books.
Surya Bhusal
- 371
- 1
- 3
- 12
19
votes
2 answers
Why does DQN require two different networks?
I was going through this implementation of DQN and I see that on line 124 and 125 two different Q networks have been initialized. From my understanding, I think one network predicts the appropriate action and the second network predicts the target Q…
amitection
- 327
- 2
- 6