Most Popular
1500 questions
15
votes
1 answer
How can the convolution operation be implemented as a matrix multiplication?
How can the convolution operation used by CNNs be implemented as a matrix-vector multiplication? We often think of the convolution operation in CNNs as a kernel that slides across the input. However, rather than sliding this kernel (e.g. using…
nbro
- 42,615
- 12
- 119
- 217
15
votes
3 answers
Why exactly do neural networks require i.i.d. data?
In reinforcement learning, successive states (actions and rewards) can be correlated. An experience replay buffer was used, in the DQN architecture, to avoid training the neural network (NN), which represents the $Q$ function, with correlated (or…
nbro
- 42,615
- 12
- 119
- 217
15
votes
1 answer
What is the relation between online (or offline) learning and on-policy (or off-policy) algorithms?
In the context of RL, there is the notion of on-policy and off-policy algorithms. I understand the difference between on-policy and off-policy algorithms. Moreover, in RL, there's also the notion of online and offline learning.
What is the relation…
nbro
- 42,615
- 12
- 119
- 217
14
votes
3 answers
What are the differences between A* and greedy best-first search?
What are the differences between the A* algorithm and the greedy best-first search algorithm? Which one should I use? Which algorithm is the better one, and why?
Marosh Fatima
- 375
- 1
- 3
- 10
14
votes
3 answers
What are the specific requirements of the Turing test?
What are the specific requirements of the Turing test?
What requirements if any must the evaluator fulfill in order to be qualified to give the test?
Must there always be two participants in the conversation (one human and one computer) or can…
Luke
- 253
- 2
- 6
14
votes
2 answers
Is there any scientific/mathematical argument that prevents deep learning from ever producing strong AI?
I read Judea Pearl's The Book of Why, in which he mentions that deep learning is just a glorified curve fitting technology, and will not be able to produce human-like intelligence.
From his book there is this diagram that illustrates the three…
Graviton
- 261
- 3
- 8
14
votes
1 answer
Why is A* optimal if the heuristic function is admissible?
A heuristic is admissible if it never overestimates the true cost to reach the goal node from $n$. If a heuristic is consistent, then the heuristic value of $n$ is never greater than the cost of its successor, $n'$, plus the successor's heuristic…
Wizard
- 313
- 1
- 2
- 6
14
votes
3 answers
How do I compute the structural similarity between sentences?
I am working on a problem where I need to determine whether two sentences are similar or not. I implemented a solution using BM25 algorithm and wordnet synsets for determining syntactic & semantic similarity. The solution is working adequately,…
Shubham Tiwari
- 243
- 1
- 2
- 6
14
votes
1 answer
How could I use reinforcement learning to solve a chess-like board game?
I invented a chess-like board game. I built an engine so that it can play autonomously. The engine is basically a decision tree. It's composed by:
A search function that at each node finds all possible legal moves
An evaluation function that…
Pigna
- 295
- 2
- 6
14
votes
1 answer
Are the dialogs at Sophia's (the robot) appearings scripted?
I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia.
I have found the following articles:
Your new friend is a humanoid robot
Source: theaustralian.com.au
Like Amazon Echo, Google Assistant and…
tgogos
- 251
- 1
- 6
- 12
14
votes
4 answers
What is the "dropout" technique?
What purpose does the "dropout" method serve and how does it improve the overall performance of the neural network?
kenorb
- 10,525
- 6
- 45
- 95
14
votes
6 answers
What would motivate a machine?
Currently, within the AI development field, the main focus seems to be on pattern recognition and machine learning. Learning is about adjusting internal variables based on a feedback loop.
Maslow's hierarchy of needs is a theory in psychology…
Aleksei Maide
- 251
- 3
- 14
14
votes
2 answers
Is the mean-squared error always convex in the context of neural networks?
Multiple resources I referred to mention that MSE is great because it's convex. But I don't get how, especially in the context of neural networks.
Let's say we have the following:
$X$: training dataset
$Y$: targets
$\Theta$: the set of parameters…
user74211
- 141
- 1
- 3
14
votes
3 answers
How to train a neural network for a round based board game?
I'm wondering how to train a neural network for a round based board game like, tic-tac-toe, chess, risk or any other round based game.
Getting the next move by inference seems to be pretty straight forward, by feeding the game state as input and…
soriak
- 249
- 1
- 2
- 3
14
votes
3 answers
What are some implications of Gödel's theorems on AI research?
Note: My experience with Gödel's theorem is quite limited: I have read Gödel Escher Bach; skimmed the 1st half of Introduction to Godel's Theorem (by Peter Smith); and some random stuff here and there on the internet. That is, I only have a vague…
k.c. sayz 'k.c sayz'
- 2,121
- 13
- 27