Most Popular

1500 questions
15
votes
1 answer

How can the convolution operation be implemented as a matrix multiplication?

How can the convolution operation used by CNNs be implemented as a matrix-vector multiplication? We often think of the convolution operation in CNNs as a kernel that slides across the input. However, rather than sliding this kernel (e.g. using…
15
votes
3 answers

Why exactly do neural networks require i.i.d. data?

In reinforcement learning, successive states (actions and rewards) can be correlated. An experience replay buffer was used, in the DQN architecture, to avoid training the neural network (NN), which represents the $Q$ function, with correlated (or…
15
votes
1 answer

What is the relation between online (or offline) learning and on-policy (or off-policy) algorithms?

In the context of RL, there is the notion of on-policy and off-policy algorithms. I understand the difference between on-policy and off-policy algorithms. Moreover, in RL, there's also the notion of online and offline learning. What is the relation…
14
votes
3 answers

What are the differences between A* and greedy best-first search?

What are the differences between the A* algorithm and the greedy best-first search algorithm? Which one should I use? Which algorithm is the better one, and why?
Marosh Fatima
  • 375
  • 1
  • 3
  • 10
14
votes
3 answers

What are the specific requirements of the Turing test?

What are the specific requirements of the Turing test? What requirements if any must the evaluator fulfill in order to be qualified to give the test? Must there always be two participants in the conversation (one human and one computer) or can…
14
votes
2 answers

Is there any scientific/mathematical argument that prevents deep learning from ever producing strong AI?

I read Judea Pearl's The Book of Why, in which he mentions that deep learning is just a glorified curve fitting technology, and will not be able to produce human-like intelligence. From his book there is this diagram that illustrates the three…
Graviton
  • 261
  • 3
  • 8
14
votes
1 answer

Why is A* optimal if the heuristic function is admissible?

A heuristic is admissible if it never overestimates the true cost to reach the goal node from $n$. If a heuristic is consistent, then the heuristic value of $n$ is never greater than the cost of its successor, $n'$, plus the successor's heuristic…
Wizard
  • 313
  • 1
  • 2
  • 6
14
votes
3 answers

How do I compute the structural similarity between sentences?

I am working on a problem where I need to determine whether two sentences are similar or not. I implemented a solution using BM25 algorithm and wordnet synsets for determining syntactic & semantic similarity. The solution is working adequately,…
Shubham Tiwari
  • 243
  • 1
  • 2
  • 6
14
votes
1 answer

How could I use reinforcement learning to solve a chess-like board game?

I invented a chess-like board game. I built an engine so that it can play autonomously. The engine is basically a decision tree. It's composed by: A search function that at each node finds all possible legal moves An evaluation function that…
14
votes
1 answer

Are the dialogs at Sophia's (the robot) appearings scripted?

I talk about the robot from: Hanson Robotics, which was granted the right to citizenship from Saudi Arabia. I have found the following articles: Your new friend is a humanoid robot Source: theaustralian.com.au Like Amazon Echo, Google Assistant and…
14
votes
4 answers

What is the "dropout" technique?

What purpose does the "dropout" method serve and how does it improve the overall performance of the neural network?
kenorb
  • 10,525
  • 6
  • 45
  • 95
14
votes
6 answers

What would motivate a machine?

Currently, within the AI development field, the main focus seems to be on pattern recognition and machine learning. Learning is about adjusting internal variables based on a feedback loop. Maslow's hierarchy of needs is a theory in psychology…
Aleksei Maide
  • 251
  • 3
  • 14
14
votes
2 answers

Is the mean-squared error always convex in the context of neural networks?

Multiple resources I referred to mention that MSE is great because it's convex. But I don't get how, especially in the context of neural networks. Let's say we have the following: $X$: training dataset $Y$: targets $\Theta$: the set of parameters…
14
votes
3 answers

How to train a neural network for a round based board game?

I'm wondering how to train a neural network for a round based board game like, tic-tac-toe, chess, risk or any other round based game. Getting the next move by inference seems to be pretty straight forward, by feeding the game state as input and…
soriak
  • 249
  • 1
  • 2
  • 3
14
votes
3 answers

What are some implications of Gödel's theorems on AI research?

Note: My experience with Gödel's theorem is quite limited: I have read Gödel Escher Bach; skimmed the 1st half of Introduction to Godel's Theorem (by Peter Smith); and some random stuff here and there on the internet. That is, I only have a vague…