Most Popular
1500 questions
9
votes
2 answers
5 years later, are maxout networks dead, and why?
Maxout networks were a simple yet brilliant idea of Goodfellow et al. from 2013 to max feature maps to get a universal approximator of convex activations. The design was tailored for use in conjunction with dropout (then recently introduced) and…
user209974
- 211
- 1
- 2
9
votes
5 answers
What's a good resource for getting familiar with reinforcement learning?
I am familiar with supervised and unsupervised learning. I did the SaaS course done by Andrew Ng on Coursera.org.
I am looking for something similar for reinforcement learning.
Can you recommend something?
Martin S
- 233
- 1
- 6
9
votes
6 answers
How to evaluate a NEAT neural network?
I'm trying to write my own implementation of NEAT and I'm stuck on the network evaluate function, which calculates the output of the network.
NEAT as you may know contains a group of neural networks with continuously evolving topologies by the…
Chris
- 193
- 2
- 9
9
votes
1 answer
Why does nobody use decision trees for visual question answering?
I'm starting a project that will involve computer vision, visual question answering, and explainability. I am currently choosing what type of algorithm to use for my classifier - a neural network or a decision tree.
It would seem to me that, because…
The Impossible Squish
- 231
- 1
- 5
9
votes
4 answers
Can a neural network work out the concept of distance?
Imagine a game where it is a black screen apart from a red pixel and a blue pixel. Given this game to a human, they will first see that pressing the arrow keys will move the red pixel. The next thing they will try is to move the red pixel onto the…
zooby
- 2,260
- 1
- 14
- 22
9
votes
1 answer
Why aren't there neural networks that connect the output of each layer to all next layers?
Why aren't there neural networks that connect the output of each layer to all next layers?
For example, the output of layer 1 would be fed to the input of layers 2, 3, 4, etc. Beyond computational power considerations, wouldn't this be better than…
Christopher Jernigan
- 91
- 1
9
votes
1 answer
How does weight normalization work?
I was reading the paper Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks about improving the learning of an ANN using weight normalization.
They consider standard artificial neural networks where the…
Mike AI
- 145
- 2
- 8
9
votes
5 answers
Can prior knowledge be encoded in deep neural networks?
I was reading Gary Marcus's a Critical Appraisal of Deep Learning. One of his criticisms is that neural networks don't incorporate prior knowledge in tackling a problem. My question is: have there been any attempts at encoding prior knowledge in…
Seth Simba
- 1,186
- 1
- 11
- 29
9
votes
1 answer
In YOLO, what exactly do the values associated with each anchor box represent?
I'm going through Andrew NG's course, which talks about YOLO, but he doesn't go into the implementation details of anchor boxes.
After having looked through the code, each anchor box is represented by two values, but what exactly are these values…
moondra
- 209
- 2
- 4
9
votes
2 answers
How can I use neural networks for detecting TV channel logos in video frames?
I am trying to detect a TV channel logo inside a video file. So, simply, given an input .mp4 video, detect if it has that logo present in a specific frame, say the first frame, or not.
Here's the first example of a frame with a logo.
Here's the…
Mary
- 993
- 6
- 13
9
votes
1 answer
Should I use neural networks or genetic algorithms to solve Gomoku?
Currently, I'm doing a project that's about creating an AI to play the game Gomoku (it's like tic tac toe, but played on a 1515 board and requires 5 in a row to win). I have already successfully implemented a perfect tic tac toe AI using Q-learning…
Conway
- 93
- 4
9
votes
1 answer
What are the different approaches used in Machine Learning?
There seem to be so many sub-fields, so I'm interested in getting a better understanding of the approaches.
I'm looking for information on a single framework per answer, in order to allow for granularity without the overall answer getting too long.…
kakaz
- 271
- 1
- 6
9
votes
2 answers
How is the "right to explanation" reasonable?
There has been recent uptick in interest in eXplainable Artificial Intelligence (XAI). Here is XAI's mission as stated on its DARPA page:
The Explainable AI (XAI) program aims to create a suite of machine learning techniques that:
Produce more…
LastIronStar
- 91
- 2
9
votes
1 answer
When to use Tanh?
When and why would you not use Tanh?
I just replaced ReLU with Tanh and my model trains about 2x faster, reaching 90% acc within 500 steps.
While using ReLU it reached 90% acc in >1000 training steps.
I believe the reason it trained faster was due…
vxnuaj
- 125
- 1
- 6
9
votes
5 answers
Why isn't ethics more integrated into current AI systems?
I am a PhD student in computer science, and currently creating a state of the art overview in applications done in Machine Ethics (a multidisciplinary field combining philosophy and AI, that looks at creating explicit ethical programs or agents). It…
Suzanne
- 99
- 5