Most Popular
1500 questions
34
votes
6 answers
How does an AI like ChatGPT answer a question in a subject which it may not know?
After seeing StackOverflow's banning of ChatGPT, I explored it out of curiosity. It's marvellous as it can write code by itself!
Later to check if it knows chess as well like Google-Deepmind's AlphaZero AI, I asked below questions:
Me: Does openai…
iammilind
- 443
- 1
- 4
- 9
33
votes
4 answers
How to find the optimal number of neurons per layer?
When you're writing your algorithm, how do you know how many neurons you need per single layer? Are there any methods for finding the optimal number of them, or is it a rule of thumb?
kenorb
- 10,525
- 6
- 45
- 95
32
votes
2 answers
What is sample efficiency, and how can importance sampling be used to achieve it?
For instance, the title of this paper reads: "Sample Efficient Actor-Critic with Experience Replay".
What is sample efficiency, and how can importance sampling be used to achieve it?
Gokul NC
- 473
- 1
- 4
- 7
32
votes
3 answers
Where can I find the proof of the universal approximation theorem?
The Wikipedia article for the universal approximation theorem cites a version of the universal approximation theorem for Lebesgue-measurable functions from this conference paper. However, the paper does not include the proofs of the theorem. Does…
Leroy Od
- 485
- 1
- 5
- 4
31
votes
2 answers
How is a deep neural network different from other neural networks?
How is a neural network having the "deep" adjective actually distinguished from other similar networks?
kenorb
- 10,525
- 6
- 45
- 95
31
votes
4 answers
Can neural networks be used to prove conjectures?
Imagine I have a list (in a computer-readable form) of all problems (or statements) and proofs that math relies on.
Could I train a neural network in such a way that, for example, I enter a problem and it generates a proof for it?
Of course, those…
Max Mustermann Junior
- 311
- 3
- 3
31
votes
7 answers
Is artificial intelligence vulnerable to hacking?
The paper The Limitations of Deep Learning in Adversarial Settings explores how neural networks might be corrupted by an attacker who can manipulate the data set that the neural network trains with. The authors experiment with a neural network meant…
Surya Sg
- 495
- 4
- 13
31
votes
5 answers
Is it possible to train a neural network as new classes are given?
I would like to train a neural network (NN) where the output classes are not (all) defined from the start. More and more classes will be introduced later based on incoming data. This means that, every time I introduce a new class, I would need to…
Th3Nic3Guy
- 459
- 1
- 4
- 11
31
votes
1 answer
How is BERT different from the original transformer architecture?
As far as I can tell, BERT is a type of Transformer architecture. What I do not understand is:
How is Bert different from the original transformer architecture?
What tasks are better suited for BERT, and what tasks are better suited for the…
chessprogrammer
- 3,050
- 2
- 16
- 26
31
votes
1 answer
What is the Bellman operator in reinforcement learning?
In mathematics, the word operator can refer to several distinct but related concepts. An operator can be defined as a function between two vector spaces, it can be defined as a function where the domain and the codomain are the same, or it can be…
nbro
- 42,615
- 12
- 119
- 217
30
votes
4 answers
Is Lisp still being used to tackle AI problems?
I know that language of Lisp was used early on when working on artificial intelligence problems. Is it still being used today for significant work? If not, is there a new language that has taken its place as the most common one being used for work…
WilliamKF
- 2,533
- 1
- 26
- 31
30
votes
4 answers
What are the current theories on the development of a conscious AI?
What are the current theories on the development of a conscious AI? Is anyone even trying to develop a conscious AI?
Is it possible that consciousness is an emergent phenomenon, that is, once we put enough complexity into our system, it will become…
Micky-D
- 401
- 4
- 3
30
votes
2 answers
What are "bottlenecks" in neural networks?
What are "bottlenecks" in the context of neural networks?
This term is mentioned, for example, in this TensorFlow article, which also uses the term "bottleneck values". How does one calculate bottleneck values? How do these values help image…
Anurag Singh
- 411
- 1
- 5
- 11
30
votes
4 answers
Why is ChatGPT bad at math?
As opposed to How does ChatGPT know math?, I've been seeing some things floating around the Twitterverse about how ChatGPT can actually be very bad at math. For instance, I asked it "If it takes 5 machines 5 minutes to make 5 devices, how long would…
Mithical
- 2,965
- 5
- 28
- 39
30
votes
7 answers
How can an AI train itself if no one is telling it if its answer is correct or wrong?
I am a programmer but not in the field of AI. A question constantly confuses me is that how can an AI be trained if we human beings are not telling it its calculation is correct?
For example, news usually said something like "company A has a large…
user31556