Questions tagged [bias]
15 questions
5
votes
2 answers
Does value iteration still return the true Q-values in stochastic environment?
I'm working with the FrozenLake environment (8x8) from Gymnasium.
In the deterministic case (is_slippery=False), I understand that using value iteration can converge to the true Q-values, since the environment is fully observable and transitions are…
Jien Weng
- 69
- 4
3
votes
2 answers
Is the Bellman backup unbiased?
This is comes from cs285 2023Fall hw3.
In my opinion, if $\hat{Q}$ is unbiased estimate of $Q$, then
$$
\begin{align}
\mathbb{E}_{D \sim P}[B_{D}\hat{Q} - B_{D}Q]
&= \mathbb{E}_{D \sim P}[r(s,a) + \gamma max_{a'}\hat{Q}(s', a') - r(s,a) - \gamma…
yeebo xie
- 77
- 6
3
votes
0 answers
Why do neural networks have bias units?
Why do neural networks have bias units? Why is it sometimes okay to opt them out?
Dinamo
- 31
- 1
2
votes
3 answers
Why my classification results are correlated with the proportionality of my data?
I'm facing a problem. I'm working on mixed data model with NN (MLP & Word Embedding). My results are not pretty good. And I observed that the proportionality of my data are corelated with my classification results. I explain:
As you can see, I have…
Alexandre Juan
- 21
- 1
1
vote
1 answer
How is estimation bias quantified in reinforcement learning?
In various estimation problems, especially in RL domains, where we currently looking into Q-learning and its variants, we often encounter the term estimation bias, which refers to the systematic deviation of an estimator’s expected value from the…
Jien Weng
- 69
- 4
1
vote
1 answer
How AI can it answer a question without bias
If AI like chatgpt, gemini and other AI has bias and user safety net like the data it has and censorship, how can we have unbiased and uncensored answers?
Like if you ask is "is the moon landing a hoax?", it will answer no because of the data it has…
jmazaredo
- 113
- 4
1
vote
1 answer
In multilayer perceptron, to update the Bias value, do we use the neuron's delta, or do we use the sum of all deltas?
In multilayer perceptron, to update the Bias value, do we use the neuron's delta, or do we use the sum of all deltas?
I ask this because I once saw a video on YouTube where the formula for updating the neuron's Bias in backpropagation, The…
will The J
- 267
- 1
- 6
1
vote
0 answers
Does the number of biases in a Convolutional layer scale with the number of images?
I am convolving 32 grey scale images of size 28 x28 with 16 filters of size 5x5.
Which of the following is the correct way to add biases to the convolution operation output?
add 1 scalar value bias for each of the 16 filters. (Each of the 32 images…
The Ace
- 11
- 2
1
vote
1 answer
Not able to understand Pytorch Tensor (Weight & Biases) Size for Linear Regression
Below are the two tensors
[ 73., 67., 43.]
[ 91., 88., 64.],
[ 87., 134., 58.],
[102., 43., 37.],
[ 69., 96., 70.]
[ 56., 70.],
[ 81., 101.],
[119., 133.],
[ 22., 37.],
[103., 119.]
These are the weight that are added
Weights and…
ZKS
- 121
- 3
0
votes
1 answer
Is there any evidence that the bias terms help in the attention mechanism of the transformers?
In the original transformer paper, the attention mechanism uses parameter matrices, but no bias terms. However, in more recent implementations I see people often using a bias term when computing "key", "query", and "value". For example, in Andrej…
Tarvoc
- 1
0
votes
1 answer
Confusion about bias in McCulloch-Pitts neurons
I just have a quick question, maybe I am too nit picky here.
We recently had an introductory lecture to AI in university and the professor talked about McCulloch-Pitts neurons, e.g. activation as soon as the sum of inputs is reaching a certain…
DerOeko
- 13
- 3
0
votes
1 answer
Is there a way to freeze training for weights, but not biases in PyTorch?
I'm constructing a neural network where the weights of my first hidden layer (connected to the input) are all 1 (identity matrix), but the biases are variable.
Is there a way to "freeze" any updates/training to the weights in a specific layer, but…
Nova
- 143
- 4
0
votes
1 answer
Bias equal to 1 and neuron output equal to -1 in neural networks
I have read that bias in neural networks is used to avoid situation in which output of neuron is equal to 0. But what if the same output is equal to -1 and we add 1 to it? Isn't it the same issue as in case of zero output and no bias?
bridgemnc
- 125
- 3
0
votes
1 answer
Can we change bias and control the output of neural network?
I have read the use of Targeted Adversarial Attacks for making the model perform better. But can we change the bias of the neural networks and control the outcome of the network rather than changing the input. if yes, can you share some resources or…
harsha
- 101
0
votes
0 answers
How is the bias added after the convolution in a CNN?
I'm having trouble understanding how bias is added to the feature extraction convolution. I've seen people either refer to the bias as a single number that changes per filter or the whole matrix that is the size of the output. Here is what I…
