Questions tagged [binary-crossentropy]
5 questions
2
votes
1 answer
Is BCE commutative?
Is binary cross entropy commutative? Both in math theory and in PyTorch?
I'm not fresh enough on my math to tell straight by looking at the formula and code.
BCE(x,y) =?= BCE(y,x)
Thomas Eding
- 123
- 3
2
votes
1 answer
What are pros and cons of using a multi-head neural network versus a single neural network for multi-label classification?
I haven't been able to find a good discussion specifically comparing the two (only one describing a classification and regression problem). I am training a classifier to learn both age and gender based on genomic data. Every sample has a known age…
user9317212
- 181
- 2
- 13
1
vote
0 answers
Categorical loss function for variable number of labels
I have a model for binary classification. The target variable has the different number of labels (instances) in each sample. For example, a batch of size 2 with 2 and 3 instances and correspondingly with 2 and 3 labels (0 and 1):
y_true =…
Mykola Zotko
- 111
- 4
1
vote
1 answer
Is it appropriate to use a softmax activation with a categorical crossentropy loss?
I have a binary classification problem where I have 2 classes. A sample is either class 1 or class 2 - For simplicity, lets say they are exclusive from one another so it is definitely one or the other.
For this reason, in my neural network, I have…
user9317212
- 181
- 2
- 13
0
votes
1 answer
Why is `SigmoidBinaryCrossEntropyLoss` in `DJL` implemented this way?
SigmoidBinaryCrossEntropyLoss implementation in DJL accepts two kinds of outputs from NNs:
where sigmoid activation has already been applied.
where raw NN output is taken as is.
The choice is determied by fromSigmoid parameter.
Here's how (1)…
src091
- 1
- 2