Questions tagged [precision]

13 questions
4
votes
4 answers

Is it possible that Precision and Recall increase together?

Usually, it is said in ML that there is a trade-off between Precision and Recall. I wonder if it is possible that Precision and Recall can increase together?
DSPinfinity
  • 1,223
  • 4
  • 10
2
votes
0 answers

Training tricks to improve stability of mixed precision

I would love to be able to use automatic mixed precision more extensively in my training, but I find that it is too unstable and often ends in NaNs. Are there any general tricks in training that people here have used to improve stability? I've seen…
Luke
  • 21
  • 2
2
votes
1 answer

Why doesn't the high precision of neural network weights improve accuracy?

Consider the following paragraph from the subsubsection 3.5.2: A dtype for every occasion chapter named It starts with a tensor from the textbook titled Deep Learning with PyTorch by Eli Stevens et al. As we will see in future chapters,…
hanugm
  • 4,102
  • 3
  • 29
  • 63
2
votes
2 answers

Is it possible that every class has a higher recall than precision for multi-class classification?

I am a student learning machine learning recently, and one thing is keep confusing me, I tried multiple sources and failed to find the related answer. As following table shows (this is from some paper): Is it possible that every class has a higher…
1
vote
1 answer

Might use of rational numbers and calculations be beneficial for an ANN?

Rational numbers would help alleviate some gradient issues by not losing precision as the weights and the propagated values (signal) reach extremely low and high values. I'm not aware of any hardware that is optimized for rationals. GPUs are all…
1
vote
1 answer

High precision and low recall results. What does it mean?

I am working on a classification algorithm for brain rhythms. However, when I implemented the metrics for precision, accuracy, F1 score and recall. My results show that my algorithm has a high precision but a low recall. I am not expert on this kind…
GGChe
  • 123
  • 1
  • 5
1
vote
2 answers

What is meant by a "relevant document" in NLP?

In natural language processing, I came across the concept of "relevant document" several times. And several analytical formulas, such as precision, recall are based on the relevant documents. Precision = $\dfrac{\text{Number of documents that are…
1
vote
1 answer

Is my understanding of confidence (precision) correct?

I'm attempting to develop a genetic algorithm capable of discovering classification rules for a given data set, a number of papers make use of the confidence (precision) and coverage of a rule to define its fitness. In particular, I've been…
1
vote
1 answer

Given the precision and recall of this model, what can I say about it?

The following table shows the precision and recall values I obtained for three object detection models. The goal is to find the best object detection model for that particular data set. I evaluate the first two models as the following. Model 1 has…
1
vote
1 answer

How to calculate the precision and recall given the predictions and targets in this case?

I'm using three pre-trained deep learning models to detect vehicles and count from an image data set. The vehicles belong to one of these classes ['car', 'truck', 'motorcycle', 'bus']. So, for a sample I have manually counted number of vehicles in…
0
votes
2 answers

What does a value of -1.000 mean in MS COCO Metrics for Object Detection

I am training some Object-Detection-Models from the TensorFlow Object Detection API and got from the evaluation with MS COCO metrics the following results for Average Precision: IoU = 0.5;0.9 maxDets = 100 area = small AP = -1.000 The other values…
0
votes
2 answers

What is Precision@K for link prediction in graph embedding meaning?

I am trying to re-implement the SDNE algorithm for graph embedding by PyTorch. I get stuck at some issues about evaluation metric Precision@K. precision@k is a metric which gives equal weight to the returned instance. It is defined as…
Truong Hoang
  • 127
  • 1
  • 6
-1
votes
1 answer

Equations for computing true positives and false positives when using object detection algorithms?

I am running some evaluation metrics using the YOLOv5 object detection algorithm, and wish to calculate my true positives and false positives. For instance, the evaluation metric outputs are as follows: Class Images Labels Prec …
sneeze_shiny
  • 129
  • 1
  • 10