How are the assumed thresholds for Amazon Rekognition Custom Labels computed?
In the Per label performance section of my model's evaluation summary in the Amazon Rekognition console, I can see an Assumed threshold metric. How are those metrics computed?
When I collected all the confidence levels computed for a given class in the test dataset, I could see that the minimum confidence level for my KO label was 0.87, while the minimum confidence level for the OK label was around 0.30. Is there some kind of heuristics going on (for example, 90% of the minimum confidence level observed for a class?), or is there a precise mathematical definition behind the assumed thresholds?
Also, is there a way to get the assumed thresholds programmatically with the Amazon Rekognition Custom Labels API?
- 최신
- 최다 투표
- 가장 많은 댓글
The assumed threshold for each label is the value above which a prediction is counted as a true or false positive. The metric is calculated based on the best F1 score achieved on the test dataset during model training. For more information, see the Assumed threshold section in the Rekognition Custom Labels guide.
To get the assumed thresholds programmatically, use the Rekognition SDK. The assumed thresholds are listed in the summary file output.
