Rekognition custom labels "No predictions for this image" instead of "False Negative"

0

I'm training a Rekognition custom labels model. After finish the training I see the legend "No predictions for this image" in some files. All files are labeled with bounding boxes so my expectation was find a "False Negative" message for elements not detected by the model, instead of "No predictions for this image"

What means "No predictions for this image" and there is any difference with "False Negative" message?

질문됨 2년 전396회 조회
2개 답변
1

Hello, if you can open a customer support ticket and provide us with:

  1. your account ID
  2. your Project Version ARN
  3. the TestingDataResult/Input GT manifest
  4. the TestingDataResult/Output GT manifest
  5. the TestingDataResult/Validation GT manifest

then we can take a closer look at your model and give you more specialized information. Thank you.

AWS
답변함 2년 전
profile picture
전문가
검토됨 한 달 전
0

Hi CGarces,

Thanks for reaching out for this problem. DetectCustomLabels does not return any labels/predictions with a confidence value that is lower than the MinConfidence value given in DetectCustomLabels API call. If you specify a value of 0, DetectCustomLabels returns all labels, regardless of the assumed threshold applied to each label. If you don't specify a value for MinConfidence, DetectCustomLabels returns labels based on the assumed threshold of each label. The assumed threshold is calculated based on the best F1 score achieved on the test dataset during model training for each label. You are probably not specifying a MinConfidence/threshold value.

Please specify MinConfidence parameter as 0, or a lower value to get some or all of predictions. Please also refer to the following resources for more information:

Please let us know if this problem continues for you. Thanks.

AWS
답변함 2년 전
profile picture
전문가
검토됨 한 달 전
  • I'm training the model, the messaged is raise by the AWS web interface. There is no option to set the confidence during training.

  • can you provide details about your training time and region ?

  • Training was done in eu-west-1 last one was 2022-07-06T17.41.23

  • Hi, If this happens in training, this means that your training or test dataset have not much enough samples. I understand that your training succeeded but possibly performance of trained model is not good. Please try again with a larger dataset. Thanks.

  • In my opinion is a bug. If the test dataset has a item labeled and the model can't detect it (due enough samples as you said), it must be set as "False Negative", according to the AWS documentation. "False negative – The Amazon Rekognition Custom Labels model doesn't predict that a custom label is present in the image, but the "ground truth" for that image includes this label" https://docs.aws.amazon.com/rekognition/latest/customlabels-dg/im-metrics-use.html

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠