Amazon Textract adapter for Custom Query seems to not use it's training.

0

I have an adapter that I trained on a query that looks for a logo on every page. It returns a binary response. When I trained the adapter, I got 100.0% accuracy on all pages. I had a training/test split of 93/77 pages. Now, I am attempting to use the adapter on some documents that were in the test set and some documents that were not. About half the responses are wrong. Has anyone else run into this issue, and if so, how did you solve it?

demandé il y a 5 mois663 vues
1 réponse
0

Hi Jon,

Thank you for your question.

Hope this answers your question, and if so, please accept this answer. Have a great day!

AWS
keithm
répondu il y a 5 mois
  • Thank you for your suggestions. The logo is pretty much just capitalized text, so in theory textract could be fine for this use case. I'm still confused about why multiple documents from the testing dataset performed clearly differently from the what happened during training. They seemed to have consistent responses, but they don't seem to be consistent with the evaluation that occurred during training. Do you have any potential explanations for why this could be the case?

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions