We trained an adapter based on 500 documents and it worked perfectly for weeks until I noticed something strange today.
Some queries started returning multiple values for the same query without appearing in the detected raw text.
For example:
For the query "What is the license plate number?" the adapter would previously only output one value which would be "ABC123".
Now, it adds a second answer with the exact same confidence value, which is either a duplicate of the correct answer or complete gibberish/made up.
In some instances, the read out values do not even appear in the raw text and they don't have any bounding boxes attached, Textract simply seems to hallucinate.
I was able to replicate this issue on every document I tried to analyze using the adapter.
This is a huge issue to say the least. I don't know what happened. As we did not change anything within the code or on the adapter version, so I'm assuming, that it might be an issue with the Textract model.
Any chance I could fall back on a previous version of Textract? Are you aware of this issue?
Thanks in advance.
Hello, I have a similar problem. The thing is that before the textract model was working well and locally it continues to work well but when passing it to docker it does not detect the text values as it does locally. I asked about this but haven't gotten a response. https://repost.aws/questions/QUI0AMII5fTh6-YF817TAHqQ/textract-is-not-working-as-it-should