Skip to content

Textract bulk document download

0

Hi, I used Textract bulk document uploader to process over 9k documents. Now I need to download the processed files. However, I found I can only download 50 files each time. Is there any way to download all 99k processed files with one click?

Enter image description here

asked 2 years ago223 views

1 Answer
2
Accepted Answer

I apologize, but there isn't a way to download all 9,000 processed files from the Textract Bulk Document Uploader with a single click. The Bulk Document Uploader has some limitations that affect large-scale processing and downloading:

  1. It can only process up to 150 documents per bulk processing request.
  2. Results are available for download for seven days after processing.
  3. Documents are cleared from the Submitted Documents panel after 14 days.

Given these constraints, you would need to submit multiple requests to process 9,000 documents, and then download the results in batches. The limitation of downloading 50 files at a time that you've encountered is part of the tool's design.

For processing and managing such a large number of documents, you might want to consider a more programmatic approach using Amazon Textract APIs directly, combined with other AWS services. This could involve:

  1. Using the StartDocumentTextDetection or StartDocumentAnalysis API calls for asynchronous processing.
  2. Implementing a workflow that uses AWS Lambda functions triggered by Amazon S3 events when new documents are uploaded.
  3. Using Amazon SNS (Simple Notification Service) or Amazon SQS (Simple Queue Service) to receive notifications when processing is complete.
  4. Automating the retrieval of results using GetDocumentTextDetection or GetDocumentAnalysis API calls.
  5. Storing the results in your own S3 bucket for easier management and bulk access.

This approach would give you more control over the processing and allow you to automate the download of all your processed files, rather than relying on the console's Bulk Document Uploader interface.
Sources
Best Practices for Bulk Document Uploader - Amazon Textract
Options for processing large documents using Amazon Textract? | AWS re:Post
Processing Documents Asynchronously - Amazon Textract

answered 2 years ago

EXPERT

reviewed 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.