- Newest
- Most votes
- Most comments
Unload is designed to handle export large amounts of data without any impact on the table. All the best practices for S3 PUT are incorporated. Are you exporting for data lake or retention purpose?
The UNLOAD operation in Amazon Timestream for LiveAnalytics does not directly impact the performance of the Timestream table itself. The UNLOAD command is designed to export query results to Amazon S3, and it operates on the result set of a query rather than directly on the table.
When you use the UNLOAD statement, you're essentially running a SELECT query and then exporting those results to S3. The impact on performance is primarily related to the query itself, not the export process. Once the query results are obtained, the export to S3 is a separate operation that doesn't affect the original Timestream table.
However, it's important to note that there are some best practices and limitations to keep in mind:
-
The query associated with the UNLOAD operation times out after 60 minutes. It's recommended to export no more than 60GB of data in a single query.
-
If you need to export larger amounts of data, it's advised to split the job across multiple queries. This approach helps manage the load and prevents long-running queries from impacting other operations.
-
While you can send thousands of requests to S3 to upload the data, it's recommended to parallelize the write operations to multiple S3 prefixes. This helps avoid potential S3 API call rate throttling.
In this regard, the mechanism is similar to exporting data from DynamoDB to S3. The export process itself doesn't directly impact the performance of the source table. However, the initial query to retrieve the data might have some impact, depending on its complexity and the amount of data being processed.
To minimize any potential impact, you should consider running your UNLOAD operations during off-peak hours and optimize your queries to retrieve only the necessary data.
Sources
Best practices for UNLOAD from Timestream for LiveAnalytics - Amazon Timestream
UNLOAD - Amazon Timestream
Relevant content
- asked a year ago
- asked a year ago
- asked 2 years ago
- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 3 years ago

Retention. What about the 60 GB and timeout limit that the AI has posted about?