1 Answer
- Newest
- Most votes
- Most comments
0
Normally you don't limit IOPS since the DB will do that "throttling" by taking longer, the main impact in the number of connections in parallel, which you can control by controlling the number of cores in the cluster or the number of partitions (using repartition or coalesce) in the data (whichever is lower).
Relevant content
- Accepted Answer
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- How can I use a Lambda function to automatically start an AWS Glue job when a crawler run completes?AWS OFFICIALUpdated 2 years ago
Sorry I should have mentioned, RDS is cross account and a shared database so I cannot change RDS config
That's not what I suggested (that would throttle all users equally), all I talked about is done in the Glue code