- Newest
- Most votes
- Most comments
Hello.
Is it possible to identify files that failed to upload?
Also, is it possible to add "--debug" to the command option?
I think there is a possibility that some detailed log is output to the debug log.
aws s3 sync --cache-control 'max-age=604800' ./projects/dashboard-reporting/dist s3://dashboard-reporting-1234567 --delete --debug
Please also check that the bucket name is correct.
Even simple misspellings can cause errors.
https://github.com/aws/aws-cli/issues/1276
Also, I think the IAM policy is set properly, but please check it according to the document below just to be sure.
https://repost.aws/knowledge-center/s3-access-denied-listobjects-sync
From local it works without any issue
Some of the logs are trimmed due to the comment limit. I am sharing it here:
2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - botocore.retries.standard - DEBUG - Not retrying request. 2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - botocore.hooks - DEBUG - Event needs-retry.s3.PutObject: calling handler <bound method S3RegionRedirector.redirect_from_error of <botocore.utils.S3RegionRedirector object at 0x7a8f570ec128>> 2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - botocore.hooks - DEBUG - Event after-call.s3.PutObject: calling handler <function enhance_error_msg at 0x7a8f5792ff28> 2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - botocore.hooks - DEBUG - Event after-call.s3.PutObject: calling handler <bound method RetryQuotaChecker.release_retry_quota of <botocore.retries.standard.RetryQuotaChecker object at 0x7a8f570ec080>> 2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - s3transfer.utils - DEBUG - Releasing acquire 41/None Completed 5.7 MiB/5.8 MiB (13.6 MiB/s) with 1 file(s) remaining Completed 5.8 MiB/5.8 MiB (13.3 MiB/s) with 1 file(s) remaining upload: projects/dashboard-reporting/dist/styles.js to s3://dashboard-reporting-12345/styles.js 2024-06-26 15:18:41,463 - Thread-1 - awscli.customizations.s3.results - DEBUG - Shutdown request received in result processing thread, shutting down result thread. fatal error: An error occurred (NoSuchBucket) when calling the ListObjectsV2 operation: The specified bucket does not exist Error: Process completed with exit
Relevant content
- asked 3 years ago
- asked 5 years ago
- asked 2 years ago
AWS OFFICIALUpdated a year ago- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
We have already granted AmazonS3FullAccess permission to the role. And also the sync command fails on different files like style.js or some times main.js etc. Also the weird thing is that some of the files are uploaded successfully to the bucket. Output logs are here after enabling debug mode: .......................... upload: projects/dashboard-reporting/dist/main.js to s3://dashboard-reporting-12345/main.js Completed 5.4 MiB/5.8 MiB (14.7 MiB/s) with 3 file(s) remaining Completed 5.5 MiB/5.8 MiB (14.0 MiB/s) with 3 file(s) remaining upload: projects/dashboard-reporting/dist/assets/images/placeholders/site-highlight.png to s3://dashboard-reporting-12345/assets/images/placeholders/site-highlight.png Completed 5.5 MiB/5.8 MiB (14.0 MiB/s) with 2 file(s) remaining Completed 5.7 MiB/5.8 MiB (13.6 MiB/s) with 2 file(s) remaining upload: projects/dashboard-reporting/dist/vendors-node_modules_echarts_index_js.js to s3://dashboard-reporting-12345/vendors-node_modules_echarts_index_js.js 2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - urllib3.connectionpool - DEBUG - https://dashboard-reporting-12345.s3.ap-southeast-1.amazonaws.com:443 "PUT /styles.js HTTP/1.1" 200 0 2024-06-26 15:18:41,462 - ThreadPoolExecutor-0_3 - botocore.parsers - DEBUG - Response headers: {'x-amz-id-2': 'XS9ywjI5hwHiu1pPStQWR2xtwpcmLue6duetQNaNwJfxB+P9y9HXdDEZm5a5B9+ciEPRdEXkqvSEt7qn/44fPQ==', 'x-amz-request-id': 'VEB245F427VCN6FG', 'Date': 'Wed, 26 Jun 2024 15:18:42 GMT', 'x-amz-server-side
From the looks of it, it doesn't seem like there is an error. Can you check if the same file etc. can be uploaded using the same command from a local PC etc.?