Multipart upload process verification

0

I'm using windows 10 with all the latest fixes and I have wireshark installed, too. How can I verify that my AWS upload to my S3 bucket is using 6 processes like I told it to use in the config. I'm not that familiar with wireshark and tasklist doesn't help me either. I have my upload script coded in Python using boto3.

  • In another forum, I was advised to use Process Explorer in Sysinternals Suite by Microsoft to see how many processes are running for a given parent/child relationship. It shows that I'm only running one aws_pc_backup process. I configured it to run 6, which I start running in aws_pc_backup, so I expected to see 6 children of aws_pc_backup. Did I do something wrong? I coded aws_copy_backups to call aws_pc_backup and aws_pc_backup starts the upload process using a config with 6 processes. I code this in python using the boto3 utility. Is there something I'm missing here?

    Here's the screen print of that Process Explorer screen:

    Enter image description here

  • I did some more research and I'm using the client upload_file method to upload to s3. In one area it mentions that a config can be provided, but in another area it doesn't mention config at all. Which is the case?

    Did mention it here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3.html No mention here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-uploading-files.html

  • By the way, I did double check. I do, of course, have threads=True in my code.

  • I will create an issue in GitHub under boto3 for this.

  • i submitted an issue on this in github.

    https://github.com/boto/boto3/issues/3445

1 Answer
0
Accepted Answer

I figured it out myself. Process explorer in windows 10 from the sysinternals suite has an option to check properties of a process and then see how many threads that process is using. I was able to see that my process was using 6 threads, so I'm happy. Here's the screen print.

Enter image description here

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions