Multipart upload process verification

0

I'm using windows 10 with all the latest fixes and I have wireshark installed, too. How can I verify that my AWS upload to my S3 bucket is using 6 processes like I told it to use in the config. I'm not that familiar with wireshark and tasklist doesn't help me either. I have my upload script coded in Python using boto3.

  • In another forum, I was advised to use Process Explorer in Sysinternals Suite by Microsoft to see how many processes are running for a given parent/child relationship. It shows that I'm only running one aws_pc_backup process. I configured it to run 6, which I start running in aws_pc_backup, so I expected to see 6 children of aws_pc_backup. Did I do something wrong? I coded aws_copy_backups to call aws_pc_backup and aws_pc_backup starts the upload process using a config with 6 processes. I code this in python using the boto3 utility. Is there something I'm missing here?

    Here's the screen print of that Process Explorer screen:

    Enter image description here

  • I did some more research and I'm using the client upload_file method to upload to s3. In one area it mentions that a config can be provided, but in another area it doesn't mention config at all. Which is the case?

    Did mention it here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3.html No mention here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-uploading-files.html

  • By the way, I did double check. I do, of course, have threads=True in my code.

  • I will create an issue in GitHub under boto3 for this.

  • i submitted an issue on this in github.

    https://github.com/boto/boto3/issues/3445

1개 답변
0
수락된 답변

I figured it out myself. Process explorer in windows 10 from the sysinternals suite has an option to check properties of a process and then see how many threads that process is using. I was able to see that my process was using 6 threads, so I'm happy. Here's the screen print.

Enter image description here

답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠