Multipart upload process verification

0

I'm using windows 10 with all the latest fixes and I have wireshark installed, too. How can I verify that my AWS upload to my S3 bucket is using 6 processes like I told it to use in the config. I'm not that familiar with wireshark and tasklist doesn't help me either. I have my upload script coded in Python using boto3.

  • In another forum, I was advised to use Process Explorer in Sysinternals Suite by Microsoft to see how many processes are running for a given parent/child relationship. It shows that I'm only running one aws_pc_backup process. I configured it to run 6, which I start running in aws_pc_backup, so I expected to see 6 children of aws_pc_backup. Did I do something wrong? I coded aws_copy_backups to call aws_pc_backup and aws_pc_backup starts the upload process using a config with 6 processes. I code this in python using the boto3 utility. Is there something I'm missing here?

    Here's the screen print of that Process Explorer screen:

    Enter image description here

  • I did some more research and I'm using the client upload_file method to upload to s3. In one area it mentions that a config can be provided, but in another area it doesn't mention config at all. Which is the case?

    Did mention it here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3.html No mention here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-uploading-files.html

  • By the way, I did double check. I do, of course, have threads=True in my code.

  • I will create an issue in GitHub under boto3 for this.

  • i submitted an issue on this in github.

    https://github.com/boto/boto3/issues/3445

1 Antwort
0
Akzeptierte Antwort

I figured it out myself. Process explorer in windows 10 from the sysinternals suite has an option to check properties of a process and then see how many threads that process is using. I was able to see that my process was using 6 threads, so I'm happy. Here's the screen print.

Enter image description here

beantwortet vor 2 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen