Run multiple Datasync jobs in parallel

0
Run multiple Datasync jobs in parallel
I have an agent installed in my data center that is located in a private network. I can start one job at a time to move the data from on prem to s3. If I started another job it's queued (waiting for the first job to be completed). I believe this is not the way it should work. Is there something that is not well configured? Can anyone help in this? I want to know If I'm allowed to run several jobs to upload the data using the same agent from my data center to s3
질문됨 5달 전392회 조회
1개 답변
0

Hi!

Remember the following about running multiple tasks:

  1. Tasks run in a series (first in, first out). If you run the same task more than once, by default each execution goes into a queue. If you start a task twice, for instance, the second task execution won't start until the first one finishes.
  2. You can run separate tasks at the same time, but these tasks will be queued if they're using the same DataSync agent.

You can also take a look at this document: https://aws.amazon.com/es/blogs/storage/how-to-accelerate-your-data-transfers-with-aws-datasync-scale-out-architectures/

You may need to set multiple agents to run the same task in parallel Enter image description here

답변함 5달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠