Can't activate Data Sync Agent
I'm following the below tutorial to create a Data Sync agent to move data from a Google Cloud Storage bucket to S3. However, I can't find the activation key.
In step 3 of the tutorial, under 'For your VPC' #11 instructs you to the Create Agent Screen (attached screenshot) which says
'When your DataSync agent has been deployed, enter its domain name or IP address. When you click Get key, your browser will connect to this address to get a unique activation key."
However, it doesn't allow me to deploy the agent without this activation key. The instructions to reference something that isn't created don't make a lot of sense to me. But, I've tried everything I can think of to get this to work.
How can I move past this step and create the data sync agent?
Tutorial Link: https://docs.aws.amazon.com/datasync/latest/userguide/tutorial_transfer-google-cloud-storage.html
- Newest
- Most votes
- Most comments
Hello,
For automatically activating the agent you will want to input the IP address of the agent you deployed in step 9, into the text box you highlighted. This will allow your console to automatically retrieve the activation key and activate the agent. The agent is deployed as an EC2 instance prior to activation. https://docs.aws.amazon.com/datasync/latest/userguide/activate-agent.html
The console will require access to the agent via port 80 so ensure you have port 80 open in your security group to the IP of your console during automatic activation. https://docs.aws.amazon.com/datasync/latest/userguide/datasync-network.html#using-vpc-endpoint
You can deploy DataSync Agent as EC2 machine within VPN and use the IP address in agent address section of the configuration and then click get key , wait for sometime and you will get the activation key once everything is configured properly. This should work for you.
On the other hand with 2nd option where you can create HMAC key on GCP account.
- Create an HMAC key for your Google service account.
- Make sure that your Google service account has at least Storage Object Viewer permissions.
- Save your HMAC key's access ID and secret in a secure location.
Relevant content
- Accepted Answerasked 10 months ago
- asked 2 years ago
- asked a year ago
AWS OFFICIALUpdated a year ago- AWS OFFICIALUpdated 2 months ago
Hi Darryl,
Thanks for your response, but I'm still a little confused. I believe Step 3-'For your vpc'-step 9 is deploying an ec2 instance not a data sync agent. When I put the Private IPv4 addresses of the ec2 instance (I don't see a public IPv4 address) into the 'activate your agent,' section it runs for a while then errors out saying it can't connect. Also, I'm using the default security group, which has all ports open. What am I missing?
I don't see a spot to post screenshots, so I'll add them as another answer.
Hi, Review your security group settings as you may need to open port 80 inbound to activate, as long as your console can access that private ip address. If your intention is to only configure the agent with a private IP you can also look into manual activation by obtaining the key from the agent local console via SSH from an instance that has access to the private IP space. If you intended to use a public IP you can redeploy the EC2 instance in a public subnet and select "Auto-assign public IP" is enabled. https://docs.aws.amazon.com/datasync/latest/userguide/local-console-vm.html#get-activation-key https://docs.aws.amazon.com/datasync/latest/userguide/agent-requirements.html#ec2-instance-types
No good. It keeps timing out when it tries to get the credentials. Can you provide some screenshots or documentation on which IP address should be used for getting the activation credentials?
I even created a whole new VPC and subnet and it still doesn't work.
Is there some sort of support so someone can look at the project and tell me specifically what to do?
@darryl_dio
You reference this help article which says to log into the data sync agent's local console. How do I do that? Can you please provide the link to do that?
https://docs.aws.amazon.com/datasync/latest/userguide/local-console-vm.html#get-activation-key