2 Answers
- Newest
- Most votes
- Most comments
1
You can use the AWS SDK for Python (Boto3) to programmatically create a dataset, upload data to AWS S3, and then import the data into a Redshift DB. Here's a high-level overview of the steps involved:
-
Create a Dataset: Use the
create_data_setmethod from the AWSDataExchange client in Boto3 to create a dataset in AWS Data Exchange. -
Upload Data to AWS S3: Use the
put_objectmethod from the S3 client in Boto3 to upload your data to an S3 bucket. -
Create and Send Data Grants: Use the
create_data_setandcreate_revisionmethods from theAWSDataExchangeclient in Boto3 to create a data grant and associate it with your dataset.
0
Hi! The APIs for Sending data grants are not available yet; you need to use the console for that action right now.
answered 2 months ago
Relevant content
- asked 4 months ago
- asked 3 months ago
- Accepted Answerasked a year ago
AWS OFFICIALUpdated 10 months ago- AWS OFFICIALUpdated 7 months ago
Thank you for your quick help.
Not sure which parameter can be used to provide the AWS Account details in which the dataset needs to be created
response = client.create_data_set( AssetType='S3_SNAPSHOT'|'REDSHIFT_DATA_SHARE'|'API_GATEWAY_API'|'S3_DATA_ACCESS'|'LAKE_FORMATION_DATA_PERMISSION', Description='string', Name='string', Tags={ 'string': 'string' } )
To specify the AWS account in which the dataset should be created, you need to assume a role in each account where the dataset will be created. The role to be assumed should be specific to the account where the dataset is being created. This approach allows you to create the dataset in the desired AWS account by assuming the appropriate role in each target account.