All Content tagged with Extract Transform & Load Data

I am using AWS Glue crawler with a JDBC connection to an Oracle database. The crawler successfully discovers oracle tables, but it does not discover Oracle views. Can you confirm whether AWS Glue cra...

I'm running AWS Glue ETL jobs that perform SQL operations on Amazon S3 Tables (Iceberg), using the AWS analytics services integration approach. ### Setup I followed the official documentation for int...

I have configured a Zero-ETL integration from Aurora MySQL to Redshift using History Mode. All is working OK. I created another couple of schemas in the same Redshift database which I now can not dr...

The problems I'm having: s3 tables maintenance fails, cannot access s3 tables in Athena s3 table maintenance fails: I make my s3 tables in a glue etl job, they show up in my s3 table bucket, but if i...

Hi there, I'm trying to test this new AWS Glue REST API Connectors, but I can not make them work. Since it's a new product and there's not a lot of documentation or examples in the web, I thought som...

Hi team, I am trying to send data to a Hubspot from s3 using Glue connector.I am facing two issues 1.Firstly the Glue connector which i created and saved using the available Hubspot connector has st...

Hi, in AWS docs it is said that data that Glue jobs use is encrypted via KMS keys when it is at rest and in transit, which provides ambiguity since Glue jobs might use S3 instead of their local disk. ...

I have an IAM role for my bucket that has the following permissions: "s3:PutObject", "s3:GetObject", "iam:PassRole", "kms:Decrypt", "kms:Encrypt", "kms:GenerateDataKey", "s3:ListBucket", "s3:DeleteObj...

I am attempting to use Hudi 1.1.1 in an AWS 5.0 Glue job. To avoid conflicts with the pre-installed Glue Hudi libraries, I have set the job parameter `--datalake-formats` to an empty string (""). Howe...

I am building a Lakehouse solution using aws glue visual etl. When writing the dataset using the target s3 node in visual editor, there is no option to specify writemode() to overwrite When i checked ...

I’m running into an issue with AWS Clean Rooms when associating an AWS Glue table. The table association succeeds, but when another member of the collaboration tries to query it, they get: "Status not...

AWS Glue Python Shell currently only supports Python 3.6 and 3.9, which are both end-of-life. Is there a roadmap or planned timeline for releasing a newer Python runtime (e.g., 3.10+ ) for Python Shel...