Whether you're taking your first steps with Kubernetes or you're an experienced practitioner looking to sharpen your skills, our Amazon EKS workshop series delivers practical, real-world experience that moves you forward. Learn directly from AWS solutions architects and EKS specialists through hands-on sessions designed to build your confidence with Kubernetes. Register now and start building with Amazon EKS!
Questions tagged with Extract Transform & Load Data
Content language: English
Filter questions
Select tags to filter
Sort by
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
722 results
Hi, in AWS docs it is said that data that Glue jobs use is encrypted via KMS keys when it is at rest and in transit, which provides ambiguity since Glue jobs might use S3 instead of their local disk. ...
I have an IAM role for my bucket that has the following permissions:
"s3:PutObject",
"s3:GetObject",
"iam:PassRole",
"kms:Decrypt",
"kms:Encrypt",
"kms:GenerateDataKey",
"s3:ListBucket",
"s3:DeleteObj...
I am attempting to use Hudi 1.1.1 in an AWS 5.0 Glue job. To avoid conflicts with the pre-installed Glue Hudi libraries, I have set the job parameter `--datalake-formats` to an empty string (""). Howe...
I am building a Lakehouse solution using aws glue visual etl. When writing the dataset using the target s3 node in visual editor, there is no option to specify writemode() to overwrite
When i checked ...
I’m running into an issue with AWS Clean Rooms when associating an AWS Glue table. The table association succeeds, but when another member of the collaboration tries to query it, they get:
"Status not...
AWS Glue Python Shell currently only supports Python 3.6 and 3.9, which are both end-of-life. Is there a roadmap or planned timeline for releasing a newer Python runtime (e.g., 3.10+ ) for Python Shel...
I have written a custom script to transform a column, data transformed successfully and I can verify that in data preview in aws glue studio, acft_tail_num -> 8911(earlier this was N8911 ) when I joi...
I am using KDS which pushes to Kinesis Data Firehose which loads data into my S3 bucket.
My S3 bucket is currently structured as follows:
s3://bucket_name/anyCompany/year/month/day/hour/jsonFiles
Eac...
asked 3 months ago
I am using Spark to read and write to a S3table bucket. I have configured it the following way:
spark = SparkSession.builder.appName("SparkIcebergSQL") \
.config("spark.jars.packages", "org.apach...
Please find the two DQDL rules I am trying to formate. They are not working as desired. Please let me know if there is any issue with the syntax.
- check_type: "DQDL"
check: CustomSql "SELECT a,b...
I am writing a simple AWS Glue ETL job as a Python script which reads a record from a Snowflake table and updates the corresponding record in Salesforce. However, I am getting the following error "Err...
I'm using AWS Glue with the SAP OData Connector to extract data from an SAP OData service. The service has nullable fields properly configured on the SAP side (e.g., ESTIMATEDCOSTCOSTINGRUNDATE), and ...