Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
HI , I have data in delta format in s3 ,
created external table with following query .
>CREATE EXTERNAL TABLE delta_mongo.transactions
> ( `_id` string ,
>account_id bigint,
>bucket_end_date...
0
answers
0
votes
149
views
asked 2 years agolg...
From time to time I have a csv file coming with single row and it breaks the Glue Crawler because of the at least 2 row requirement to be classified as a CSV.
Is there a way I can provide a custom CSV...
0
answers
0
votes
172
views
asked 2 years agolg...
We have incoming file with the fixed length field length (.dat).
For example:
|2|123 |AWS |0505 |3
When Glue Crawler crawles the file, it ignores all the int/long values that have trailing...
0
answers
0
votes
134
views
asked 2 years agolg...
SYNTAX_ERROR: line 1:8: SELECT * not allowed from relation that has no columns
I got the above error while trying to preview my created table created with AWS Glue Crawler. The file is my test data...
0
answers
0
votes
171
views
asked 2 years agolg...
I need to share a workflow that has an EventBridge trigger. **[Glue Blueprint doesn't seem to be an option right now as it doesn't support EventBridge...
0
answers
0
votes
88
views
asked 2 years agolg...
Hi,
I have a Glue job script that ingests tables from a Postgres database to AWS Catalog database. Here are the steps of the ingestion:
1. Read postgres tables using SparkDF
2. Convert SparkDF to...
0
answers
0
votes
413
views
asked 2 years agolg...
I am reading a parquet file from S3 in AWS Glue job and creating a Dynamic Frame. I have a requirement of enforcing schema on it before writing the data to a Redshift table. I have the required schema...
0
answers
0
votes
63
views
asked 2 years agolg...
Hi,
I'm trying to iterate through the results returned from SelectFields action using the following command
```
SelectFields_node1656679636429.toDF().index
```
but i get the following error
>...
0
answers
0
votes
65
views
asked 2 years agolg...
While running AWS glue Job facing this error
0
answers
0
votes
50
views
asked 2 years agolg...
Hello there:
We have ingest jobs A, B, C, and D and Transformation jobs X and Y in PySpark
For Workflow 1: the steps are:
1. Once Job A, B, and C successfully done
2. Start transformation job...
0
answers
0
votes
126
views
asked 2 years agolg...
I need to pre-process some data on S3 before the Glue Crawler crawls the data. For this I created an S3 Object Lambda to do the pre-processing. If I test the Object Lambda using the CLI, it provides...
0
answers
1
votes
188
views
asked 2 years agolg...
In the [documentation](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-libraries.html) I can see that we can add additional modules from pip using the following...
0
answers
0
votes
83
views
asked 2 years agolg...