Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Is it possible to wildcard the include path for a MongoDB crawler. I've tried a number of different options similar to the options available for JDBC and other relational database connections, but...
1
answers
0
votes
151
views
asked 4 months agolg...
I receive a file from external vendor. The file is in ***.dat*** format. Once the file arrives into my S3 bucket, I have to trigger a AWS Glue job to read the file and load into my Redshift table. I...
2
answers
0
votes
233
views
asked 4 months agolg...
My dataframe has 2 columns - name and age. If there is name Manish with 2 rows one with age 16 and another with age 23 , will AWS data quality fail both, pass both or one fail one pass. for below...
1
answers
0
votes
263
views
asked 4 months agolg...
I have a glue job that transforms data from glue table. And I encounter the following error. It does not occur for every run of the job.
I have looked at a few documentarians, it seems to be coming...
1
answers
0
votes
379
views
asked 4 months agolg...
Hello
I am using Glue Pyspark to handle ETL, but when I tried running script with bookmark, I found out that if one script handles more than one table and one of them doesn't have changes or...
2
answers
0
votes
413
views
asked 4 months agolg...
When I try and add a new BigQuery connection as a sink for glue I am getting the following error:
InvalidInputException: jdbcEnforceSsl: is not defined in the schema and the schema does not allow...
1
answers
0
votes
188
views
asked 4 months agolg...
I have a Kinesis stream that is persisting (inserting) data to an iceberg table, via a Glue streaming job. I'm following the glue streaming pattern as published...
2
answers
0
votes
1623
views
asked 4 months agolg...
I tried AWS Glue data quality dynamic rules in my AWS Glue pipeline. I wrote below rule
RowCount > avg(last(3))
Then I processed 3 csv files with 1000,10000 and 100 rows. Then in 4th run I again...
1
answers
0
votes
265
views
asked 4 months agolg...
Glue service with SSL enabled document db connection is always timing out. when i disable cert ,my connection is working fine.
I am not sure where to pass the SSL cert when i create a documentdb...
4
answers
0
votes
550
views
asked 4 months agolg...
Can't create Glue Connection to RDS MySQL - [Error] Failed to test connection due to FAILED status.lg...
Hello, I have problem when create Glue connection to RDS MySQL.
My RDS MySQL instance put in private subnet, with NAT Gateway, and Glue have necessary permissions (I use old IAM role, which I...
1
answers
0
votes
156
views
asked 4 months agolg...
I have looked at the glue java packages and couldn't find any. Thx.
Accepted AnswerAWS Glue
1
answers
0
votes
94
views
asked 4 months agolg...
Hello, we created a job in AWS Glue, where it extracts a table from a JDBC connection, and takes this data to an S3 bucket, in parquet format.
We have the following problem, if one of these data is...
Accepted AnswerAWS Glue
2
answers
0
votes
252
views
asked 4 months agolg...