Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I got the error when write glue dynamic data frame to redshift table .
The code I have used :-
my_conn_op={
"dbtable":"public.xxxx",
...
0
answers
0
votes
434
views
asked a month agolg...
Hello.
I am trying to configure specific iam permission for an user. I need a permission for only read tables from existing Data Catalog.
So, I have configured this policiy:
```
{
"Version":...
0
answers
0
votes
193
views
asked a month agolg...
I've successfully set up AWS Glue with an RDS database serving as the data source and a Snowflake database as the data target. In this setup, I've configured AWS Glue crawlers to catalog the metadata...
0
answers
0
votes
448
views
asked a month agolg...
Hello,
I work as a data engineer and business intelligence specialist for a fintech startup. We've entered into a new agreement with a supplier to provide a technological solution for managing their...
0
answers
0
votes
240
views
asked a month agolg...
I am using aws lakeformation workflow to create a data lake following [this](https://docs.aws.amazon.com/lake-formation/latest/dg/getting-started-tutorial-jdbc.html) guide. everything is setup as...
0
answers
0
votes
119
views
asked a month agolg...
In our ETL process we are building out a pipeline where someones job is to take input files (ex. csv) and map the columns to existing column names. After the mapping is complete a glue workflow will...
0
answers
0
votes
181
views
asked a month agolg...
Hi!
I am trying to use DataZone to share an Iceberg table from the Glue Data Catalog with another AWS account.
I have created the table with Athena in the source account like this:
```sql
CREATE...
0
answers
0
votes
105
views
asked a month agolg...
![Enter image description here](/media/postImages/original/IMBuRkn9W7QT6CvwJB2m8InA)
Hello AWS Community,
I'm encountering an issue while attempting to extract a specific value from a column in AWS...
0
answers
0
votes
80
views
asked a month agolg...
Why don't I see the column - ruleset_name, in the output of s3 file generated by a Glue Data Quality job ? I see the below columns in the JSON output of the Glue DQ job. Is there any way, I can get...
0
answers
0
votes
110
views
asked 2 months agolg...
AWS Glue Python Shell currently supports Python 3.9, whereas AWS Glue Pyspark jobs support Python 3.10 and AWS Lambda up to 3.12. When will we see support for more recent Python runtimes in the AWS...
0
answers
0
votes
104
views
asked 2 months agolg...
Hello, so I have my script that runs an Athena query and sends an email,
When I was testing in my machine in the terminal, running 'python3 name-file.py'. The script works fine, the query is run and...
0
answers
0
votes
140
views
asked 2 months agolg...
Hello AWS Community,
I'm facing a challenging issue with our AWS data pipeline that affects data visualization in Amazon QuickSight. Initially, our setup involved directly importing CSV data from S3...
0
answers
0
votes
203
views
asked 2 months agolg...