Questions tagged with AWS Glue DataBrew
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello Team ,
I have created Docker compose file mentioned below :
```
version: "2"
services:
spark:
image: glue/spark:latest
container_name: spark
** build: ./spark**
hostname: spark
...
1
answers
0
votes
551
views
asked 2 years agolg...
I am trying to implement a data quality framework for an application which ingests data from various systems(batch, near real time, real time). Few items that I want to highlight here are:
* The data...
1
answers
0
votes
2041
views
asked 2 years agolg...
Hi,
This is question with Databrew data profile capability. I am looking for record-level tracking per rule validation status. This will provide while rules has failed on a record from the dataset....
1
answers
0
votes
422
views
asked 2 years agolg...
Hi All,
I want to make this transformation :
columnA, columnB, columnC
to
Struct {columnA:"",columnB:"", columnC:""}
to
Array [{columnA:"",columnB:"", columnC:""}]
The first two step works,...
1
answers
0
votes
227
views
asked 2 years agolg...
DataBrew Filterlg...
Is there a way to filter a column in DataBrew using the contains operator in a case where you would like to filter by more than one word? I would like to filter an address column that contains the...
1
answers
0
votes
289
views
asked 2 years agolg...
I failed to connect to the RDS postgreSQL database using glue, and failed to return the following message:
Check that your connection definition references your JDBC database with correct URL syntax,...
2
answers
1
votes
7218
views
asked 2 years agolg...
I have a AWS Glue customer doing POC and found that each output job creates a separate output csv file. They want to be able to create a single csv output file combining multiple input jobs or files....
1
answers
0
votes
2710
views
asked 2 years agolg...
I'm using a Table resource to create a Glue Table like so:
```
this.glueTable = new Table(scope, `${props.glueTableName}`, {
database: this.glueDatabase,
tableName:...
2
answers
0
votes
1118
views
asked 2 years agolg...
I am trying to create a connection from AWS Glue to MongoDB, but when I test the connection it fails with error: "Check that your connection definition references your Mongo database with correct URL...
1
answers
0
votes
296
views
asked 2 years agolg...
Hi All,
I'm looking for a Test Data management (TDM) tool in AWS which can perform below requirements,
1. TDM tool to Connect Production S3 bucket to extract files for anonymization and load it in...
2
answers
0
votes
756
views
asked 2 years agolg...
Hello,
I'm trying to import datasets in DataBrew from a PostgreSQL db. Some tables have Case Sensitive names, others don't.
When I try to import Tables with only lowercase letters in their names,...
0
answers
0
votes
103
views
asked 2 years agolg...
I've glue catalog and use s3 as DB. Datatype of columns are numeric in Redshift which i'm casting as decimal in Glue. But getting issue while querying the data in Athena. Column in redshift looks like...
1
answers
0
votes
497
views
asked 2 years agolg...