Questions tagged with AWS Glue DataBrew
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
AWS Glue visual joblg...
Hi
I was trying to work on a simple problem where I am taking data from 3 csv files in s3(source) and after combining them, I am appending them to a table in postgre sql where my database is by...
1
answers
0
votes
359
views
asked 2 years agolg...
Hello Team ,
I have created Docker compose file mentioned below :
```
version: "2"
services:
spark:
image: glue/spark:latest
container_name: spark
** build: ./spark**
hostname: spark
...
1
answers
0
votes
593
views
asked 2 years agolg...
I am trying to implement a data quality framework for an application which ingests data from various systems(batch, near real time, real time). Few items that I want to highlight here are:
* The data...
1
answers
0
votes
2142
views
asked 2 years agolg...
Hi,
This is question with Databrew data profile capability. I am looking for record-level tracking per rule validation status. This will provide while rules has failed on a record from the dataset....
1
answers
0
votes
453
views
asked 2 years agolg...
Hi All,
I want to make this transformation :
columnA, columnB, columnC
to
Struct {columnA:"",columnB:"", columnC:""}
to
Array [{columnA:"",columnB:"", columnC:""}]
The first two step works,...
1
answers
0
votes
258
views
asked 2 years agolg...
DataBrew Filterlg...
Is there a way to filter a column in DataBrew using the contains operator in a case where you would like to filter by more than one word? I would like to filter an address column that contains the...
1
answers
0
votes
324
views
asked 2 years agolg...
I failed to connect to the RDS postgreSQL database using glue, and failed to return the following message:
Check that your connection definition references your JDBC database with correct URL syntax,...
2
answers
1
votes
7714
views
asked 2 years agolg...
I have a AWS Glue customer doing POC and found that each output job creates a separate output csv file. They want to be able to create a single csv output file combining multiple input jobs or files....
1
answers
0
votes
2866
views
asked 2 years agolg...
I'm using a Table resource to create a Glue Table like so:
```
this.glueTable = new Table(scope, `${props.glueTableName}`, {
database: this.glueDatabase,
tableName:...
2
answers
0
votes
1188
views
asked 2 years agolg...
I am trying to create a connection from AWS Glue to MongoDB, but when I test the connection it fails with error: "Check that your connection definition references your Mongo database with correct URL...
1
answers
0
votes
325
views
asked 2 years agolg...
Hi All,
I'm looking for a Test Data management (TDM) tool in AWS which can perform below requirements,
1. TDM tool to Connect Production S3 bucket to extract files for anonymization and load it in...
2
answers
0
votes
811
views
asked 2 years agolg...
Hello,
I'm trying to import datasets in DataBrew from a PostgreSQL db. Some tables have Case Sensitive names, others don't.
When I try to import Tables with only lowercase letters in their names,...
0
answers
0
votes
118
views
asked 2 years agolg...