Questions tagged with Data Lakes
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have an AWS Data Lake that is ready to be used at the moment.
My use case for the Data Lake is to be able to, ingest data from different API connectors (coming from other data vendors and service...
1
answers
0
votes
1605
views
asked 2 years agolg...
Lake Formation Blueprint occurred an error that "NoCredentialsError: Unable to locate credentials"lg...
I ran an Lake Formation BluePrint and result was as follows:
| method to run | result |
| --- | --- |
| by hand | COMPLETED |
| scheduled | IMPORT FAILED(NoCredentialsError: Unable to locate...
0
answers
0
votes
160
views
asked 2 years agolg...
Hi all,
I'm using a glue job that reads CSV files from S3 and injects data to MySQL RDS.
at the end of my pyspark glue script, I call a stored procedure. the issue is the glue job status end by...
1
answers
0
votes
1367
views
asked 2 years agolg...
Following the aws blog post : [Dynamic Partitioning](https://aws.amazon.com/blogs/big-data/kinesis-data-firehose-now-supports-dynamic-partitioning-to-amazon-s3/).
So I have a firehose delivery...
1
answers
0
votes
3245
views
asked 2 years agolg...
Hi Team,
I run an AWS glue job that reads data from a CSV file located on an S3 bucket to my aurora MySQL DB.
My job fails because it interprets an empty string from the CSV ("") as a null value then...
1
answers
0
votes
3912
views
asked 2 years agolg...
Does AWS currently, or does it have planned for the future, an equivalent service to "NewSQL" services such as TiDB, Vitess, Yugabyte, and Oracle Heatwave? My understanding is that these services...
1
answers
0
votes
1813
views
asked 2 years agolg...
Could you please tell me whether there is any AWS service that can mask the content of S3 files? (Data masking/Anonymization).
For Example,
1. Masking Name from John to 'abcd'
2. Masking Phone...
3
answers
1
votes
2098
views
asked 2 years agolg...
Hi team, I have an AWS glue job that reads data from the CSV file in s3 and injects the data on a table in MySQL RDS Aurora DB.
the escapeChar used on the CSV file is the backslash (\).
I have 2...
1
answers
0
votes
906
views
asked 2 years agolg...
Hi team,
I have an AWS glue job that reads data from the CSV file in s3 and injects the data on a table in MySQL RDS Aurora DB.
The issue is all lines in the CSV file with escaped characters are...
1
answers
0
votes
1870
views
asked 2 years agolg...
I'm syncing data written to S3 using Apache Hudi with Hive & Glue.
Hudi options:
```
hudi_options:
'hoodie.table.name': mytable
'hoodie.datasource.write.recordkey.field': Id
...
1
answers
0
votes
4392
views
asked 2 years agolg...
Hi,
I am signed in with a userId which has IAM Administrator access and DataLake Administrator access. The userId also has permissions to table columns set up in Lake Formation. However when...
2
answers
0
votes
532
views
asked 2 years agolg...
Business users regularly host data on Microsoft SharePoint. Is there any way to get csv or xlsx data in SPICE, that doesn't involve using a prorietary solution ?
1
answers
0
votes
1042
views
asked 2 years agolg...