Questions tagged with Amazon Athena
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
HIVE_BAD_DATA: Not valid Parquet file: s3://adp-to-aqt-dev/partition1/partition1.csv expected magic number: PAR1 got: ,,
This query ran against the "" database, unless qualified by the query.
1
answers
0
votes
482
views
asked 5 months agolg...
I've loaded some CSV files from an S3 bucket into tables in a Glue DB. I'm trying to query the tables using Athena, but I keep getting this...
1
answers
0
votes
399
views
asked 5 months agolg...
Hello.
I am currently completing the AWS Industry Quest: Financial Industry but I'm unable to do so as 2 modules produce errors that prevent me from continuing. The modules "Securing a Banking Data...
1
answers
0
votes
468
views
asked 5 months agolg...
I'm converting my json files with dynamic schema to Parquet and used a Glue Crawler to create Glue Table to query using Athena. I got the below error as one column in my table got array<string> in one...
2
answers
0
votes
391
views
asked 5 months agolg...
When creating a QuickSight Dataset using CDK, we have to specify the input_columns parameter for physical_table_map. Is there a way to include all columns in the table without having to write out all...
1
answers
0
votes
446
views
asked 5 months agolg...
Hi
In Athena Notebooks,
```
df = spark.createDataFrame([
(2, "Alice"), (5, "Bob")], schema=["age", "name"])
t = df.collect()
%table t
```
the displayed table looks like a typical pandas...
Accepted AnswerAmazon Athena
1
answers
0
votes
413
views
asked 5 months agolg...
If I try to return the dataframe or use json.dumps(df) in Athena Spark start_calculation_execution codeBlock, they results appear in stdout file in S3 folder for the session and query execution. How...
0
answers
0
votes
245
views
asked 5 months agolg...
I am trying to follow the notebook here to create a AWS Athena database, fill it with data from Amazon reviews and execute a query....
1
answers
0
votes
409
views
asked 5 months agolg...
We're using ICEBERG table and we see that each update increase the number of folders and PARQUET files in S3, although data itself wasn't change. Is there an option to compacting and optimizing...
1
answers
0
votes
411
views
asked 5 months agolg...
Hi,
I'm using MERGE INTO with UPDATE on top of ICEBERG.
For example
`MERGE INTO accounts t USING monthly_accounts_update s
ON (t.customer = s.customer)
WHEN MATCHED
THEN UPDATE SET...
0
answers
0
votes
156
views
asked 5 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
234
views
asked 5 months agolg...
I am trying to see if I can use EMR Serverless to serve as a compute engine for customers querying data in S3. But even with pre-initialized capacity, the simplest of queries possible (select 1+2 as...
1
answers
0
votes
183
views
asked 5 months agolg...