Questions tagged with Amazon Athena
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am trying to connect to an external s3 bucket as a data source for a glue crawler. The bucket has the necessary arn permissions as i can connect to it via s3 browser as an external bucket. The...
1
answers
0
votes
660
views
asked 5 months agolg...
HIVE_BAD_DATA: Not valid Parquet file: s3://adp-to-aqt-dev/partition1/partition1.csv expected magic number: PAR1 got: ,,
This query ran against the "" database, unless qualified by the query.
1
answers
0
votes
501
views
asked 5 months agolg...
I've loaded some CSV files from an S3 bucket into tables in a Glue DB. I'm trying to query the tables using Athena, but I keep getting this...
1
answers
0
votes
413
views
asked 5 months agolg...
Hello.
I am currently completing the AWS Industry Quest: Financial Industry but I'm unable to do so as 2 modules produce errors that prevent me from continuing. The modules "Securing a Banking Data...
1
answers
0
votes
472
views
asked 5 months agolg...
I'm converting my json files with dynamic schema to Parquet and used a Glue Crawler to create Glue Table to query using Athena. I got the below error as one column in my table got array<string> in one...
2
answers
0
votes
397
views
asked 5 months agolg...
When creating a QuickSight Dataset using CDK, we have to specify the input_columns parameter for physical_table_map. Is there a way to include all columns in the table without having to write out all...
1
answers
0
votes
455
views
asked 5 months agolg...
Hi
In Athena Notebooks,
```
df = spark.createDataFrame([
(2, "Alice"), (5, "Bob")], schema=["age", "name"])
t = df.collect()
%table t
```
the displayed table looks like a typical pandas...
Accepted AnswerAmazon Athena
1
answers
0
votes
433
views
asked 5 months agolg...
If I try to return the dataframe or use json.dumps(df) in Athena Spark start_calculation_execution codeBlock, they results appear in stdout file in S3 folder for the session and query execution. How...
0
answers
0
votes
247
views
asked 5 months agolg...
I am trying to follow the notebook here to create a AWS Athena database, fill it with data from Amazon reviews and execute a query....
1
answers
0
votes
419
views
asked 5 months agolg...
We're using ICEBERG table and we see that each update increase the number of folders and PARQUET files in S3, although data itself wasn't change. Is there an option to compacting and optimizing...
1
answers
0
votes
429
views
asked 5 months agolg...
Hi,
I'm using MERGE INTO with UPDATE on top of ICEBERG.
For example
`MERGE INTO accounts t USING monthly_accounts_update s
ON (t.customer = s.customer)
WHEN MATCHED
THEN UPDATE SET...
0
answers
0
votes
158
views
asked 5 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
246
views
asked 5 months agolg...