Can AWS Glue read data from different SQL Server table, generate csv files and zipping it to S3?
0
I need to load data from multiple tables in a SQL server to S3 for some batch processing. Can AWS Glue read data from different SQL Server table, generate csv files and zipping it to S3? And can AWS Glue run R script functions?
asked 4 months ago17 views
1 Answers
1
Accepted Answer
Hi,
yes, AWS Glue can read from multiple SQL Server tables,apply transformation with Spark (Pyhotn or Scala) and write to Amazon in S3 in different output format, compressed CSV is one of them.
As mentioned, AWS Glue is a Serverless Spark environment and you can build your jobs wit Python and Scala. R is not natively supported.
hope this helps
Relevant questions
AWS Glue ETL from SQL Server DB on premises to Snowflake on AWS cloud
asked a month agoCopying data from sql server to snowflake with AWS GLUE
asked a month agoCan AWS Glue read data from different SQL Server table, generate csv files and zipping it to S3?
Accepted Answerasked 4 months agoHow could we have Glue to get data from csv as String?
Accepted Answerasked 2 months agoHow can i run SQL statements in my AWS Glue Script
asked 2 months agoAWS Glue - setting data target for RDS mysql
asked 2 months agoGlue Jobs & Multiple tables
Accepted Answerasked 4 years ago403 Access denied error from S3 in Glue
Accepted Answerasked 5 years agoGenerating Parquet files from Glue Data Catalog
asked 25 days agoI need to read S3 data, transform and put into Data Catalog. Should I be using a Crawler?
Accepted Answerasked 3 months ago