By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

Is it possible to omit header rows when exporting a SageMaker DataWrangler flow to s3 (via a Jupyer Notebook)?

0

I am exporting a DataWrangler flow to s3 via a Jupyter Notebook using SageMaker Studio. Each of the resulting CSV files (each containing a part of the transformed dataset) include a header row with the column names. However when using a CSV file as training input for a Sagemaker estimator, header rows are not accepted. Is there an option in DataWrangler to export to s3 without header rows?

Topics
StorageMachine Learning & AI
Tags
Amazon Simple Storage ServiceAmazon SageMakerMachine Learning & AIAmazon SageMaker Data Wrangler
Language
English
rePost-User-4986866
asked 2 years ago536 views
1 Answer
1

Yes. See https://aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.s3.to_csv.html options 'pandas_kwargs' where you can pass header=False to suppress header rows (per https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_csv.html)

profile picture
jhmartin1
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content