1 Answer
- Newest
- Most votes
- Most comments
0
Hi there, Is it not possible that the table contains a null header and sagemaker is reading that header as col1 instead thus giving you that shift in the data structure. If that is not the case then it is possible you already had an col0 and it is moving up the data a column when you append col1, col2 and so on.
Hopefully this gives you more to think about and puts you in the right direction.
Regards NN
answered 2 years ago
Relevant content
- asked 9 months ago
- asked 7 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
Hi NN,
The data is coming from a Redshift table/select expression so I can't see how a "null header" is possible. And each run generates a fresh set of files in S3, so I'm not sure what it means for columns to be appended.
Do you have examples of null headers or columns moving around, that would be very interesting to look into.
Regards, SV