HDFS command to convert to AWS S3

0

We are having many HDFS commands on our ETL scripts. Due to cloud migration we need to convert the HDFS commands to AWS S3 commadns.

We have a command as below:

hdfs dfs -text ${OUTPUT_PATH}/part* | hdfs dfs -cp ${INPUT_PATH}/${FILENAME}

Need help to convert this to S3 command, mainly the first part with '-text'.

Abhisek
已提问 2 年前217 查看次数
1 回答
0

Did you try this command to select the object content? https://docs.aws.amazon.com/cli/latest/reference/s3api/select-object-content.html

已回答 2 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则