RDF format for aws Neptune

0

I have multiple csv I want to convert these csv in n-triple. I have used Rdflib library now when I am running that code it is taking very high time took 4-5 hours still running.... Suggest any other way to convert into n-triple my csv file has 20000 records.

asked 10 months ago251 views
1 Answer
1
Accepted Answer

I am not an RDFLIB expert, but as N-Triples format is highly parallelizable and assuming your CSV format is the same (e.g., every row is independent), I would suggest looking to parallelize your process. If you split the file into say 20 files of 1,000 and run them in parallel, whether as a Glue job, AWS Batch job, or maybe containers...or even kicking off 20 shell processes on an EC2 instance, beyond doing the transformation in parallel, it will also likely be faster because it will have less memory pressure.

AWS
AWS-BMO
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions