1 Answers
0
solved by converting the file from s3 to Uint8Array - example code
fs.open(filename, 'r', function (err, fd) {
var buffer = Buffer.alloc(1);
var data = new Uint8Array(fileSize);
var n = 0
while (true) {
var num = fs.readSync(fd, buffer, 0, 1, null);
if (num === 0)
break;
data[n] = buffer[0]
n += 1
}
console.log(parseRecord(data));
});
not optimized, but working for me.
where filename
is the filename from s3, and fileSize
is the num of bytes of the file.
HTH for anyone is using open telemetry
answered 7 months ago
Relevant questions
UWP C++ S3 PutObject (upload file) error: Unable to parse ExceptionName: BadRequest Message: An error occurred when parsing the HTTP request.
asked 2 years agoHow to load large amount of data from S3 onto Sagemaker?
asked 7 months agoKinesis data stream - data transfer charges for on-premises consumer/producer
Accepted Answerasked 4 years agoTransferring data from AWS Kinesis data streams to AWS Redshift using AWS Glue
asked a month agoAWS CloudWatch metrics to OpenSearch
asked 4 months agoUsing JavaScript and AWS SDK to access S3 Bucket without Credentials
asked 2 years agoKinesis Transformation Buffering from Data Stream
Accepted Answerasked 3 months agoHow to set document id when delivering data from Kinesis Data Firehose to Opensearch index
asked 5 months agoError when trying to parse OpenTelemetry 0.7.0 data from metric streams
asked 7 months agoInternalFailureException when trying to load turtle files from S3
asked 2 years ago