S3 download large files (.Net)

Question

We are trying to download large files(>2 GB) through a C#.Net web application(AWS .Net SDK) from S3 to browser's(user/local) machine.

This is getting memory out of flow exception when using below

Amazon.S3.Transfer.TransferUtility.OpenStreamAsync().

Please suggest the best approach to download large(>2 GB) S3 file using .Net SDK?

Answer

The .NET SDK is just returning back the Stream from S3. It doesn't buffer the the object into memory. I suspect depending on how you are returning the stream back through your web stack it is attempting to read the entire stream before sending it down to the client.

Answer

Hello! As a workaround, you could try installing the AWS CLI on the same machine and calling the "aws s3 cp" commands from .Net

S3 download large files (.Net)

Contenido relevante