Understand whats causing DataTransfer Cost (EC2 free service, tiny program)

0

Hi,

I'm trying to understand whats causing DataTransfer costs in my program. After talking to AWS help, my EC2 instance (free tier) has apparently 'transferred' 13GB of data, however that doesn't make much sense to me.

My program:

3rd Party RSS Feed ---> AWS EC2 Server running 3 python scripts, manipulating data and publishes to database ---> MongoDatabase (not AWS hosted)

Whats weird to me, is that my Mongo Database is 4.44mb in total, so I dont understand how 13GB could have been transferred out of AWS. Is there a way for me to drill more into these costs so I can understand whats causing this data leak?

Any help is appreciated!

3 Answers
2

You can use Flow Logs with Athena to dig into your network traffic. Maybe you're polling the RSS feed too often.

profile pictureAWS
answered 2 years ago
  • Thanks a lot - I am polling it a ton, but because it's fairly high frequency. Wouldn't that be 'data in' to AWS though? and not count towards this DataTransfer? (the rep I talked to told me it was only data out of AWS that counted)

  • You have to send the request out in order to get a response. Even small requests can add up if it's constantly polling.

1

VPC Flow Logs will capture the traffic going in and out of your instance and amount of bytes. Can also use Cloudwatch to monitor the traffic and set alarms for when the traffic goes above a certain threshold. "Data in" from the internet to AWS is not charged https://aws.amazon.com/ec2/pricing/on-demand/#Data_Transfer

AWS
EXPERT
answered 2 years ago
1

In addition to examining VPC flow logs to determine network outbound traffic (DTOs, data transfer out), you may also want to examine network inbound traffic in your MongoDB hosting environment. See if any packets are lost or blocked in your network. This may give you an answer why Mongo Database is still 4.44mb in total. If you would like to find out more details with regard to the data transfer costs in AWS, please refer to: https://aws.amazon.com/blogs/architecture/overview-of-data-transfer-costs-for-common-architectures/

profile pictureAWS
jcvip
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions