What Type of EC2 Instance Should I Use?

Question

Currently I am on the free plan. I am running a python web scraping on a windows script that could be refreshing potentially every minute for tracking several different (20-50 instance requests at a time. Hopefully expanding to more. What infrastructure should I be using, looking for cheapest possible option. Also the web scraping instances are tracking elements on a site that could potentially ban or timeout requests. My python script is connected to a proxies.txt, I am wondering what the best proxies or way to generate proxies is?

Answer

Hi,

Given above I d start simple with t2 or t3 (small/medium) and then vertical scale from there.

You can also consider spot instances if you accept some level of interruption in exchange for cost saving - or evaluate a SpotFleet to mitigate that but pay a bit more

* https://aws.amazon.com/ec2/instance-types/t2/
* https://aws.amazon.com/ec2/instance-types/t3/
* https://aws.amazon.com/ec2/spot/
* https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet.html

Hope it helps ;)

What Type of EC2 Instance Should I Use?

Relevanter Inhalt