how to block a bot from causing high data downloads

0

Hi,
I have noticed excessive downloads of our mp3 files which are stored on Amazon s3

  • it seems that a Russian search engine bot Yandex (https://myip.ms/info/whois/141.8.144.47 ) is downloading our mp3 files causing excessive data traffic.
    Is it possible to block this IP address, while keeping the files public, or how should be prevent Yandex downloading so much? Is a robots.txt file something to consider? (which I know nothing about!)

Many thanks

IrishCM
preguntada hace 5 años190 visualizaciones
4 Respuestas
0

Hello
The robots.txt file is an agreement which is not mandatory so it may help but it does not stop Yandex from keep doing it.
You can create a bucket policy to denie access to an IP address or IP address range.

here is an example
https://aws.amazon.com/premiumsupport/knowledge-center/block-s3-traffic-vpc-ip/

hope this helps
Rt

rtt
respondido hace 5 años
0

Thank you so much.
However, the example you give is for blocking all access and giving permission to specific IP addresses. I wish to do the opposite - to give public access, but block specific IP addresses.

Is there JSON code you know of which does this please?
thanks again

IrishCM
respondido hace 5 años
0

Hello
Sorry, this link should have a bit more info.

https://docs.aws.amazon.com/AmazonS3/latest/dev/example-bucket-policies.html#example-bucket-policies-use-case-3

a little modification to the other example and you have it.

{
  "Version": "2012-10-17",
  "Id": "S3PolicyId1",
  "Statement": [
    {
      "Sid": "IPAllow",
      "Effect": "Deny",
      "Principal": "*",
      "Action": "s3:*",
      "Resource": "arn:aws:s3:::examplebucket/*",
      "Condition": {
         "IpAddress": {"aws:SourceIp": "54.240.143.24/32"}
      } 
    } 
  ]
}

RT

rtt
respondido hace 5 años
0

Thank you so much - have it sorted. Really appreciate your time.

IrishCM
respondido hace 5 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas