how to block a bot from causing high data downloads

0

Hi,
I have noticed excessive downloads of our mp3 files which are stored on Amazon s3

  • it seems that a Russian search engine bot Yandex (https://myip.ms/info/whois/141.8.144.47 ) is downloading our mp3 files causing excessive data traffic.
    Is it possible to block this IP address, while keeping the files public, or how should be prevent Yandex downloading so much? Is a robots.txt file something to consider? (which I know nothing about!)

Many thanks

IrishCM
posta 5 anni fa190 visualizzazioni
4 Risposte
0

Hello
The robots.txt file is an agreement which is not mandatory so it may help but it does not stop Yandex from keep doing it.
You can create a bucket policy to denie access to an IP address or IP address range.

here is an example
https://aws.amazon.com/premiumsupport/knowledge-center/block-s3-traffic-vpc-ip/

hope this helps
Rt

rtt
con risposta 5 anni fa
0

Thank you so much.
However, the example you give is for blocking all access and giving permission to specific IP addresses. I wish to do the opposite - to give public access, but block specific IP addresses.

Is there JSON code you know of which does this please?
thanks again

IrishCM
con risposta 5 anni fa
0

Hello
Sorry, this link should have a bit more info.

https://docs.aws.amazon.com/AmazonS3/latest/dev/example-bucket-policies.html#example-bucket-policies-use-case-3

a little modification to the other example and you have it.

{
  "Version": "2012-10-17",
  "Id": "S3PolicyId1",
  "Statement": [
    {
      "Sid": "IPAllow",
      "Effect": "Deny",
      "Principal": "*",
      "Action": "s3:*",
      "Resource": "arn:aws:s3:::examplebucket/*",
      "Condition": {
         "IpAddress": {"aws:SourceIp": "54.240.143.24/32"}
      } 
    } 
  ]
}

RT

rtt
con risposta 5 anni fa
0

Thank you so much - have it sorted. Really appreciate your time.

IrishCM
con risposta 5 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande