1 Answer
- Newest
- Most votes
- Most comments
0
Hello.
If you are using Apache as your web server, you can deny access from Bytespider by configuring the following settings in .htaccess.
The following settings were actually set on a blog site that I manage, but so far there is no access from Bytespider.
SetEnvIf User-Agent "Bytespider" bothersome_bot
BrowserMatchNoCase "Bytespider" bothersome_bot
<RequireAll>
RequireAll Granted
Require not env bothersome_bot
</RequireAll>
If you are using Nginx, the following URL settings may be helpful.
https://gist.github.com/hans2103/733b8eef30e89c759335017863bd721d
Since user agents can be spoofed, it may not be possible to block them with this setting alone in the future.
If blocking becomes difficult due to Apache settings, etc., I think it would be a good idea to introduce WAF.
Relevant content
- asked 5 months ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated a year ago