Here are a few links about dealing with the recent influx of server-killing bots attacking just about everything.
Alex Schroeder: Ban autonomous systems
Alex Schroeder: Trying to understand the bots
Alex Schroeder: fail2ban some more
Alex Schroeder: systemd timers for the Butlerian Jihad
Alex Schroeder: A separate allow-list to bypass fail2ban
Alex Schroeder: Bringing the Butlerian Jihad to Gemini
Alex Schroeder: Bringing the Butlerian Jihad to Gopher
Alex Schroeder: The current setup defending my sites
The Boston Diaries: A different approach to blocking bad webbots by IP address
The Boston Diaries: A deeper dive into mapping web requests via ASN, not by IP address
The Boston Diaries: Notes on blocking spam by filtering on ASN
Saturn73: Blocking AI Bot Crawlers with nginx
camelia: My Forgejo instance was attacked by LLM crawlers
Jul 25 · 3 months ago · 👍 sam
Source