Rate limiting AI scrapers with Nginx

AI scrapers are a scourge and the battle against them is never-ending. Here are some tips for how I m using Nginx to rate-limit overly aggressive scrapers on some of my websites. I m also using fail2ban to take note of the rate-limit results and take further action to ban AI scrapers.… Read More