robots.txt – Disallow well-behaved crawlers from accessing specific directories:

User-agent: *
Disallow: /private/
Firewall/WAF rules – Use services such as Cloudflare or your hosting firewall to block known bot IPs and suspicious traffic.
CAPTCHA challenges – Require CAPTCHA verification on forms and sensitive pages.
Rate limiting – Restrict the number of requests from a single IP within a given time period.
Block specific user agents – Configure your web server (.htaccess, Nginx, etc.) to deny requests from unwanted bots.
Bot management tools – Use advanced bot detection services that analyze behavior rather than just user-agent strings.