Read article @ https://perishablepress.com/ultimate-ai-block-list/

Numerous user agents are omitted from the block lists because the names are matched in wild-card fashion. 

Here is a list showing additional bots (user agents) that are blocked:



.ai: .ai, Copy.ai, Meta.AI, Hive.ai, x.AI

AI2Bot: AI2Bot, AI2Bot-Dolma

Agentic: Agentic, Agentic AI

AIMatrix: AIMatrix Crawler, AIMatrixCrawler

Alexa: Alexa, AlexaTM

Anthropic: Anthropic-AI, AnthropicAI

Applebot: Applebot, Applebot-Extended

Aria Browse: Aria Browse, Aria Browser, Aria Browser AI, etc.

Bingbot-Chat: Bingbot-Chat/2.0, Bingbot-Chat/etc.

Brave Leo: Brave Leo, Brave Leo AI

CC-Crawler: CC-Crawler/2.0, CC-Crawler/etc.

CCBot: CCBot/2.0, CCBot/etc.

Claude: Claude 2.0, Claude 2.1, Claude 3.5 Haiku, Claude 3.5 Sonnet, Claude 3.7 Sonnet, Claude Bot, Claude-Web, Claude-Web/1.0, ClaudeBot, Claudebot/1.0, Claudebot/etc.

Cohere: Cohere-AI, Cohere-Training-Data-Crawler

DALL-E: DALL-E, DALL-E 2, DALL-E etc.

DeepSeek: DeepSeek, DeepSeek-r1

FacebookBot: FacebookBot/1.0, FacebookBot/etc.

FacebookExternalHit: FacebookExternalHit, FacebookExternalHit/1.1, FacebookExternalHit/etc.

Firecrawl: Firecrawl, FirecrawlAgent

Flyriver: Flyriver, FlyriverBot/1.1, FlyriverBot/etc.

FriendlyCrawler: FriendlyCrawler, FriendlyCrawler/1.0, FriendlyCrawler/Nutch-1.20-Snapshot

Gemini: Gemini, Google Gemini

GoogleOther: GoogleOther, GoogleOther-Image, GoogleOther-Video

GPT: Agent GPT, AgentGPT, AutoGPT, ChatGPT, ChatGPT, ChatGPT-User, DepolarizingGPT, DialoGPT, Fraud GPT, FraudGPT, GPT, GPT 4 Omni, GPT 4 Omni Mini, GPT Scraper, GPT-1, GPT-2, GPT-3, GPT-3.5, GPT-3.5 Turbo, GPT-4-Turbo, GPT-4.5, GPT-4o, GPT-4o Mini, GPT-4v, GPT-etc., GPT-sw3, GPTBot, GPTBot/0.1, GPTBot/1.0, GPTBot/etc., GPTZero, LeftWingGPT, OmniGPT, RightWingGPT, ScrapeGPT, SearchGPT, ShadowGPT, WebChatGPT, Worm GPT, WormGPT, WormGPT v3.0, YarGPT, YarchatGPT, ZeroGPT

Grendizer: Grendizer, Grendizer/7.74.0, Grendizer/etc.

Grok: Grok, GrokAI

iaskspider: iaskspider, iaskspider/2.0, iaskspider/etc.

IntelliSeek: IntelliSeek, IntelliSeek.ai

Kangaroo: Kangaroo, Kangaroo Bot

LLaMA: LLaMA, LLaMA 3.2, LLaMA etc., Meta Llama

Meta-External: Meta-ExternalAgent, Meta-ExternalFetcher

Narrative: Narrative, Narrative Device

OAI-SearchBot: OAI-SearchBot/1.0, OAI-SearchBot/etc.

Omgili: Omgili, Omgilibot

OpenAI: OpenAI GPT, OpenAI o1, OpenAI o1-mini, OpenAI o3-mini, OpenAIContentCrawler

Paperlibot: Paperlibot, Paperlibot/2.1, Paperlibot/etc.

Scalenut: Scalenut, Scalenutbot

Scraper: Content Scraper GPT, Extended GPT Scraper, Content Scraper GPT

Scrapy: Scrapy, Scrapy/2.0, Scrapy/etc.

Skydancer: Skydancer, Skydancer AI

Stability: Stability, Stability AI

Timpibot: Timpibot, Timpibot/0.8, Timpibot/etc.

Webzio: Webzio, Webzio-Extended

WPBot: WPBot, WPBot/1.1, WPBot/1.2, WPBot/etc.

Zimm: ZimmWrite, ZimmWriter