Control AI crawlers and assistants separately in Vercel Firewall

Vercel Firewall now lets you log or block AI crawlers and AI assistants separately with its AI Bots managed ruleset. Crawlers are the bots that collect content for indexing and model training. Assistants are the ones that fetch a page in response to a user's action or search query.

That split means you can, for example, block AI crawlers while still letting assistants retrieve your content to answer people's questions. Vercel updates the rules as new bots are added.

In the dashboard, open your project's Security > Firewall > Rules, enable AI Bots under Bot Management, and select the gear icon next to it. Set an action for AI crawlers and another for AI assistants, then review and publish. The CLI works too: vercel firewall rules edit ai-bots --category ai-crawlers --action deny --yes blocks crawlers, and the same command with --category ai-assistants --action log --yes logs assistant requests. Check the result with vercel firewall diff, then apply it with vercel firewall publish.

The AI Bots managed ruleset is available on all plans.