Skip to main content

Automatic mitigation of Google and Bing crawl delay, via Vercel’s Skew Protection

By Steven Van ·

Pro and Enterprise projects with Skew Protection keep old assets available to Googlebot and Bingbot for 60 days, whatever the dashboard's maximum age.

Search engines that render pages weeks after crawling them no longer trip over redeployed assets on Vercel. Google and Bing crawlers sometimes crawl a document but render it up to several weeks later in a headless browser. If the site was redeployed in between, the assets that render needs can be gone, which can cause indexing failures.

Vercel now extends Skew Protection's maximum age to 60 days for requests from major search engine bots such as Googlebot and Bingbot. Assets deployed up to 60 days ago stay accessible when those bots render the page. This applies regardless of the maximum age set in the dashboard, and it covers Pro and Enterprise accounts that have Skew Protection enabled.

Vercel
Vercel
The platform for frontend developers — deploy, preview, and scale web apps and AI agents with zero config.
View Vercel →

Original source

Read Automatic mitigation of Google and Bing crawl delay, via Vercel’s Skew Protection on Creators Toolbox