Vercel Adds AI Traffic Insights to Observability

What happened

Vercel Observability now includes AI traffic insights, allowing users to track how AI bots interact with their websites. These insights provide data on the number of requests made by verified AI bots.

Developers can identify frequently crawled pages by AI crawlers, which are often used for indexing or model training. The insights also show which pages are fetched by AI assistants in response to user actions or search queries.

Why it matters

Understanding AI bot behavior helps developers optimize website performance and security. By identifying problematic or excessive traffic, they can improve resource allocation and prevent potential misuse.

Key details

AI traffic data includes information about pages requested in Markdown format by bots. It also highlights pages where AI bot requests result in errors. These insights are accessible through the Vercel dashboard under Observability > AI Traffic.

Developers and agents can query metrics using the vercel metrics command in the Vercel CLI, though this requires the Observability Plus plan. Additional details are available in the AI traffic documentation provided by Vercel.