DigiJaws Data
Original benchmarks on how AI search and autonomous agents are reshaping who gets found, cited, and trusted online. Every report is generated from live data with our own free tools, refreshed periodically, and free to cite with attribution.
The AI Overview Prevalence Benchmark
How often Google now answers with an AI Overview, how many sources it cites, and which domains get cited most — across six search intents.
The AI Crawler Blocking Report
How often the web’s biggest sites block AI crawlers like GPTBot, ClaudeBot and PerplexityBot in robots.txt — by bot and by industry.
The AI Search Readiness Index
Our continuously updated index of how AI-ready the general web is — crawler access, llms.txt adoption, and structured data — published as an open dataset and a free API.
The AI Search Readiness Index is published as an open dataset and a public read-only API — no key required. Use it, cite it, build on it. Machine-readable exports of the AI Overview and Crawler Blocking benchmarks are being added next.
Dataset (CSV) ↓ Dataset (JSON) ↓ Open API & methodologyTwo lenses on the same question. The Readiness Index samples the general web and finds 27% of sites blocking AI crawlers. The Crawler Blocking Report samples the web’s largest sites and finds 43% blocking at least one. The gap is the finding: big publishers gate AI far more aggressively than the average site, while most ordinary sites leave the door open without ever deciding to.
Our free tools run the same checks on any site — AI Overview citations, crawler access, llms.txt and more.
Explore the free tools →Using this data? Please cite DigiJaws with a link to the source report. New benchmarks are added over time.
DigiJaws monitors your AI visibility continuously, alerts you when a signal drops, and generates the publish-ready fixes — across your whole site, on autopilot.
See the platform →View pricingMore free tools
- The Zero-Click Toolkit — all six tools in one place
- The AI Visibility Toolkit — AI Overviews + ChatGPT
- The Agent-Readiness Toolkit — get ready for AI agents
- The Content & Rewrite Toolkit — write content AI cites
- Answer-First Content Checker — is your draft quotable?
- AI Crawler Access Checker — are AI bots allowed in?
- The AI Crawler Blocking Report (data)
- DigiJaws Data (original research)
- llms.txt Checker — do you have a valid llms.txt?
- AI Overview Citation Checker — are you cited?
- The AI Overview Prevalence Benchmark (data)
- ChatGPT Visibility Report — does ChatGPT name you?
- Zero-Click Signature Analyzer — is AI eating your clicks?
- Zero-Click Revenue Calculator — what the gap costs you
- AI Overviews Traffic Tracker
- Keyword & Rewrite Optimizer
- AI Citability Checker — is your page ready to be cited?
- AI Overview Risk Checker — is a keyword a zero-click trap?
- Share of AI Answers — does AI recommend you?
- Schema Markup Generator — FAQ / Article JSON-LD
- The DigiJaws Library — the zero-click reference series