DigiJaws Data
Original benchmarks on how AI search and autonomous agents are reshaping who gets found, cited, and trusted online. Every report is generated from live data with our own free tools, refreshed periodically, and free to cite with attribution.
The AI Overview Prevalence Benchmark
How often Google now answers with an AI Overview, how many sources it cites, and which domains get cited most — across six search intents.
The AI Crawler Blocking Report
How often the web’s biggest sites block AI crawlers like GPTBot, ClaudeBot and PerplexityBot in robots.txt — by bot and by industry.
The AI Search Readiness Index
Our continuously updated index of how AI-ready the general web is — crawler access, llms.txt adoption, and structured data — published as an open dataset and a free API.
The AI Search Readiness Index is published as an open dataset and a public read-only API — no key required. Use it, cite it, build on it. Machine-readable exports of the AI Overview and Crawler Blocking benchmarks are being added next.
Dataset (CSV) ↓ Dataset (JSON) ↓ Open API & methodologyTwo lenses on the same question. The Readiness Index samples the general web and finds 29% of sites blocking AI crawlers. The Crawler Blocking Report samples the web’s largest sites and finds 43% blocking at least one. The gap is the finding: big publishers gate AI far more aggressively than the average site, while most ordinary sites leave the door open without ever deciding to.
Our free tools run the same checks on any site — AI Overview citations, crawler access, llms.txt and more.
Explore the free tools →Using this data? Please cite DigiJaws with a link to the source report. New benchmarks are added over time.
DigiJaws monitors your AI visibility continuously, alerts you when a signal drops, and generates the publish-ready fixes — across your whole site, on autopilot.
See the platform →View pricingTool pricing index
Entry pricing for 252 marketing and AI tools across 28 categories, with billing basis, per-seat status, free-tier availability and a verification date on every row. The median entry price is $20 a month and 77% of tools that publish a comparable figure start under $50 — but AI search and GEO tools are the exception at a $99 median, roughly five times the market. Read the index, or take the raw data as JSON or CSV. Quotation with attribution is permitted.

Using the data programmatically
Every dataset on this page is readable without an API key, and the endpoints behind them are documented in the Data API reference — response shapes, status codes, and the eighteen signals the readiness score is built from. POST /wp-json/digijaws/v1/machine-audit will score any URL you give it; bench-stats returns the signal pass rates across our scored sample. Quotation with attribution is permitted.
Related research: we classified the published entry price of 302 SaaS and AI tools by what kind of figure it actually is, and found that 53% of the tools advertising a recurring price headline the annual rate rather than the monthly one. The full dataset and method are published with it.
More free tools
- The Zero-Click Toolkit — all six tools in one place
- The AI Visibility Toolkit — AI Overviews + ChatGPT
- The Agent-Readiness Toolkit — get ready for AI agents
- The Content & Rewrite Toolkit — write content AI cites
- Answer-First Content Checker — is your draft quotable?
- AI Crawler Access Checker — are AI bots allowed in?
- The AI Crawler Blocking Report (data)
- DigiJaws Data (original research)
- llms.txt Checker — do you have a valid llms.txt?
- AI Overview Citation Checker — are you cited?
- The AI Overview Prevalence Benchmark (data)
- ChatGPT Visibility Report — does ChatGPT name you?
- Zero-Click Signature Analyzer — is AI eating your clicks?
- Zero-Click Revenue Calculator — what the gap costs you
- AI Overviews Traffic Tracker
- Keyword & Rewrite Optimizer
- AI Citability Checker — is your page ready to be cited?
- AI Overview Risk Checker — is a keyword a zero-click trap?
- Share of AI Answers — does AI recommend you?
- FAQ Schema Generator — FAQ page JSON-LD
- The DigiJaws Library — the zero-click reference series