DigiJaws Data

ORIGINAL RESEARCH

DigiJaws Data

Original benchmarks on how AI search and autonomous agents are reshaping who gets found, cited, and trusted online. Every report is generated from live data with our own free tools, refreshed periodically, and free to cite with attribution.

Benchmark · Updated monthly

The AI Overview Prevalence Benchmark

How often Google now answers with an AI Overview, how many sources it cites, and which domains get cited most — across six search intents.

84%
show an AI Overview
81%
cite YouTube
Read the benchmark →
Report · Updated monthly

The AI Crawler Blocking Report

How often the web’s biggest sites block AI crawlers like GPTBot, ClaudeBot and PerplexityBot in robots.txt — by bot and by industry.

43%
block an AI crawler
100%
of news sites do
Read the report →
Live index · Open dataset

The AI Search Readiness Index

Our continuously updated index of how AI-ready the general web is — crawler access, llms.txt adoption, and structured data — published as an open dataset and a free API.

51%
have no llms.txt
94%
missing FAQ schema
Explore the index →
Download the raw data

The AI Search Readiness Index is published as an open dataset and a public read-only API — no key required. Use it, cite it, build on it. Machine-readable exports of the AI Overview and Crawler Blocking benchmarks are being added next.

Dataset (CSV) ↓ Dataset (JSON) ↓ Open API & methodology

Two lenses on the same question. The Readiness Index samples the general web and finds 29% of sites blocking AI crawlers. The Crawler Blocking Report samples the web’s largest sites and finds 43% blocking at least one. The gap is the finding: big publishers gate AI far more aggressively than the average site, while most ordinary sites leave the door open without ever deciding to.

Want to see where your own site stands?

Our free tools run the same checks on any site — AI Overview citations, crawler access, llms.txt and more.

Explore the free tools →

Using this data? Please cite DigiJaws with a link to the source report. New benchmarks are added over time.

From diagnosis to done
The free checks find the gaps. The platform closes them.

DigiJaws monitors your AI visibility continuously, alerts you when a signal drops, and generates the publish-ready fixes — across your whole site, on autopilot.

See the platform →View pricing

Tool pricing index

Entry pricing for 252 marketing and AI tools across 28 categories, with billing basis, per-seat status, free-tier availability and a verification date on every row. The median entry price is $20 a month and 77% of tools that publish a comparable figure start under $50 — but AI search and GEO tools are the exception at a $99 median, roughly five times the market. Read the index, or take the raw data as JSON or CSV. Quotation with attribution is permitted.

Research report graphic for “DigiJaws Data” with headline metric tiles and a trend chart

Using the data programmatically

Every dataset on this page is readable without an API key, and the endpoints behind them are documented in the Data API reference — response shapes, status codes, and the eighteen signals the readiness score is built from. POST /wp-json/digijaws/v1/machine-audit will score any URL you give it; bench-stats returns the signal pass rates across our scored sample. Quotation with attribution is permitted.

Related research: we classified the published entry price of 302 SaaS and AI tools by what kind of figure it actually is, and found that 53% of the tools advertising a recurring price headline the annual rate rather than the monthly one. The full dataset and method are published with it.

More free tools

Run your free scan →

Free tools →My toolkit →Locations →Comparisons →
Verified Agent-Ready by DigiJaws
See who AI recommends instead of you — free AEO audit, 90-day plan you keepGet my free audit