✦AI Web Readiness
Free · No sign-up required

Is your site ready for
AI agents?

AI agents don't browse, they parse. Score any website across 14 machine-readability signals and see exactly what AI systems can and can't read.

https://
example.com74 / 100
● Good9 of 14 checks passed
✓
AI agent manifest25/25
✓
Structured data15/15
✕
Full-content AI feed0/10
✕
Q&A schema0/7
✓
Attribution schema8/8
Sample report · real results in ~5 seconds
Community data

How the web scores

Aggregated across every site scanned. Updated in real time.

Unique sites
-
distinct domains scanned
Total scans run
-
including rescans
Average score
- / 100
across all scanned sites
Avg rescan improvement
- pts
avg score gain on rescan
The 14 checks

Every signal that matters to AI agents

Each check maps to something an AI agent looks for when it reads, classifies, or cites your site. Pass them all and you're invisible to nothing.

01
AI agent manifest
An /llms.txt file tells AI agents exactly what your site is, what it offers, and which pages to prioritize. Without it, agents have to guess.
+25 pts
02
Full-content AI feed
An /llms-full.txt file gives agents your complete site content in one place, so they can understand you without crawling page by page.
+10 pts
03
Structured data
JSON-LD tells agents what type of entity you are, what you do, and how your content relates to the wider web. It is the vocabulary of machine understanding.
+15 pts
04
Readable content ratio
Measures how much of your page payload is actual text versus markup, scripts, and boilerplate. Low ratios signal bloated or ad-heavy pages that agents deprioritize.
+15 pts
05
Crawler-visible content
Checks whether your page delivers real content in the raw HTML. Sites that render entirely in JavaScript are largely invisible to AI crawlers that do not execute scripts.
+10 pts
06
AI crawler permissions
Checks whether your robots.txt explicitly addresses AI agents like GPTBot, ClaudeBot, and PerplexityBot. Silence is ambiguous; explicit rules build trust and control.
+10 pts
07
Page index
A valid sitemap.xml gives agents a reliable, complete map of your site so no important page gets missed during indexing.
+10 pts
08
Social and citation metadata
OpenGraph tags supply the headline and summary agents use when citing or previewing your content. Missing tags force agents to improvise, often poorly.
+10 pts
09
Page identity signals
Your title and meta description are the first signals an agent reads to classify what a page is about. Thin or missing values hurt both discoverability and citation accuracy.
+10 pts
10
Canonical authority
A canonical tag tells agents which URL is the definitive version of a page, preventing your authority from being split across duplicates or parameter variants.
+5 pts
11
Accessibility and speed
Agents skip sites that are slow or served over plain HTTP. This check confirms your site is on HTTPS and responds within 3 seconds.
+5 pts
12
Attribution schema
Structured author, publisher, Person, or Organization data tells AI citation engines who created the content and who stands behind it, directly influencing whether you get credited.
+8 pts
13
Q&A schema
FAQPage and HowTo schema mark up content in the exact format LLMs use to answer questions. Pages with this schema are cited at significantly higher rates.
+7 pts
14
Content feed
An RSS or Atom feed signals that your site publishes content regularly and gives agents and aggregators a reliable stream to re-index as you update.
+6 pts
How it works

Three steps to a shareable report

No account needed. Enter a URL, wait a few seconds, and get a full breakdown with a ready-to-deploy /llms.txt file.

01

Fetch

We request your homepage, /robots.txt, /sitemap.xml, /llms.txt, and /llms-full.txt simultaneously.

02

Analyze

14 checks run in parallel against the raw HTML and file responses. No JavaScript execution required.

03

Report

You get a score out of 100, a grade, and a full per-check breakdown with specific fixes for each failure.

FAQ

Common questions

What is AI web readiness?

AI web readiness measures how well a website can be discovered, parsed, and cited by AI agents and large language models. It covers signals like /llms.txt, structured data, robots.txt AI crawler permissions, server-side rendering, and OpenGraph metadata. A site with high AI readiness is more likely to be understood, referenced, and surfaced by AI-powered tools and assistants.

What is /llms.txt and why does it matter?

/llms.txt is a plain text file placed at the root of a website that tells AI agents what the site is about, what it offers, and which pages to prioritize. It follows a simple convention proposed by the developer community to give large language models a structured map of site content. Without it, AI agents have to infer your site's structure from raw HTML, which is less reliable. Adding /llms.txt is the single highest-impact change most sites can make for AI visibility.

How is the AI readiness score calculated?

The score is calculated across 14 weighted checks, each representing a signal that AI agents use when reading, classifying, or citing a website. Points are awarded on a pass, partial, or fail basis, then normalized to a 0 to 100 scale. The checks cover /llms.txt (25 pts), structured data (15 pts), content readability (15 pts), and 11 additional signals including robots.txt AI permissions, sitemap, OpenGraph, canonical tags, HTTPS, and more.

Is AI readiness the same as SEO?

They overlap but are distinct. Traditional SEO optimizes for search engine crawlers and ranking algorithms. AI readiness optimizes for large language models and AI agents that read, summarize, and cite content directly. Many SEO best practices such as structured data, fast load times, and clear content also help AI readiness, but AI-specific signals like /llms.txt have no SEO equivalent.

Which AI crawlers does the tool check for?

The tool checks robots.txt for explicit rules covering GPTBot (OpenAI), ClaudeBot and anthropic-ai (Anthropic), PerplexityBot (Perplexity), Google-Extended and GoogleOther (Google), CCBot (Common Crawl), cohere-ai (Cohere), OAI-SearchBot (OpenAI search), and Bytespider (ByteDance). Sites that explicitly allow these crawlers signal openness to AI indexing and score higher on the AI crawler permissions check.

Is this tool free to use?

Yes, AI Web Readiness is completely free to use. No account or sign-up is required. Simply enter a URL and get a full report in seconds. All scans are saved and shareable via a unique report link, and you can rescan any URL at any time to track improvements over time. The tool runs 14 checks in parallel and returns results in under 10 seconds for most sites.

How often should I rescan my site?

Rescan whenever you make changes that could affect machine readability: publishing a new /llms.txt, adding structured data, updating robots.txt, or significantly changing your page content. The tool stores your previous score so you can track improvement over time. Many users run a scan before and after a launch to confirm their changes had the intended effect on AI visibility.