The first step in LLMO and AIO: four free ways to check whether your site is readable by AI
Whether AI can read your site, free tools tell you in minutes by checking robots.txt, llms.txt and the sitemap. Whether AI actually reads and cites it, only your access log and asking AI yourself can show.
- 1. Do you refuse AI crawlers?Enter your domain in the pw check
- 2. Are llms.txt and the sitemap to spec?The free LLMO check; it gives no score
- 3. Do AI bots actually come?Your access log, checked against the operators' IP lists
- 4. Do AI answers mention you?Ask AI yourself and record the answers with a date
Source: the four ways in the text (October 2026). Ways 1 and 2 are free tools; 3 and 4 you check with your own log and questions.
Four ways
| What you check | Free way | What it does not tell |
|---|---|---|
| 1. Do you refuse AI crawlers? | https://pw.migurei.ai/en/check/ai-bots | Blocks in a CDN or firewall |
| 2. Are llms.txt and the sitemap to spec? | Free LLMO check https://pw.migurei.ai/en/free-scan | Whether AI reads or cites you |
| 3. Do AI bots actually come? | Access log, Search Console, Bing Webmaster Tools | Which question brought them |
| 4. Do AI answers mention you? | Ask AI chat services yourself | Whether the next answer is the same |
1. Do you refuse AI crawlers?
Enter a domain and it shows, bot by bot (GPTBot, OAI-SearchBot and others), whether robots.txt allows or refuses it. OpenAI says GPTBot (training) and OAI-SearchBot (search) are set independently, and sites that refuse OAI-SearchBot are not shown in ChatGPT search answers.
2. Are llms.txt and the sitemap to spec?
The free LLMO check shows whether robots.txt, llms.txt and the sitemap follow their public specs, plus the PageSpeed Insights result. It gives no score. llms.txt is a proposal and is optional.
3. Do AI bots actually come?
Count bot names in your log and check that the IP address is in the list the operator publishes. On our test site, from 1 to 26 October 2026, OAI-SearchBot came 49 times and every time read only robots.txt.
4. Do AI answers mention you?
Ask ChatGPT, Gemini and Claude what your customers would ask. On 5 and 10 October 2026, in 9 of 48 questions with a pasted URL, Gemini answered without reading the page, and all 9 answers were wrong. Answers change by day and service, so ask a few times and note the date.
- OAI-SearchBot (our test site, 1-26 October 2026)
- Visits
- 49
- What it read
- robots.txt every time
- Gemini with a pasted URL (5 and 10 October 2026)
- Questions
- 48
- Answered without reading the page
- 9, and all 9 wrong
Source: Parallel World records, October 2026. From our two sites and a small number of questions; your site may differ.
What this guide rests on, and its limits
- It was written by Migurei (a subsidiary of HBLAB Japan), the provider of the free tools it describes.
- Our numbers come from our two sites and a small number of questions; your site may differ.
- What each company says is from its official pages read in October 2026 and may change.
Frequently asked questions
Can I check for free whether AI crawlers are refused or blocked?
For robots.txt, yes: enter a domain at https://pw.migurei.ai/en/check/ai-bots and it shows, bot by bot (GPTBot, ClaudeBot, OAI-SearchBot and others), whether each is allowed or refused, with no sign-up. A block in a CDN or firewall does not show in robots.txt, so check the CDN dashboard or your server log for that.
Do I need llms.txt?
No. llms.txt (llmstxt.org) is a proposal that does not say generative AI reads it when answering, so put what you want AI to read in HTML pages listed in your sitemap first.
Can I find out for free whether AI cites my site?
Partly. Google Search Console and Bing Webmaster Tools show how often AI answers displayed or cited your pages, but for ChatGPT, Claude and Gemini you have to ask them yourself, and the free LLMO check (https://pw.migurei.ai/en/free-scan) does not measure citations either.