About our research bot

If you have seen AISEOAgentsResearchBot in your website logs, this page explains who we are and what it does.

Who we are

We are AI SEO Agents, a UK team that helps small businesses get found on Google and recommended by AI assistants. AISEOAgentsResearchBot is our research crawler. We use it for our UK Small Business AI Readiness Study, which looks at how ready small-business websites are to be found and recommended by AI assistants.

What it looks at

• Only your public homepage, plus the small public files that tell visitors and bots about your site: robots.txt, llms.txt and, only if robots.txt doesn’t list one, sitemap.xml.
• That’s a handful of requests, usually just once. It never logs in, fills in forms or follows links further into your site.
• It runs the same checks as our free AI readiness checker, such as whether your page loads, whether AI assistants are allowed in and whether your contact details are easy to find.
• We only publish totals across many businesses. We never name or rank individual businesses.

It follows your robots.txt

Before it visits your homepage, the bot reads your robots.txt file and does what it says. If your file blocks it (or blocks all bots), it doesn’t visit your homepage.

How it identifies itself

The bot always uses this exact user agent, so you can spot it in your logs:

AISEOAgentsResearchBot/1.0 (+https://aiseoagents.co.uk/research/)

How to opt out

Add these two lines to your robots.txt file and the bot will stay away:

User-agent: AISEOAgentsResearchBot
Disallow: /

You can also email us at hello@aiseoagents.co.uk with your website address. We’ll remove your site from our study data.

Questions

If you have any questions about the bot or the study, email hello@aiseoagents.co.uk and we’ll get back to you.