Shopify: robots.txt for AI crawlers and llms.txt
No signup, no email. The checker reads only public files and gives a plain-English fix list.
Open the ai readiness checkerEdit robots.txt on Shopify
- Online Store > Themes > ... > Edit code.
- Add a new template and choose robots.txt. Shopify creates robots.txt.liquid with its default rules.
- Keep the Liquid loop that outputs Shopify's default groups, and add your own groups at the end.
- Save, then open https://yourstore/robots.txt.
Shopify recommends keeping its default rules, which keep crawlers out of cart, checkout and filtered collection URLs.
Rules to add for AI crawlers
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: CCBot
Disallow: /
This opts out of the main training crawlers while AI search crawlers such as OAI-SearchBot and PerplexityBot keep following the default User-agent: * rules. Add your sitemap line only if it's missing: Shopify already lists /sitemap.xml.
llms.txt and agents.md
Shopify serves /llms.txt on every store by mirroring its managed /agents.md. You can override it with an llms.txt.liquid template. See the Shopify llms.txt guide for an example.
Things to watch
- A theme change can drop your robots.txt.liquid template. Copy it to the new theme.
- Apps that add bot protection may block crawlers at the edge, separate from robots.txt.
Questions and answers
Can I edit robots.txt on Shopify?
Yes, with a robots.txt.liquid template in your theme. Shopify's help explains how to add rules while keeping the defaults.
Does Shopify block AI crawlers by default?
Check your own /robots.txt or run the AI readiness checker: it lists every AI crawler and whether your current rules allow it.
Does Shopify create llms.txt?
Yes. /llms.txt mirrors Shopify's managed /agents.md unless your theme overrides it.
Will blocking GPTBot remove my store from ChatGPT shopping answers?
GPTBot is the training crawler. ChatGPT search uses OAI-SearchBot, which has its own robots.txt setting.
Should I remove Shopify's default rules?
No. Shopify recommends keeping them; they stop crawlers wasting time on cart and checkout pages.
What happens when I change themes?
Theme templates go with the theme. Copy robots.txt.liquid and llms.txt.liquid to the new theme before publishing it.
Sources
Related tools and guides
AI readiness by platform
All free Countnest tools · Plain-text summary for AI assistants
30-day free trial, no card required. Then from $14 a month. Cancel anytime.
Start free for 30 days