Shopify does not give you a robots.txt file to edit. The file is generated from a Liquid template called robots.txt.liquid that lives inside your theme. You create that template once, keep Shopify's default rules intact, and add allow groups for the AI retrieval crawlers alongside them.
Why Shopify is different
There is no physical file anywhere. If you go looking for robots.txt over FTP or in a file manager, it does not exist. Shopify renders the file from theme code on every request.
Shopify merges your template with its own default rules through a loop over robots.default_groups. That loop renders Shopify's defaults, including the protections on checkout, cart, and admin paths. Delete or break the loop and you lose those defaults.
The template lives in one theme. Switching themes, or updating a theme without carrying the template over, drops your AI crawler rules without warning. The file quietly reverts to Shopify's defaults and nothing tells you.
Shopify's default file is built for traditional search. It says nothing about AI crawlers either way, so the retrieval bots inherit the open default. Your work is additive: make that access explicit and keep it that way.
The steps, in order
- Check what Shopify serves today. Open https://[yourdomain.com]/robots.txt in a browser, replacing yourdomain.com with your actual domain. Read the defaults so you know the baseline before you touch anything.
- Open the code editor. In your Shopify admin go to Online Store, then Themes. On your live theme, open the actions menu (the three dots) and choose Edit code.
- Create the template. In the Templates section, add a new template and choose robots.txt. Shopify creates robots.txt.liquid with its default code already inside. Keep the robots.default_groups loop exactly as it is. That loop is what renders Shopify's default rules.
- Add your AI crawler groups below the loop, near the top of the rendered file and before any broad disallow rules:
User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: Claude-User
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: meta-webindexer
Allow: /
User-agent: bingbot
Allow: /- Save and verify. Reload https://[yourdomain.com]/robots.txt and confirm your new groups appear before Shopify's broader rules. Shopify renders the file on request, so what you see is what the crawlers get.
- To roll back, delete the robots.txt.liquid template. Shopify then serves its default file again.
The fundamentals
Three things work the same on every platform:
- •What goes in an llms.txt file and where to publish it on Shopify, see our llms.txt guide
- •The product markup AI tools read on the page, see our product schema guide
- •The full crawler token reference and what each allow or block costs, see our robots.txt guide
A hypothetical example
Say you run a candle shop on Shopify. You add the allowlist through the robots.txt.liquid template and the file looks right. A scan then shows none of the AI retrieval crawlers reaching your product pages. The file was not the problem. Your theme update the previous month had replaced the theme without carrying the template over, and the file had silently reverted to Shopify's defaults. This is the failure mode to check first on Shopify: confirm the template still exists in your live theme before debugging anything else.
What this guide does not cover
The file is only the declaration. If a bot manager or CDN blocks an AI crawler at the edge before it reads robots.txt, the file's rules do not matter. That edge check, plus ongoing monitoring for drift and the transaction layer that lets an agent complete a purchase, are separate work.
Frequently Asked Questions
How do I customize robots.txt in Shopify?
Will updating my Shopify theme overwrite my custom robots rules?
How do I add rules for GPTBot and ClaudeBot in Shopify Liquid?
Check your own brand now
Run the free scan at aizii.ai/aeo-scan. One click, no signup. It shows which AI crawlers can reach your site today and which ones are blocked.
Run the free scan