How to Add robots.txt and llms.txt to Your Site (Any Platform)

You ran the check and got a list of fixes. Most of them are paste-ready — the only real question is where each one goes. This guide shows exactly that, for the platforms most sites use.

The two kinds of fixes

Almost every fix is one of two types:

  1. A file at your site’s root — like robots.txt or llms.txt. It has to load at yoursite.com/robots.txt (the very top of your domain).
  2. A tag in your page’s <head> — like structured data (JSON-LD), Open Graph tags, or a meta description. It goes inside the <head> of the relevant page.

The rule of thumb: if it’s a .txt file, it goes to the root; if it’s a <script> or <meta> tag, it goes in the head.

Where root files go (robots.txt, llms.txt)

The test is simple: after you add it, yoursite.com/robots.txt (or /llms.txt) should open in a browser and show your file. Here’s how to get it there:

If your platform doesn’t obviously allow custom root files, don’t force it — see Not sure? Ask ChatGPT below.

Where head tags go (structured data, Open Graph, meta)

These go inside <head>. Structured data (JSON-LD) and meta tags describe a single page, so they belong on that page; Open Graph defaults can be set site-wide.

Your design doesn’t change — these tags are invisible to visitors; only crawlers and AI read them.

Not sure? Ask ChatGPT

Every platform is a little different. If the steps above don’t match what you see, paste one of these into ChatGPT (or hand it to your developer):

How do I add a file called llms.txt to the root of my [your platform] website?
Where do I paste this code into the <head> of my [your platform] site?
[paste the code from your report here]

Swap [your platform] for WordPress, Shopify, Wix, Squarespace, Webflow, and so on.

How to confirm it worked

The bottom line

Applying the fixes is mostly copy, paste, and putting each one in the right place: root files at the root, head tags in the head, and when in doubt, ask ChatGPT with the prompts above. Then run the check again to confirm your AI-friendliness score went up.

Related: robots.txt for AI crawlers · What is llms.txt · Structured data for AI · GEO overview.

← All guides