Find out what llms.txt does and when your website could use one
An llms.txt file is an optional Markdown guide that helps AI agents find their way around a website.
What goes in an llms.txt file?
The llms.txt proposal describes a Markdown file with the site's name as an H1. You can add a short summary and group links under H2 headings, with notes that help an agent choose a page. Only the H1 is required.
Use it as a short directory to useful content. For documentation, links can lead to Markdown versions of the pages. Keep the description accurate and check the links when the site changes.
Create llms.txt with a generator or by hand
Many platforms create the file for you. The proposal's list of integrations includes Yoast SEO and AIOSEO for WordPress, Wix, and docs platforms such as Mintlify and GitBook. Review what a generator writes before you publish it, or write the small index yourself.
Try the file with the agent you expect to use it. Serving text at
yoursite.com/llms.txtdoesn't establish that every AI search service will fetch it.
What is llms-full.txt?
An llms.txt index points to pages. An llms-full.txt export combines page content in one file. Mintlify describes both formats and notes that large exports can exceed a client's context or response limits. Choose the format your client can use.
Frequently asked questions
Is llms.txt worth adding if Google ignores the file?
It can be, if coding agents or AI assistants read your docs, since that's where the file is used most. Google says adding one won't help or hurt your site in Google Search.
Connect llms.txt with crawler access and AI search
AI visibility
See whether ChatGPT and other AI tools can find your site at all.
AI crawlers
Choose which AI crawlers may use your pages for training, search or user requests.
How to optimize for AI search
See what Google needs before a page can appear in AI answers, and what makes it worth citing.