What llms.txt is
llms.txt is a plain Markdown file at the root of your site, at /llms.txt, that tells language models what your site is about and which pages matter. Jeremy Howard proposed it in September 2024. Think of it as a short, curated table of contents written for a model rather than a crawler.
It is a proposal, not a standard that search engines have committed to. That is worth saying plainly. It is also cheap to publish, easy to keep current, and it forces a useful exercise: deciding which ten pages actually describe your business.
The format
The spec is short. In order:
- 1.An H1 with the site or company name. This is the only required part.
- 2.A blockquote with a one or two sentence summary.
- 3.Optional paragraphs with more detail, without headings.
- 4.Optional H2 sections that are lists of links, each written as
[name](url)with an optional note after a colon. - 5.An optional H2 named Optional for secondary links a model can skip when it needs a shorter context.
# Finetune
> AI-native digital studio for industrial and B2B companies in Indonesia:
> websites, marketing, AI visibility and ongoing maintenance.
## Services
- [Marketing Website](https://finetune.id/services/marketing-website): company and marketing sites
- [AI Visibility Plan](https://finetune.id/services/ai-visibility-plan): GEO and AI search monitoring
## Insights
- [What is generative engine optimization](https://finetune.id/insight/what-is-generative-engine-optimization)
## Optional
- [About](https://finetune.id/about)
- [Contact](https://finetune.id/contact)The spec also suggests offering clean Markdown versions of important pages, at the same URL with .md added. That part is more work and can wait.
Who publishes one
Documentation sites adopted it first, because developers already paste docs into AI tools. Anthropic, for example, publishes an llms.txt for its developer docs. Company and agency sites are following. Ours is live at finetune.id/llms.txt.
How to add one
- Static site or Astro: put
llms.txtin the public folder, or generate it from your CMS so new services appear on their own. - WordPress: several SEO plugins can generate it; check what it lists before publishing.
- Any site: serve it as
text/plainortext/markdownwith UTF-8, at the root of the domain.
Keep it short. A list of every URL is a sitemap, and you already have one.
Will it help?
Honestly, nobody can measure that well yet. What reliably helps AI visibility is still the basics: let AI crawlers in, answer questions directly on the page, back claims with sources. We explain those in What is generative engine optimization.
llms.txt sits on top of that. Ten minutes of work, low risk, and a small signal that your site is ready to be read by machines as well as people.
Frequently asked questions
- What is llms.txt?
- llms.txt is a proposed Markdown file at the root of a website that gives language models a short summary of the site and a curated list of its most useful pages.
- Is llms.txt the same as robots.txt?
- No. robots.txt controls what crawlers may fetch. llms.txt does not allow or block anything; it only points models to the pages you consider most useful.
- Does llms.txt improve rankings?
- There is no evidence it affects search rankings. It is a low-cost addition on top of the basics of AI visibility: crawlable pages, direct answers and sourced claims.
- Where should llms.txt go?
- At the root of the domain, for example https://example.com/llms.txt, served as plain text or Markdown in UTF-8.





