datascale

Search services, integrations and blog posts.

Check explainer

llms.txt

llms.txt is the emerging standard for telling LLMs in a structured way what they may read.

  • note
  • ok

What we check

Checks whether an llms.txt exists at the web root.

Why it matters

llms.txt is the emerging standard for telling LLMs in a structured way what they may read.

Common causes

  • The file was never created, the standard is young and the most common finding is simply: missing.
  • An llms.txt exists but lists outdated URLs that lead nowhere.
  • The file sits in a subdirectory instead of the web root, where no crawler looks for it.

How to fix it

Add llms.txt at the web root; list relevant content for LLM retrieval (spec: llmstxt.org).

  • Q01
    What does a failing llms.txt finding mean?

    llms.txt is the emerging standard for telling LLMs in a structured way what they may read. Add llms.txt at the web root; list relevant content for LLM retrieval (spec: llmstxt.org).

  • Q02
    How do you fix llms.txt?

    Add llms.txt at the web root; list relevant content for LLM retrieval (spec: llmstxt.org).