PhoenixKit.Modules.Crawlers.LlmsTxt (phoenix_kit v2.6.0)

Builds the /llms.txt document — a markdown summary telling AI assistants what this site is about (llmstxt.org).

Where robots.txt is about keeping bots out, llms.txt is the opposite half of bot policy: making the site legible to the AI tools the operator wants reading it. The generated document is:

# <project title>

<operator-provided extra markdown, verbatim>

The head is generated from Settings so a fresh install serves something truthful with zero configuration; the tail is the operator's, edited on the Crawlers settings page and stored as a setting. There is deliberately no generated > summary blockquote — llmstxt.org allows one, but core has no setting that says what the site is, and a fabricated line is worse than none. Serving happens in PhoenixKit.Modules.Crawlers.Web.Controller, at the site root and under the kit prefix — the root is where tools look, same reasoning as /sitemap.xml.

Summary

Functions

build()

Build the llms.txt contents from current settings.

build_for(title, extra)

Pure variant used by tests: build from explicit title and extra markdown.

Functions

build()

@spec build() :: String.t()

Build the llms.txt contents from current settings.

build_for(title, extra)

@spec build_for(String.t() | nil, String.t() | nil) :: String.t()

Pure variant used by tests: build from explicit title and extra markdown.