PhoenixKitWeb.Live.Settings.Crawlers (phoenix_kit v2.7.0)

Copy Markdown View Source

Crawlers settings LiveView — the bot-policy page.

Sections, top to bottom:

  • Robots directive — the global noindex/nofollow staging switch.
  • Bot access — per-group allow/block toggles over the curated registry (PhoenixKit.Modules.Crawlers.Bots).
  • robots.txt — the complete generated file for copy-paste, built from the toggles above. PhoenixKit deliberately does not write or serve this file: it is host policy, and Plug.Static answers before the router, so a generated route would be dead code on most installs and a silent override on the rest.
  • llms.txt — served (root + prefixed) when the module is enabled; the operator's extra markdown is edited here.
  • Verification — Google/Bing site-verification meta contents.
  • Enforcement — the default-off application-level UA blocker, with its advisory-grade caveat stated plainly.

Summary

Functions

handle_event(binary, params, socket)

Callback implementation for Phoenix.LiveView.handle_event/3.

mount(params, session, socket)

Callback implementation for Phoenix.LiveView.mount/3.

render(assigns)

Callback implementation for Phoenix.LiveView.render/1.