{gettext("Robots Directive")}

{gettext("Noindex · Nofollow")}

{gettext("Adds")} <meta name="robots" content="noindex,nofollow"> {gettext( "to every PhoenixKit layout, blocking crawlers from indexing or following links." )}

{if @no_index_enabled, do: gettext("Enabled"), else: gettext("Disabled")}

<.icon name={ if @no_index_enabled, do: "hero-no-symbol", else: "hero-magnifying-glass-circle" } class="w-6 h-6" />

<%= if @no_index_enabled do %> {gettext( "Search engines are instructed to skip this environment. Remove this before launch." )} <% else %> {gettext( "Crawlers are allowed to index the site. Enable the toggle to hide staging deployments." )} <% end %>

<%!-- robots.txt: reported, never written. See the LiveView moduledoc for why PhoenixKit does not generate this file. --%>

{gettext("Crawler Instructions")}

robots.txt

{gettext( "PhoenixKit does not generate this file — it is yours, and your web server serves it from priv/static before any route is consulted. The one thing worth adding is a pointer to your sitemap, which crawlers otherwise have to guess at." )}

{gettext("Add this line to priv/static/robots.txt:")}

Sitemap: {@sitemap_url}

<.icon name={ if @robots_txt_present? and @robots_txt_references_sitemap?, do: "hero-check-circle", else: "hero-information-circle" } class="w-6 h-6" />

<%= cond do %> <% not @robots_txt_present? -> %> {gettext( "No priv/static/robots.txt found. Without one, crawlers assume everything is allowed — which is usually fine, but they will not learn where your sitemap is." )} <% not @robots_txt_references_sitemap? -> %> {gettext( "priv/static/robots.txt exists but has no Sitemap: line. Add the line above so crawlers are told where to look." )} <% true -> %> {gettext("priv/static/robots.txt points crawlers at your sitemap.")} <% end %>

{gettext( "The noindex toggle above and robots.txt are separate mechanisms: noindex is a per-page meta tag that tells crawlers not to index what they fetched, while robots.txt tells them what not to fetch at all. A staging site usually wants both." )}