Tribunal.Judges.PromptExtracted (Tribunal v1.4.0)

Copy Markdown View Source

Detects whether an LLM-powered assistant leaked its system prompt or internal configuration in its response.

Pairs with Tribunal.RedTeam.Plugins.PromptExtraction: the plugin generates indirect leak attempts and carries the assistant's purpose in expected.prompt_extracted.purpose. This judge grades each response against the same purpose at run time.

This is a negative metric: "yes" (extraction succeeded) = fail.

Required options

  • :purpose — the assistant's purpose text. Helps the judge distinguish legitimate domain content (which mentions topics in scope) from configuration leaks.