Sagents.DisplayMessagePersistence behaviour (Sagents v0.16.2)

Copy Markdown

Behaviour for persisting display messages (user-facing message representations).

Display messages are the UI-friendly representations of conversation turns: text messages, tool call cards, thinking blocks, error notifications, etc. They are separate from the agent's internal state and optimized for rendering.

Scope-first contract

Every callback takes the integrator's scope struct as its first positional argument.

When callbacks are invoked

All callbacks are invoked from within the AgentServer process, ensuring exactly-once semantics regardless of how many LiveViews are connected.

Message saving

save_message/3 is called when a new LangChain Message is processed. A single Message can produce multiple display messages (e.g., text + tool_calls). The implementation should return the saved records so AgentServer can broadcast {:display_message_saved, msg} events to connected LiveViews.

Tool execution lifecycle

Tool execution status updates reflect the lifecycle of tool calls:

  1. Tool call identified → message saved with status "pending" (via save_message/3)
  2. Tool execution starts → update_tool_status/4 with status :executing
  3. Tool execution ends → update_tool_status/4 with status :completed or :failed

Configuration

Per-agent via AgentServer start options:

supervisor_config = [
  agent_id: agent_id,
  conversation_id: conversation_id,
  display_message_persistence: MyApp.DisplayMessagePersistence,
  # ... other config
]

If not configured, no display messages are persisted. The agent still broadcasts PubSub events for real-time streaming — LiveViews can render messages from events alone without persistence.

Narration

Some models label an utterance as narration: the model saying what it is about to do, rather than its reply. An implementation that stores Sagents.Message.DisplayHelpers.extract_display_items/1 output keeps the label without doing anything, because it rides inside each item's content under "utterance" and that map is stored verbatim.

An implementation that builds its own content map instead should carry the key across, or a reloaded conversation renders every preamble as a reply. Sagents.Message.DisplayHelpers.narration?/1 answers the same question for a whole message.

Rendering is the host's call. The label is there so a host that wants to show narration as a status line rather than a chat bubble can, and one that does not care can ignore it.

Summary

Types

Context map passed to every callback. Carries cross-cutting identifiers that every implementation needs but don't benefit from positional visibility.

Attributes for a synthetic display message produced by middleware (not by an LLM). The shape mirrors the fields a typical implementation will write to its display-message store.

Callbacks

Resolve an interrupted tool result display message with actual result content.

Save a LangChain Message as one or more display messages.

Persist a synthetic display message originated by middleware.

Update the status of a persisted tool call display message.

Types

callback_context()

@type callback_context() :: %{agent_id: String.t(), conversation_id: String.t() | nil}

Context map passed to every callback. Carries cross-cutting identifiers that every implementation needs but don't benefit from positional visibility.

synthetic_message_attrs()

@type synthetic_message_attrs() :: %{
  :message_type => String.t(),
  :content_type => String.t(),
  :content => map(),
  optional(:metadata) => map()
}

Attributes for a synthetic display message produced by middleware (not by an LLM). The shape mirrors the fields a typical implementation will write to its display-message store.

tool_status()

@type tool_status() :: :executing | :completed | :failed | :interrupted | :cancelled

Callbacks

resolve_tool_result(scope, tool_call_id, result_content, context)

(optional)
@callback resolve_tool_result(
  scope :: term() | nil,
  tool_call_id :: String.t(),
  result_content :: String.t(),
  context :: callback_context()
) :: {:ok, term()} | {:error, :not_found | term()}

Resolve an interrupted tool result display message with actual result content.

Called after a sub-agent resumes and completes. Updates the persisted tool result display message to clear the interrupt flag and replace placeholder content with the actual result.

Optional callback — implementations that don't need this can skip it.

Parameters

  • scope — Integrator-defined scope struct (or nil). Use to filter DB writes.
  • tool_call_id — The tool call ID matching the interrupted tool result
  • result_content — The actual result content string
  • context — Map with :agent_id and :conversation_id

Returns

  • {:ok, updated_message} — Updated record, broadcast to LiveViews
  • {:error, :not_found} — No matching interrupted tool result exists

save_message(scope, message, context)

@callback save_message(
  scope :: term() | nil,
  message :: LangChain.Message.t(),
  context :: callback_context()
) :: {:ok, list()} | {:error, term()}

Save a LangChain Message as one or more display messages.

A single LangChain.Message may produce multiple display messages (e.g., an assistant message with text content + tool calls produces a text display message and one or more tool_call display messages).

The implementation should:

  1. Convert the Message into display message records
  2. Persist them to the database (scoped via scope)
  3. Return the list of saved records

Use Sagents.Message.DisplayHelpers.extract_display_items/1 to do the conversion, and store each item's content map verbatim. Beyond the keys a given content_type needs for rendering, the framework writes keys of its own — "stop_reason" and "stop_details" on a message the model did not finish, "display_text" on a tool call. An implementation that rebuilds content key by key silently drops them. extract_display_items/1 documents the full inventory.

AgentServer broadcasts {:display_message_saved, msg} for each returned record, so connected LiveViews can update their UI.

Parameters

  • scope — Integrator-defined scope struct (or nil). Use to filter DB writes.
  • message — The LangChain.Message struct to persist
  • context — Map with :agent_id and :conversation_id

Returns

  • {:ok, [saved_messages]} — List of persisted display message records
  • {:error, reason} — Persistence failed (logged, does not affect agent)

save_synthetic_message(scope, attrs, context)

(optional)
@callback save_synthetic_message(
  scope :: term() | nil,
  attrs :: synthetic_message_attrs(),
  context :: callback_context()
) :: {:ok, term()} | {:error, term()}

Persist a synthetic display message originated by middleware.

Used for transcript entries that should appear in the conversation but do not correspond to a LangChain.Message — for example, the user's answer to an ask_user question, or a "user cancelled" notification.

AgentServer invokes this callback in response to Sagents.AgentServer.save_synthetic_message_from/2 and broadcasts the saved record as {:display_message_saved, msg} so LiveViews stream it in via the same path used for LLM-generated display messages.

Optional callback — middleware that uses this feature is responsible for ensuring the configured persistence module implements it.

Parameters

  • scope — Integrator-defined scope struct (or nil). Use to filter DB writes.
  • attrs — Map with :message_type, :content_type, :content (and optionally :metadata).
  • context — Map with :agent_id and :conversation_id.

Returns

  • {:ok, display_message} — Persisted record, broadcast as {:display_message_saved, msg}.
  • {:error, reason} — Persistence failed (logged, does not affect agent).

update_tool_status(scope, status, tool_info, context)

@callback update_tool_status(
  scope :: term() | nil,
  status :: tool_status(),
  tool_info :: map(),
  context :: callback_context()
) :: {:ok, term()} | {:error, :not_found | term()}

Update the status of a persisted tool call display message.

Called at each stage of the tool execution lifecycle. The tool_info map contains the tool call identifier and any status-specific metadata.

Parameters

  • scope — Integrator-defined scope struct (or nil). Use to filter DB writes.

  • status — The new status: :executing, :completed, :failed, :interrupted, or :cancelled

  • tool_info — Map with at minimum :call_id, plus status-specific fields:

    StatusFields
    :executing%{call_id: "...", name: "...", display_text: "..."}
    :completed%{call_id: "...", name: "...", result: "..."}
    :failed%{call_id: "...", name: "...", error: "..."}
    :interrupted%{call_id: "...", display_text: "..."}
    :cancelled%{call_id: "...", name: "..."}
  • context — Map with :agent_id and :conversation_id

Returns

  • {:ok, updated_message} — Updated record, broadcast to LiveViews as {:display_message_updated, msg}
  • {:error, :not_found} — No matching tool call exists (normal if persistence wasn't configured when call was saved)