Live LLM Tool Loop

Copy Markdown View Source

Live tests are opt-in so normal unit tests remain deterministic.

Configure Keys

Jidoka does not load .env files from the package runtime. Export at least one provider key in the shell running the live test, or configure ReqLLM in the host application:

export OPENAI_API_KEY=...
# or
export ANTHROPIC_API_KEY=...

Run The Live Test

mix test --include live test/jidoka/live_req_llm_test.exs

The live test proves:

  • the Spark DSL compiles to a Jido-backed agent module;
  • ReqLLM makes a real model call;
  • the model chooses one operation;
  • the operation runs through Jido.Action.Tool;
  • the model receives the observation and produces the final answer.

Current Protocol

The current ReqLLM runtime uses a constrained JSON decision protocol:

{"type":"final","content":"answer"}

or:

{"type":"operation","name":"local_time","arguments":{"city":"Chicago"}}

This keeps the current runtime provider-neutral. Native provider tool-calling can replace this protocol later without changing Agent.Spec.