View Source AWS.SagemakerJobRuntime (aws-elixir v1.0.12)
Agentic RFT Runtime Service - manages trajectory and transition data for reinforcement fine-tuning jobs.
Link to this section Summary
Functions
Marks a rollout as complete, indicating that no further turns will be appended to the trajectory.
Sends an inference request to the model during a job execution.
Sends a streaming inference request to the model during a job execution.
Updates the reward values for a trajectory and transitions it to reward-received status, signaling that it is eligible for processing.
Link to this section Functions
Marks a rollout as complete, indicating that no further turns will be appended to the trajectory.
After calling this operation, the trajectory is sealed and eligible for reward submission via the UpdateReward operation.
Sends an inference request to the model during a job execution.
The request and response bodies are forwarded to and from the model without modification. Each turn (prompt and response) is captured for later use.
Sends a streaming inference request to the model during a job execution.
Returns the response as a stream of payload chunks. Each turn is captured for later use.
Updates the reward values for a trajectory and transitions it to reward-received status, signaling that it is eligible for processing.
Call this operation after CompleteRollout to provide the computed reward scores.