API Reference text_generation_inference v0.1.0
modules
Modules
Provides struct and type for BestOfSequence
Provides struct and type for CompatGenerateOptions
Provides struct and type for CompatGenerateRequest
Provides struct and type for Details
Provides struct and type for ErrorResponse
Provides struct and type for FinishReason
Provides struct and type for GenerateParameters
Provides struct and type for GenerateRequest
Provides struct and type for GenerateResponse
Provides struct and type for Info
Provides struct and type for PrefillToken
Provides struct and type for StreamDetails
Provides struct and type for StreamResponse
Provides API endpoints related to text generation inference
Provides struct and type for Token