API Reference text_generation_inference v0.1.2

modules

Modules

Provides struct and type for BestOfSequence

Provides struct and type for CompatGenerateOptions

Provides struct and type for CompatGenerateRequest

Provides struct and type for Details

Provides struct and type for ErrorResponse

Provides struct and type for FinishReason

Provides struct and type for GenerateParameters

Provides struct and type for GenerateRequest

Provides struct and type for GenerateResponse

Provides struct and type for Info

Provides struct and type for PrefillToken

Provides struct and type for StreamDetails

Provides struct and type for StreamResponse

Provides API endpoints related to text generation inference

Provides struct and type for Token