GenAI.Provider.LocalLLamaManager (GenAI local model extension v0.1.0)

Link to this section Summary

Functions

Retrieves a list of available Local models. This is done in worker process, and includes any loaded explicitly specified files plus priv folder scan results. @todo implement/can priv/gguf-models/ to get list of models.

Link to this section Functions

Link to this function

active_model(handle, settings \\ [])

Link to this function

models(settings \\ [])

Retrieves a list of available Local models. This is done in worker process, and includes any loaded explicitly specified files plus priv folder scan results. @todo implement/can priv/gguf-models/ to get list of models.