Probes inference providers to determine availability.
Uses a lightweight TCP connect to check if the provider's host is reachable, avoiding repeated API calls that can trigger model reloads in local providers like LM Studio.
Summary
Functions
Probes a provider and returns its status.
Functions
@spec probe_provider(map()) :: :online | :offline
Probes a provider and returns its status.
Cloud providers are always considered :online (failures are detected
at request time). Local and custom providers are probed by attempting
a TCP connection to their host and port.