Optional Ortex-backed serving for GLiNER span models.
Summary
Functions
Builds an Ortex GLiNER serving from local model assets.
Flushes an enabled ONNX Runtime profile and summarizes execution-provider use.
Runs GLiNER inference for one text.
Runs GLiNER inference for many texts.
Types
Functions
Builds an Ortex GLiNER serving from local model assets.
Flushes an enabled ONNX Runtime profile and summarizes execution-provider use.
CoreML participation proves that ONNX Runtime assigned work to CoreML. It does not prove GPU-only execution because CoreML has no GPU-only compute-unit mode.
Runs GLiNER inference for one text.
Runs GLiNER inference for many texts.