API Reference emlx_axon v#0.4.0

Axon model rewrites that swap supported nodes to EMLX.Fast Metal shaders.

OTP Application for EMLXAxon.

Loads Qwen3 weights from an MLX-4bit safetensors checkpoint into Bumblebee Axon params format (BF16, Bumblebee {in, out} key convention).

Post-load param quantization for Bumblebee models.

Grouped-query attention (GQA) for Qwen3, with a preallocated KV cache.

Builds native Qwen3 %EMLXAxon.Qwen3.Model.State{} structs from standard Bumblebee Qwen3 dense parameters or Hugging Face safetensors files.

Autoregressive token generation loop.

Stateless layer primitives: RMSNorm, SwiGLU.

Loads a lmstudio-community/Qwen3-*-MLX-4bit checkpoint from disk into an %EMLXAxon.Qwen3.Model.State{} struct.

Qwen3 model state struct and forward pass for quantized and dense weights.

Loaded model weights and config.

Three sampling strategies for autoregressive token generation.

A Nx.Serving-compatible wrapper around native Qwen3 generation.