LMStudio.NeuralArchitecture.TransformerLayer (lmstudio v0.1.0)

Transformer layer with self-attention and feed-forward network

Summary

Functions

forward(layer, input, mask \\ nil)

new(layer_id, model_dim, num_heads \\ 8, ff_dim \\ nil)