lmstudio
v0.1.0
Search documentation of lmstudio
Settings
LMStudio.NeuralArchitecture.TransformerLayer
(lmstudio v0.1.0)
Transformer layer with self-attention and feed-forward network
Summary
Functions
forward(layer, input, mask \\ nil)
new(layer_id, model_dim, num_heads \\ 8, ff_dim \\ nil)
Functions
forward(layer, input, mask \\ nil)
new(layer_id, model_dim, num_heads \\ 8, ff_dim \\ nil)