Numerix v0.5.0 Numerix.Activations View Source

Activation functions for neural networks.

Link to this section Summary

Functions

Computes the exponential linear unit of a tensor

Computes the leaky rectified linear unit of a tensor

Computes the rectified linear unit of a tensor

Computes the scaled exponential linear unit of a tensor

Computes the element-wise sigmoid of a tensor

Computes the softmax of a tensor

Computes the softplus of a tensor

Computes the softsign of a tensor

Computes the element-wise hyperbolic tangent of a tensor

Link to this section Functions

Link to this function elu(x, alpha \\ 1.0) View Source
elu(%Numerix.Tensor{dims: term(), items: term()}, number()) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the exponential linear unit of a tensor.

Link to this function leaky_relu(x, alpha) View Source
leaky_relu(%Numerix.Tensor{dims: term(), items: term()}, number()) ::
  %Numerix.Tensor{dims: term(), items: term()}

Computes the leaky rectified linear unit of a tensor.

Link to this function relu(x) View Source
relu(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the rectified linear unit of a tensor.

Link to this function selu(x) View Source
selu(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the scaled exponential linear unit of a tensor.

Link to this function sigmoid(x) View Source
sigmoid(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the element-wise sigmoid of a tensor.

Link to this function softmax(x) View Source
softmax(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the softmax of a tensor.

Link to this function softplus(x) View Source
softplus(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the softplus of a tensor.

Link to this function softsign(x) View Source
softsign(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the softsign of a tensor.

Link to this function tanh(x) View Source
tanh(%Numerix.Tensor{dims: term(), items: term()}) :: %Numerix.Tensor{
  dims: term(),
  items: term()
}

Computes the element-wise hyperbolic tangent of a tensor.