brainpy.math.activations.silu#

brainpy.math.activations.silu(x)[source]#

SiLU activation function.

Computes the element-wise function:

\[\mathrm{silu}(x) = x \cdot \mathrm{sigmoid}(x) = \frac{x}{1 + e^{-x}}\]
Parameters

x (JaxArray, jnp.ndarray) – The input array.