Method LayerNormalization
LayerNormalization(TensorFloat, TensorFloat, TensorFloat, TensorFloat, float)
Computes the mean variance on the last dimension of the input tensor and normalizes it according to scale and bias tensors.
Declaration
public override void LayerNormalization(TensorFloat X, TensorFloat S, TensorFloat B, TensorFloat O, float epsilon)Parameters
| Type | Name | Description |
|---|---|---|
| TensorFloat | X | The input tensor. |
| TensorFloat | S | The scale tensor. |
| TensorFloat | B | The bias tensor. |
| TensorFloat | O | The output tensor to be computed and filled. |
| float | epsilon | The epsilon value the layer uses to avoid division by zero. |