Enum MatmulEpilog

Namespace

NVMathNet.LinAlg

Assembly

NVMath.Net.dll

Epilog operations applied after the matrix multiplication.

public enum MatmulEpilog

Fields

Bias = 4

Add a per-row bias vector.

Default = 1

No epilog.

Gelu = 32

Apply GELU activation.

GeluAux = 160

Apply GELU and save the pre-GELU output for backward pass.

GeluAuxBias = 164

Add bias, apply GELU and save the pre-GELU output.

GeluBias = 36

Add bias and apply GELU.

Relu = 2

Apply ReLU activation.

ReluAux = 130

Apply ReLU and save the auxiliary bitmask for backward pass.

ReluAuxBias = 134

Add bias, apply ReLU and save the auxiliary bitmask.

ReluBias = 6

Add bias then apply ReLU.