Class MatmulPlanPreferences

Namespace

NVMathNet.LinAlg

Assembly

NVMath.Net.dll

Fine-grained control over the cuBLASLt algorithm selection used during NVMathNet.LinAlg.Matmul.Plan(NVMathNet.LinAlg.MatmulPlanPreferences) / NVMathNet.LinAlg.Matmul.PlanAsync(NVMathNet.LinAlg.MatmulPlanPreferences,System.Threading.CancellationToken). Pass an instance to the optional preferences parameter on those methods.

public sealed class MatmulPlanPreferences

Inheritance

object

MatmulPlanPreferences

Inherited Members

object.Equals(object?)

object.Equals(object?, object?)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object?, object?)

object.ToString()

Properties

MaxWorkspaceBytes

Override the maximum workspace in bytes offered to the algorithm search, replacing the value set in NVMathNet.LinAlg.MatmulOptions.MaxWorkspaceBytes. null (default) keeps the options value unchanged.

public nuint? MaxWorkspaceBytes { get; set; }

Property Value

nuint?

NumericalImplMask

Bit-mask controlling which numerical implementations are allowed. 0 (default) means all implementations are permitted. Set bit 0 (1) to allow tensor-core variants only, bit 1 (2) to allow SIMD variants only, etc. Maps to CUBLASLT_MATMUL_PREF_IMPL_MASK.

public ulong NumericalImplMask { get; set; }

Property Value

ulong

RequestedAlgoCount

Maximum number of algorithm candidates to request from the cuBLASLt heuristic. The first candidate (highest score) is used. Increase to let the heuristic consider more options when the default choice is sub-optimal. Default: 4.

public int RequestedAlgoCount { get; set; }

Property Value

int