Method RequiredBytes

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

RequiredBytes(ChatModelShape, int, ChatMemoryBudgetOptions)

weights + KV(context) + workspace + reserve, before any measured-peak substitution.

public static long RequiredBytes(ChatModelShape shape, int contextTokens, ChatMemoryBudgetOptions options)

Parameters

shape ChatModelShape

The model's geometry.

contextTokens int

The context to size for.

options ChatMemoryBudgetOptions

The budget's constants.

Returns

long

The arithmetic total in bytes.

Exceptions

ArgumentNullException

shape or options is null.