Property MaxContextTokens

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

MaxContextTokens

Null derives the value from the budget, capped by the preset's default and by Shape.ContextLength. Setting it turns the budget into a refusal rather than a cap: a value that does not fit throws ChatInsufficientMemory carrying the largest context that would have fit.

public int? MaxContextTokens { get; set; }

Property Value

int?