Interface IChatPromptContext

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

What a formatter may reach. Deliberately not the raw Tokenizer: the GenAI C API is documented as not thread safe and the decode loop owns the gate.

public interface IChatPromptContext

Properties

ResolvedContextTokens

The context the budget allowed, which may be below the preset's default.

Shape

The loaded model's geometry.

Methods

ApplyChatTemplate(string, bool)

Runs the model's own Jinja template through minja.

CountTokens(string)

Counts tokens with the model's own tokenizer, never an estimate.