Table of Contents

Class ChatMemoryDecision

Namespace
Qavren.Edge.Chat
Assembly
Qavren.Edge.Chat.Onnx.dll

The gate's answer, with every term it read.

public sealed record ChatMemoryDecision : IEquatable<ChatMemoryDecision>
Inheritance
ChatMemoryDecision
Implements
Inherited Members

Constructors

ChatMemoryDecision(ChatMemoryVerdict, int, long, long, long, long, long, long?, long?, long?, EdgeMemoryBudgetKind, bool, string)

The gate's answer, with every term it read.

Properties

AvailableBytes

What the monitor reported, or null when it would not say.

BudgetKind

How to read AvailableBytes.

ContextTokens

The context to run at, or 0 on a refusal.

Explanation

One sentence naming every term and which one bound. It is what the refusal message says and what the diagnostics block publishes, so a consumer can see why they got 2048 tokens on one phone and 4096 on another without attaching a debugger.

KvCacheBytes

The KV term at ContextTokens.

RequiredBytes

What that context needs.

ReserveBytes

The reserve term.

TotalMemoryBytes

The device profile's total, whatever its source.

UsableBytes

AvailableBytes after SystemWideMemoryFraction, or unchanged on a PerProcess reading.

UsedMeasuredPeak

Whether MeasuredPeakBytes plus the reserve was the term that bound, rather than the arithmetic.

Verdict

What was decided.

WeightsBytes

The resident-weight term.

WorkspaceBytes

The workspace term.