Struct ChatBudgetRequest

Namespace: Qavren.Edge.Chat

Assembly: Qavren.Edge.Chat.Onnx.dll

One question for the memory gate.

public readonly record struct ChatBudgetRequest : IEquatable<ChatBudgetRequest>

Implements: IEquatable<ChatBudgetRequest>

Inherited Members: ValueType.Equals(object)

ValueType.GetHashCode()

ValueType.ToString()

object.Equals(object, object)

object.GetType()

object.ReferenceEquals(object, object)

Constructors

ChatBudgetRequest(string, ChatModelShape, int, EdgeResourceSnapshot, EdgeChatDeviceProfile): One question for the memory gate.

Properties

Device: The cached device profile.

PresetId: The preset being loaded.

RequestedContextTokens: min(options.MaxContextTokens ?? preset.DefaultMaxContextTokens, shape.ContextLength, configDeclaredContextLength) - spec section 9.1 step 4 does the clamping, which is what keeps Qwen3_600MInt4's declared 40960 from ever reaching a generator.

Resources: One IEdgeResourceMonitor.Read().

Shape: Its declared geometry.

Edit this page