Class ChatModelInfo

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

Everything the host knows about the model it is holding.

public sealed record ChatModelInfo : IEquatable<ChatModelInfo>

Inheritance

object

ChatModelInfo

Implements

IEquatable<ChatModelInfo>

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

ChatModelInfo(string, string, string, string, ChatModelShape, ChatMemoryDecision, int, ChatBackendReport, TimeSpan, DateTimeOffset, int, int, bool)

Everything the host knows about the model it is holding.

Properties

ActiveLeases

Outstanding leases.

Backend

The native build and this model's two probe results.

Budget

Every term the memory gate read, and which one bound.

Directory

The provisioned directory handed to new Config(string).

DirectorySha16

The 16-character content-addressed directory segment.

IntraOpNumThreads

model.decoder.session_options.intra_op_num_threads as the provisioned config declared it, or null when it declared nothing. Published as section 14.3's chatIntraOpNumThreads.

IsLoaded

Whether the model is resident right now.

LoadCount

How many times this host has loaded, including drops and reloads.

LoadDuration

How long new Model plus new Tokenizer took.

LoadedAtUtc

When the load completed.

ModelId

Its manifest's model id.

PresetId

The preset that was loaded.

ResolvedContextTokens

The context the budget allowed.

Shape

The geometry read from the provisioned genai_config.json.