Property LastTimeToFirstToken

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

LastTimeToFirstToken

The most recent turn's prefill latency.

public TimeSpan? LastTimeToFirstToken { get; init; }

Property Value

TimeSpan?