Property TimeToFirstToken

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

TimeToFirstToken

Prefill plus the first decode step.

public TimeSpan TimeToFirstToken { get; init; }

Property Value

TimeSpan