Property LastTokensPerSecond

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

LastTokensPerSecond

The most recent turn's decode throughput.

public double? LastTokensPerSecond { get; init; }

Property Value

double?