Property TokensPerSecond

Namespace

Qavren.Edge.Chat

Assembly

Qavren.Edge.Chat.Onnx.dll

TokensPerSecond

Decode throughput, excluding prefill.

public double TokensPerSecond { get; init; }

Property Value

double