Table of Contents

Property ThrottleAt

Namespace
Qavren.Edge.Chat
Assembly
Qavren.Edge.Chat.Onnx.dll

ThrottleAt

At or above this, pace the decode to ThrottledTokensPerSecond. Default Serious.

public EdgeThermalState ThrottleAt { get; set; }

Property Value

EdgeThermalState