Property ShrinkBatchUnderMemoryPressure
- Namespace
- Qavren.Edge.Embeddings.Onnx
- Assembly
- Qavren.Edge.Embeddings.Onnx.dll
ShrinkBatchUnderMemoryPressure
Halve the effective batch size after a latched memory pressure until it clears.
public bool ShrinkBatchUnderMemoryPressure { get; set; }