Property MaxBatchSize
- Namespace
- Qavren.Edge.Embeddings.Onnx
- Assembly
- Qavren.Edge.Embeddings.Onnx.dll
MaxBatchSize
How many inputs one ORT Run carries. 16 by default.
public int MaxBatchSize { get; set; }How many inputs one ORT Run carries. 16 by default.
public int MaxBatchSize { get; set; }