Property MaxBatchSize

Namespace

Qavren.Edge.Embeddings.Onnx

Assembly

Qavren.Edge.Embeddings.Onnx.dll

MaxBatchSize

How many inputs one ORT Run carries. 16 by default.

public int MaxBatchSize { get; set; }

Property Value

int