Field SessionWarmUp

Namespace: Qavren.Edge.Onnx

Assembly: Qavren.Edge.Onnx.dll

Opt-in. Two tasks share this order: Qavren.Edge.Onnx's WarmUpSessionAtStartup (loads the session; needs no tokenizer) and Qavren.Edge.Embeddings.Onnx's WarmUpEmbeddingsAtStartup (load plus one dummy batch; needs the tokenizer and the generator, both of which live in L1).

public const int SessionWarmUp = 220

Returns

int: Opt-in. Two tasks share this order: Qavren.Edge.Onnx's WarmUpSessionAtStartup (loads the session; needs no tokenizer) and Qavren.Edge.Embeddings.Onnx's WarmUpEmbeddingsAtStartup (load plus one dummy batch; needs the tokenizer and the generator, both of which live in L1).

Table of Contents

Field SessionWarmUp

Returns