Method WarmUpSessionAtStartup

Namespace

Qavren.Edge.Onnx

Assembly

Qavren.Edge.Onnx.dll

WarmUpSessionAtStartup(EdgeBuilder, string)

Startup order 220. Creates the session so the first real call pays neither graph optimisation nor a CoreML compile. Loads only - it runs no inference, because a batch needs a tokenizer and a generator and both live in Qavren.Edge.Embeddings.Onnx. Off by default, because it forces provisioning and spec 10 keeps that lazy.

public static EdgeBuilder WarmUpSessionAtStartup(this EdgeBuilder builder, string modelId)

Parameters

builder EdgeBuilder

The Qavren.Edge builder.

modelId string

The model to load.

Returns

EdgeBuilder

The same builder.