Constructor OnnxEmbeddingGenerator

Namespace

Qavren.Edge.Embeddings.Onnx

Assembly

Qavren.Edge.Embeddings.Onnx.dll

OnnxEmbeddingGenerator(IOnnxSessionHost, IEdgeTokenizerProvider, IEdgeResourceMonitor, IOptions<OnnxEmbeddingOptions>, EmbeddingInputKind, ILogger<OnnxEmbeddingGenerator>, TimeProvider)

Creates a generator for one input kind.

public OnnxEmbeddingGenerator(IOnnxSessionHost sessionHost, IEdgeTokenizerProvider tokenizers, IEdgeResourceMonitor resources, IOptions<OnnxEmbeddingOptions> options, EmbeddingInputKind inputKind, ILogger<OnnxEmbeddingGenerator> logger, TimeProvider timeProvider)

Parameters

sessionHost IOnnxSessionHost

Owns every ONNX session in the process.

tokenizers IEdgeTokenizerProvider

Builds the tokenizer lazily on first use.

resources IEdgeResourceMonitor

The device monitor whose latched pressure shrinks the batch.

options IOptions<OnnxEmbeddingOptions>

The embedding options.

inputKind EmbeddingInputKind

Which prefix this instance applies.

logger ILogger<OnnxEmbeddingGenerator>

The logger.

timeProvider TimeProvider

The clock every Embedding.CreatedAt is read from.