Method GetAsync

Namespace

Qavren.Edge.Embeddings.Onnx

Assembly

Qavren.Edge.Embeddings.Onnx.dll

GetAsync(EmbeddingPreset, CancellationToken)

Provisions the vocabulary if needed and returns the cached tokenizer.

ValueTask<IEdgeTokenizer> GetAsync(EmbeddingPreset preset, CancellationToken cancellationToken = default)

Parameters

preset EmbeddingPreset

The preset whose manifest carries the vocabulary.

cancellationToken CancellationToken

Cancellation.

Returns

ValueTask<IEdgeTokenizer>

The process-wide tokenizer for this preset.