Table of Contents

Property AttentionMask

Namespace
Qavren.Edge.Embeddings.Onnx
Assembly
Qavren.Edge.Embeddings.Onnx.dll

AttentionMask

1 for a real token, 0 for padding, same layout and window as InputIds. This is the mask this library SYNTHESISES - never anything Microsoft.ML.Tokenizers returned. There is no attention-mask API in that library, and GetSpecialTokensMask is not one: on its default path it ignores the ids and emits 1, 0...0, 1, and on the other it marks special tokens. Either way it is the inverse of what ONNX wants.

public long[] AttentionMask { get; init; }

Property Value

long[]