Table of Contents

Property SpecialTokenOverhead

Namespace
Qavren.Edge.Ingestion
Assembly
Qavren.Edge.Ingestion.dll

SpecialTokenOverhead

Tokens the encoder adds that CountTokens(ReadOnlySpan<char>) does not report.

int SpecialTokenOverhead { get; }

Property Value

int