Namespace Qavren.Edge.Ingestion.Onnx
Classes
- EdgeChunkTokenizer
IChunkTokenizer over SP2's IEdgeTokenizer (spec 8.1, 11.2). It holds ONLY the IEdgeTokenizer: CountTokens(ReadOnlySpan<char>) forwards to CountTokens(ReadOnlySpan<char>), which SP2 forwards verbatim to
Tokenizer.CountTokensat its defaults and which takes a span rather than returning an index, so no normalised string can leak through it.
- OnnxIngestionBuilderExtensions
The one extension
Qavren.Edge.Ingestion.Onnxpublishes (spec 11.2).
- ResourceMonitorThrottle
IIngestionThrottle over SP2's Read() (spec 10.2). The table below is evaluated top to bottom, first match wins, and every halving is clamped to MinBatchSize:
LastPressure == Criticalpause, memory:criticalAvailableMemoryBytes < 48 MiBpause, memory:floorThermal == Criticalpause, thermal:criticalThermal == Seriousbatch / 2, delay 250 ms, thermal:seriousLastPressure == Moderatebatch / 2, memory:moderateAvailableMemoryBytes < 96 MiBbatch / 2, memory:warnIsLowPowerMode == truebatch = min(batch, 4), delay 100 ms, power:lowotherwise proceed at the configured batch
- ResourceMonitorThrottleOptions
What ResourceMonitorThrottle can be told to ignore, and how far it may shrink a batch (spec 10.2). Every default here changes behaviour.