Property MeasuredPeakBytes
MeasuredPeakBytes
A peak RSS measured on a real device at ContextLength, or null. When present
and PreferMeasuredPeak is set, the budget takes
max(arithmetic, measured + ReserveBytes) - spec section 9.3 is the normative
formula - and records which term bound in UsedMeasuredPeak.
The reserve is added to the measured term because a measured peak is the model's own
resident footprint and carries no headroom for the rest of the app. Pure arithmetic
underestimates large-vocabulary models badly - Gemma-3-1b computes ~929 MiB and measures
1502 MiB - so a preset without a measurement is running on arithmetic alone and the
diagnostics block says so.
For both shipped presets this term is inert today, and that is stated rather than
implied. Llama32_1BInstructInt4's measured 1280 MiB plus a 192 MiB reserve is
1472 MiB, below its own arithmetic of 1679 MiB at 4096 tokens, so the arithmetic binds;
Qwen3_600MInt4 has no device measurement at all. The machinery exists for the case it
was built for - a large-vocabulary preset whose arithmetic under-reports, which is exactly
Gemma-3-1b - and spec section 19 item 3 is what would make it bind here.
public long? MeasuredPeakBytes { get; init; }Property Value
- long?