Property MaxConcurrency
MaxConcurrency
Concurrent ORT Runs. 1 by default: ORT already parallelises intra-op, and a second inference doubles peak native memory on a phone.
public int MaxConcurrency { get; set; }Concurrent ORT Runs. 1 by default: ORT already parallelises intra-op, and a second inference doubles peak native memory on a phone.
public int MaxConcurrency { get; set; }