Method ProcessAsync
- Namespace
- Qavren.Edge.Ingestion.DataIngestion
- Assembly
- Qavren.Edge.Ingestion.DataIngestion.dll
ProcessAsync(IngestionDocument, CancellationToken)
Splits a document into chunks asynchronously.
public override IAsyncEnumerable<IngestionChunk<string>> ProcessAsync(IngestionDocument document, CancellationToken cancellationToken = default)
Parameters
documentIngestionDocumentThe document to split.
cancellationTokenCancellationTokenThe token to monitor for cancellation requests.
Returns
- IAsyncEnumerable<IngestionChunk<string>>
The chunks created from the document.