Class ChunkerIds

Namespace: Qavren.Edge.Ingestion

Assembly: Qavren.Edge.Ingestion.dll

The four chunker ids SP3 ships.

public static class ChunkerIds

Inheritance: object

ChunkerIds

Inherited Members: object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Fields

Auto: Picks MarkdownHeading for Markdown documents and Plain otherwise.

MarkdownHeading: Chunks along Markdown heading boundaries, building the heading-path breadcrumb as it goes.

Plain: Sentence/paragraph-boundary chunking with no structural awareness.

TokenWindow: Fixed-size token windows with configured overlap, for text with no exploitable structure.

Edit this page