Skip to main content

Module block_paged

Module block_paged 

Source
Expand description

Block-paged layout descriptor.

Tag 0x0A. Rank MUST be 3. Buffer count = 3 (page_pool + block_table + seq_ptr). See docs/spec/layouts/block-paged.md.

Structs§

BlockPagedLayout
Descriptor for the block-paged indirect layout.

Enums§

BlockTableIndexType
Element type for the block_table and seq_ptr index buffers.
KvRole
KV-cache role for a block-paged tensor.