tvmjs
    Preparing search index...

    Interface SampledTokenReadbackBatch

    One completed sampled-token readback batch.

    interface SampledTokenReadbackBatch {
        batchSeq: number;
        tokenCount: number;
        tokens: Int32Array;
    }
    Index
    batchSeq: number

    Monotonic ring-local batch sequence number.

    tokenCount: number

    Number of valid token ids in tokens.

    tokens: Int32Array

    Contiguous token-id vector (int32) copied from GPU staging slot.