Class RuntimeContextInternal

constructor

• new RuntimeContext(getGlobalFunc): RuntimeContext

• Parameters

  • getGlobalFunc: ((name) => PackedFunc)

    • • (name): PackedFunc

      • Parameters

        • name: string

        Returns PackedFunc

  Returns RuntimeContext

applyPresenceAndFrequencyPenalty

applyRepetitionPenalty

applySoftmaxWithTemperature

arrayCacheClear

arrayCacheGet

arrayCacheRemove

arrayCacheUpdate

arrayConcat

arrayDecodeStorage

arrayGetItem

arrayGetSize

arrayMake

concatEmbeddings

getFFIString

getSysLib

makeShapeTuple

ndarrayCreateView

paramModuleFromCache

paramModuleFromCacheByName

sampleTopPFromLogits

sampleTopPFromProb

stringMake

attachToCurrentScope

• attachToCurrentScope<T>(obj): T

• Track object for dispose in current scope.

  Note

  This function only needs to be called for raw system C API values. The return value of PackedFunc will be automatically tracked.

  Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

    The object to be tracked.

  Returns T

  the same object.

beginScope

• beginScope(): void

• Returns void

detachFromCurrentScope

• detachFromCurrentScope<T>(obj): T

• Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

  Returns T

dispose

• dispose(): void

• Dispose the internal resource This function can be called multiple times, only the first call will take effect.

  Returns void

endScope

• endScope(): void

• Returns void

moveToParentScope

• moveToParentScope<T>(obj): T

• Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

  Returns T