Class RuntimeContextInternal

constructor

• new RuntimeContext(getGlobalFunc: (name: string) => PackedFunc): RuntimeContext

  Parameters

  • getGlobalFunc: (name: string) => PackedFunc

  Returns RuntimeContext

applyPresenceAndFrequencyPenalty

applyRepetitionPenalty

applySoftmaxWithTemperature

arrayConcat

arrayDecodeStorage

arrayGetItem

arrayGetSize

arrayMake

bool

concatEmbeddings

functionListGlobalNamesFunctor

getSysLib

makeShapeTuple

moduleGetFunction

moduleImport

paramModuleFromCache

paramModuleFromCacheByName

sampleTopPFromLogits

sampleTopPFromProb

tensorCacheClear

tensorCacheGet

tensorCacheRemove

tensorCacheUpdate

tensorCopyFromJSBytes

tensorCopyFromTo

tensorCopyToJSBytes

tensorCreateView

tensorEmpty

attachToCurrentScope

• attachToCurrentScope<T extends Disposable>(obj: T): T

  Track object for dispose in current scope.

  Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

    The object to be tracked.

  Returns T

  the same object.

  • Note: This function only needs to be called for raw system C API values. The return value of PackedFunc will be automatically tracked.

beginScope

• beginScope(): void

  Returns void

detachFromCurrentScope

• detachFromCurrentScope<T extends Disposable>(obj: T): T

  Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

  Returns T

dispose

• dispose(): void

  Dispose the internal resource This function can be called multiple times, only the first call will take effect.

  Returns void

endScope

• endScope(): void

  Returns void

moveToParentScope

• moveToParentScope<T extends Disposable>(obj: T): T

  Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

  Returns T