Class RuntimeContextInternal

constructor

• new RuntimeContext(getGlobalFunc): RuntimeContext

• Parameters

  • getGlobalFunc: ((name) => PackedFunc)

    • • (name): PackedFunc

      • Parameters

        • name: string

        Returns PackedFunc

  Returns RuntimeContext

applyPresenceAndFrequencyPenalty

applyRepetitionPenalty

applySoftmaxWithTemperature

arrayConcat

arrayDecodeStorage

arrayGetItem

arrayGetSize

arrayMake

bool

concatEmbeddings

functionListGlobalNamesFunctor

getSysLib

makeShapeTuple

moduleGetFunction

moduleImport

paramModuleFromCache

paramModuleFromCacheByName

sampleTopPFromLogits

sampleTopPFromProb

tensorCacheClear

tensorCacheGet

tensorCacheRemove

tensorCacheUpdate

tensorCopyFromJSBytes

tensorCopyFromTo

tensorCopyToJSBytes

tensorCreateView

tensorEmpty

attachToCurrentScope

• attachToCurrentScope<T>(obj): T

• Track object for dispose in current scope.

  Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

    The object to be tracked.

  Returns T

  the same object.

  Note

  This function only needs to be called for raw system C API values. The return value of PackedFunc will be automatically tracked.

beginScope

• beginScope(): void

• Returns void

detachFromCurrentScope

• detachFromCurrentScope<T>(obj): T

• Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

  Returns T

dispose

• dispose(): void

• Dispose the internal resource This function can be called multiple times, only the first call will take effect.

  Returns void

endScope

• endScope(): void

• Returns void

moveToParentScope

• moveToParentScope<T>(obj): T

• Type Parameters

  • T extends Disposable

  Parameters

  • obj: T

  Returns T