RPCRunner that uses RPC call to measures the time cost of programs on remote devices. Or sometime we may need to use RPC even in local running to insulate the thread environment. (e.g. running CUDA programs) More...

#include <measure.h>

Inheritance diagram for tvm::auto_scheduler::RPCRunnerNode:

Collaboration diagram for tvm::auto_scheduler::RPCRunnerNode:

Public Member Functions
Array< MeasureResult >	Run (const Array< MeasureInput > &inputs, const Array< BuildResult > &build_results, int verbose) final
	Run measurement and return results. More...

	TVM_DECLARE_FINAL_OBJECT_INFO (RPCRunnerNode, ProgramRunnerNode)

Public Member Functions inherited from tvm::auto_scheduler::ProgramRunnerNode
	TVM_DECLARE_BASE_OBJECT_INFO (ProgramRunnerNode, Object)

Public Member Functions inherited from tvm::runtime::Object
uint32_t	type_index () const

std::string	GetTypeKey () const

size_t	GetTypeKeyHash () const

template<typename TargetType >
bool	IsInstance () const

bool	unique () const

	Object ()

	Object (const Object &other)

	Object (Object &&other)

Object &	operator= (const Object &other)

Object &	operator= (Object &&other)

Public Attributes
String	key
	The key of the device registered in the RPC tracker. More...

String	host
	The host address of the RPC Tracker. More...

int	port
	The port of the RPC Tracker. More...

int	priority
	The priority of this run request, larger is more prior. More...

int	n_parallel
	The number of tasks run in parallel. More...

Public Attributes inherited from tvm::auto_scheduler::ProgramRunnerNode
int	timeout
	Timeout of a run. More...

int	number
	The number of times to run the generated code for taking average. More...

int	repeat
	The number of times to repeat the measurement. More...

int	min_repeat_ms
	The minimum duration of one repeat in milliseconds. More...

double	cooldown_interval
	The cool down interval between two measurements. More...

bool	enable_cpu_cache_flush
	Whether to flush cache on CPU between repeated measurements. More...

int	device
	Which device to run on if multiple are avaialble. More...

Static Public Attributes
static constexpr const char *	_type_key = "auto_scheduler.RPCRunner"

Static Public Attributes inherited from tvm::auto_scheduler::ProgramRunnerNode
static constexpr const char *	_type_key = "auto_scheduler.ProgramRunner"

Static Public Attributes inherited from tvm::runtime::Object
static constexpr const char *	_type_key = "runtime.Object"

static constexpr bool	_type_final = false

static constexpr uint32_t	_type_child_slots = 0

static constexpr bool	_type_child_slots_can_overflow = true

static constexpr bool	_type_has_method_visit_attrs = true

static constexpr bool	_type_has_method_sequal_reduce = false

static constexpr bool	_type_has_method_shash_reduce = false

static constexpr uint32_t	_type_index = TypeIndex::kDynamic

Additional Inherited Members
Public Types inherited from tvm::runtime::Object
typedef void(*	FDeleter) (Object *self)
	Object deleter. More...

using	RefCounterType = std::atomic< int32_t >

Static Public Member Functions inherited from tvm::runtime::Object
static std::string	TypeIndex2Key (uint32_t tindex)
	Get the type key of the corresponding index from runtime. More...

static size_t	TypeIndex2KeyHash (uint32_t tindex)
	Get the type key hash of the corresponding index from runtime. More...

static uint32_t	TypeKey2Index (const std::string &key)
	Get the type index of the corresponding key from runtime. More...

static uint32_t	_GetOrAllocRuntimeTypeIndex ()

static uint32_t	RuntimeTypeIndex ()

Protected Member Functions inherited from tvm::runtime::Object
void	IncRef ()
	developer function, increases reference counter. More...

void	DecRef ()
	developer function, decrease reference counter. More...

Static Protected Member Functions inherited from tvm::runtime::Object
static uint32_t	GetOrAllocRuntimeTypeIndex (const std::string &key, uint32_t static_tindex, uint32_t parent_tindex, uint32_t type_child_slots, bool type_child_slots_can_overflow)
	Get the type index using type key. More...

Protected Attributes inherited from tvm::runtime::Object
uint32_t	type_index_ {0}
	Type index(tag) that indicates the type of the object. More...

RefCounterType	ref_counter_ {0}
	The internal reference counter. More...

FDeleter	deleter_ = nullptr
	deleter of this object to enable customized allocation. If the deleter is nullptr, no deletion will be performed. The creator of the object must always set the deleter field properly. More...

Detailed Description

RPCRunner that uses RPC call to measures the time cost of programs on remote devices. Or sometime we may need to use RPC even in local running to insulate the thread environment. (e.g. running CUDA programs)

Member Function Documentation

◆ Run()

Array<MeasureResult> tvm::auto_scheduler::RPCRunnerNode::Run	(	const Array< MeasureInput > &	inputs,
		const Array< BuildResult > &	build_results,
		int	verbose
	)

finalvirtual

Run measurement and return results.

Parameters

inputs	An Array of MeasureInput.
build_results	An Array of BuildResult.
verbose	Verbosity level. 0 for silent, 1 to output information during program running.

Returns: An Array of MeasureResult.

Implements tvm::auto_scheduler::ProgramRunnerNode.

◆ TVM_DECLARE_FINAL_OBJECT_INFO()

tvm::auto_scheduler::RPCRunnerNode::TVM_DECLARE_FINAL_OBJECT_INFO	(	RPCRunnerNode	,
		ProgramRunnerNode
	)

Member Data Documentation

◆ _type_key

constexpr const char* tvm::auto_scheduler::RPCRunnerNode::_type_key = "auto_scheduler.RPCRunner"

staticconstexpr

◆ host

String tvm::auto_scheduler::RPCRunnerNode::host

The host address of the RPC Tracker.

◆ key

String tvm::auto_scheduler::RPCRunnerNode::key

The key of the device registered in the RPC tracker.

◆ n_parallel

int tvm::auto_scheduler::RPCRunnerNode::n_parallel

The number of tasks run in parallel.

◆ port

int tvm::auto_scheduler::RPCRunnerNode::port

The port of the RPC Tracker.

◆ priority

int tvm::auto_scheduler::RPCRunnerNode::priority

The priority of this run request, larger is more prior.

The documentation for this class was generated from the following file:

include/tvm/auto_scheduler/measure.h

Public Member Functions

Public Attributes

Static Public Attributes

Additional Inherited Members