Reduction Instructions#

CUDA reduction algorithms belong to the caller. Use scalar or packed arithmetic, warp shuffle instructions, shared storage, and explicit synchronization as appropriate for the kernel’s decomposition.

Trainium exposes the native T.trn.tile.tensorreduce instruction and the fused tensorscalar_reduce and activation_reduce instructions. Their axes and opcode are static qualifiers; tensors and optional reduction workspace are ordinary Call arguments.