Push the science and maximize performance with AWS Trainium
Tutorial for Neuron Kernel Interface
(NKI)
@ ASPLOS 2025
Rotterdam, The Netherlands
March 31, 2025
Push the science and maximize performance with AWS Trainium
Tutorial for Neuron Kernel Interface
(NKI)
@ ASPLOS 2025
Rotterdam, The Netherlands
March 31, 2025
Neuron Kernel Interface (NKI) is a bare-metal language and compiler for directly programming NeuronDevices available on AWS Trn/Inf instances. You can use NKI to develop, optimize and run new operators directly on NeuronCores while making full use of available compute and memory resources. NKI empowers ML developers to self-serve and invent new ways to use the NeuronCore hardware, starting NeuronCores v2 (Trainium1) and beyond. For more information, see the Neuron Kernel Interface (NKI) Guide