Skip to content
Hugging Face Blog·· 10d ago

Hugging Face Profiles Inference Performance on AWS Trainium Using TorchNeuron

Original source: Hugging Face BlogRead original
AI brief

This guide details how to systematically analyze inference performance on AWS Trainium using TorchNeuron, an open-source native PyTorch backend. It demonstrates configuring torch.profiler with the Neuron backend via NeuronConfig to capture device and runtime traces, and using Neuron Explorer to trace an operation from framework dispatch through runtime scheduling to hardware execution on a NeuronCore.

Source: Hugging Face Blog · huggingface.co