Hugging Face Blog·· 10d ago
Hugging Face Profiles Inference Performance on AWS Trainium Using TorchNeuron
Original source: Hugging Face BlogRead original
AI brief
This guide details how to systematically analyze inference performance on AWS Trainium using TorchNeuron, an open-source native PyTorch backend. It demonstrates configuring torch.profiler with the Neuron backend via NeuronConfig to capture device and runtime traces, and using Neuron Explorer to trace an operation from framework dispatch through runtime scheduling to hardware execution on a NeuronCore.
Source: Hugging Face Blog · huggingface.co