Hugging Face Blog·· 8d ago
Hugging Face Space allows users to check Transformer model compatibility on AWS Trainium
Original source: Hugging Face BlogRead original
AI brief
Following the introduction of TorchNeuron, Hugging Face launched an aws-neuron/torch-neuronx-model-support Space to check the compatibility and performance of popular Transformer models on AWS Trainium. The Space provides results including the number of Trainium cores used, compilation wall time, and peak device memory. Users can look up specific models via Trending or Downloads views, check model versions and Neuron compiler configurations, and access scripts to run models unmodified on Trainium2 (trn2) instances.
Source: Hugging Face Blog · huggingface.co