Hugging Face Launches TorchTPU, Making TPUs a Native PyTorch Backend

Hugging Face has released TorchTPU, a native PyTorch backend that lets users run Transformers, Diffusers, and Kernels directly on Google’s Tensor Processing Units (TPUs). By specifying device_map="tpu", models from the Hub load onto the TPU without extra conversion steps, and the library includes Pallas kernels, distributed training support, and torch.compile integration for speed. This removes the need for the older torch_xla stack and Optimum TPU for TPU inference and training.