Transformers

OpenRouter finds no clear quality gap between fp8, fp4 and fp16
OpenRouter found no detected accuracy difference between fp8, fp4 and fp16 in a test of Qwen3.8 27B, although the company cautions that the result covers one model and…

Apple Study Examines Why Gated State Space Models Struggle to Learn in Context
A paper published by Apple examines how gating affects State Space Models, finding that it can steer them toward memorization in model weights and delay or prevent…

Hugging Face Publishes Post on Transformers Model Integration Contracts
Hugging Face has published a blog post titled "Transformers Model Integration Contracts", which includes a section on "MIC contract coverage of Transformers model…

Hugging Face adds native TPU support through TorchTPU PyTorch backend
Hugging Face says Transformers, Diffusers and Kernels now run natively on Google's TPUs, thanks to TorchTPU, a native PyTorch backend that makes TPU "just another…

TorchNeuron brings native PyTorch support for HF models to AWS Trainium
Hugging Face says its main libraries now run natively on AWS Trainium through TorchNeuron, a new PyTorch backend that exposes Trainium as a standard device. TorchNeuron…