MaxText

Google details Streaming DiLoCo for LLM training across data centers
Google has detailed Streaming DiLoCo, an approach implemented in its open-source MaxText framework to support large language model training across geographically…

Google brings long-context training to TPUs through MaxText
Google has added long-context training support to MaxText, its open-source JAX training framework for Cloud TPU. The release supports four context-parallel strategies…