Pinned Loading

1. Megaprop Megaprop Public

   Preconditioned Optimizers for MoE Training at scale, with out-of-the-box support for MuP and FSDP support for Muon, built on top of Megatron-LM and TransformerEngine.

   23 1

2. opengenie opengenie Public

   An open attempt at reproducing a simplified version of Google's Genie World Model API on a single H100.

   Python 17

3. aftermath aftermath Public

   An open infrastructure to democratize and decentralize the development of superintelligence for humanity, now with support for heterogeneous devices training in tandem.

   Rust 3

4. pineapple-emulator pineapple-emulator Public

   A C++ based emulator for the CPU of the Nintendo Entertainment System that ran on the Ricoh 2A03, with limited PPU capabilities.

   C++ 4 1

5. tinything tinything Public

   As barebones as you can get the GPT, now accelerated on Macs thanks to tinygrad.

   Python 16 1

6. gp-zoo gp-zoo Public

   A repository with implementations of major papers on Gaussian Process regression models, implemented from scratch in Python, notably including Stochastic Variational Gaussian Processes.

   Jupyter Notebook 14