REAP: One-Shot Pruning for Trillion-Parameter Mixture-of-Experts Models

Created in October 16, 2025

2025   ·   mixture-of-experts   pruning   compression   LLM



Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • SparseOpt: Why Normalization Hurts Sparse Training (And How to Fix It)
  • Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry
  • Beyond Compression: How Knowledge Distillation Impacts Fairness and Bias in AI Models
  • Dynamic Sparse Training with Structured Sparsity
  • Gradient Flow in Sparse Neural Networks & Why Lottery Tickets Win