Official Pytorch implementation of the expert pruning and dynamic skipping methods as presented in: Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large ...