SparseGPT stays closest to dense model in interpretability test
A preprint compares three pruning methods and finds SparseGPT and WANDA keep fixed sparse-autoencoder metrics closer to dense-model results.
Developing Light ยท https://developinglight.com/editorial/developing-light