SparseGPT vs Wanda vs structured pruning: what actually preserves LLM quality under compression
SparseGPT and Wanda usually preserve perplexity better than structured pruning at the same sparsity, but structured pruning is the only one that reliably maps to hardware speedups without specialized kernels — so the real decision is quality retention vs deployable acceleration, not sparsity percentage alone.