WavePP reports higher LLM throughput under heavy cache reuse
An arXiv preprint reports higher WavePP throughput in most tested LLM prefill settings, plus a regression in one cache-reuse ablation.
Developing Light ยท https://developinglight.com/editorial/developing-light