Edge LLM tests show speed varies by model, software and format
A preprint measures edge LLM speed, token timing, hardware use, power and energy across Jetson generations, backends and formats.
Developing Light ยท https://developinglight.com/editorial/developing-light