Exla
An SDK to run transformer models anywhere
What is Exla?
Exla aggressively quantizes AI models to minimize memory usage and maximize inference speed. Whether you're deploying LLMs, VLMs, VLAs, or custom models, Exla reduces memory footprint by up to 80% and accelerates inference by 3–20x - all with just a few lines of code. https://cal.com/exla-ai/schedule
?
No comments yet. Be the first!
Real conversations about Exla on X
Post on X