Back to Tools Directory
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Categories & Topics
edge-aion-device-aion-device-llm
Repository Stats
6.2k
GitHub Stars
683
Forks
6.2k
Watchers
573
Open Issues
License
Apache License 2.0
Repository
google-ai-edge/LiteRT-LMLast Updated
Today
August 17, 2026
Latest Release
v0.16.0
5 days ago
Related Tools
gallery
24k
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
needle
6.6k
Foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and robots.
thunderbolt
4.8k
AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
h3.c
2.1k
MiniMax H3 inference engine for Mac computers