Back to Tools Directory
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Categories & Topics
edge-aion-device-aion-device-llm
Repository Stats
6.8k
GitHub Stars
780
Forks
6.8k
Watchers
751
Open Issues
License
Apache License 2.0
Repository
google-ai-edge/LiteRT-LMLast Updated
Today
November 3, 2026
Latest Release
v0.19.0
Yesterday
Related Tools
gallery
25k
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
Lumina
3
On-device AI agent runtime with a C/C++ core and Swift host app. Tool execution, permissions, and resumable sessions.
needle
14k
Foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and robots.
thunderbolt
4.8k
AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
h3.c
3.0k
MiniMax H3 inference engine for Mac computers