Back to Tools Directory
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Categories & Topics
edge-aion-device-aion-device-llm
Repository Stats
6.5k
GitHub Stars
722
Forks
6.5k
Watchers
649
Open Issues
License
Apache License 2.0
Repository
google-ai-edge/LiteRT-LMLast Updated
Today
September 19, 2026
Latest Release
v0.17.1
2 days ago
Related Tools
gallery
24k
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
Lumina
3
On-device AI agent runtime with a C/C++ core and Swift host app. Tool execution, permissions, and resumable sessions.
needle
11k
Foundation model for tiny devices; 14mb, 26m params, 1-6k toks/sec on mobiles, wearables smart home and robots.
thunderbolt
4.8k
AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
h3.c
2.7k
MiniMax H3 inference engine for Mac computers