3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
Categories & Topics
Repository Stats
Related Tools
agenticSeek
Enjoy a fully local AI assistant that operates independently without the need for costly subscriptions or APIs. This autonomous agent can think, browse the web, and code, only requiring electricity to run.
apfel
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
autonomous-computer
Own your compute, own your intelligence. Time to build your Personal AI Data Center.
claude-code-proxy
Use Claude Code with your ChatGPT, Kimi, Cursor or Grok subscription via a local Anthropic-compatible proxy
colibri
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦