Bridges PyTorch and Core AI. Convert existing models to Core AI IR, or author new ones from PyTorch via composite ops, custom op lowerings, and inline Metal GPU kernels.
Categories & Topics
Repository Stats
Related Tools
ds4
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
InfraTech
分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等
MTPLX
3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
turboquant-pytorch
From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% attention fidelity.
ComfyUI
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
splash
A local inference engine for Apple silicon, built around the model.