Back to Tools Directory

shimmy

Rust

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Categories & Topics

api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-aimachine-learningollama-apiopenai-compatiblerustrust-cratetransformerswebgpuwebgpu-shaders

Repository Stats

5.7k
GitHub Stars
552
Forks
5.7k
Watchers
9
Open Issues
License
Apache License 2.0
Last Updated
Today
August 7, 2026
Latest Release
v2.5.0
Today

Related Tools