Back to Tools Directory

kimi-k3-in-c

C

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Categories & Topics

avx2c99cpu-inferencedeep-learningfrom-scratchinference-enginekimi-k3linear-attentionllmllm-inferencemachine-learningmemory-efficientmixture-of-expertsmoemxfp4quantizationsimdsystems-programmingtransformerzero-dependencies

Repository Stats

3.0k
GitHub Stars
508
Forks
3.0k
Watchers
2
Open Issues
License
Apache License 2.0
Last Updated
Today
August 7, 2026
Latest Release
v0.1.0
5 days ago

Related Tools