
- Category
- AI
- Website
- github.com
- Language
- English
- Listed
- Jul 20, 2026
- Stars
- 19,533
- Forks
- 1,576
kvcache-ai/ktransformers ↗, Python, Apache-2.0, Last commit 3d ago
Ktransformers is a framework for optimizing inference and fine-tuning across heterogeneous large language models. Different architectures need different handling, so multiple architectures live under one interface while the optimization strategy stays something you configure. The payoff it aims at is lower computational overhead on work you were already going to run. Training sits outside its scope; what the framework governs is how an existing model executes.
Like this product?