Kuzco is a Swift package for integrating large language models (LLMs) directly into iOS, macOS, and Mac Catalyst apps. Built on `llama.cpp`, it offers customizable prompts, flexible tuning, and async/await-friendly APIs for on-device AI.

Hey everyone! I built Kuzco for two big reasons: 1. Developers can cut costs by skipping cloud APIs and running AI locally on‑device, completely free. 2. I was done sending my data (and users’ data) to third‑party servers. Kuzco is a straightforward Swift wrapper for llama.cpp, letting you plug local models into iOS and macOS apps with just a few lines of code. It’s fully open source, so dive in, tweak away, and if you use it (or even plan to) please drop me a link on X (Twitter), so I can cheer you on!

@jcass99 is it possible to support @OpenAI 's Open Models?

Running AI models locally with just a Swift wrapper? That’s genius—no more sending user data everywhere, ngl this is a game-changer for privacy-first apps. Makers nailed it!

@cruise_chen Thanks Cruise!

Finally. This was the product I had been waiting for for a long time, and which the global community had been waiting for. Congratulations.

Kuzco

Open-source Swift package to run LLMs locally on iOS & macOS

Open-source Swift package to run LLMs locally on iOS & macOS

Kuzco

Open-source Swift package to run LLMs locally on iOS & macOS

Open-source Swift package to run LLMs locally on iOS & macOS

Similar Products