AI voice chat infrastructure that uses WebSockets. It can achieve voice-to-voice latency as low as 300ms (what GPT-4o does) without a unified voice codec. Everything runs on a single high-end consumer GPU.

A fast, fully local AI voicechat app that runs WebSockets! Check it out! 🤓 git clone https://github.com/lhl/voicechat2

How would someone deploy this on the cloud? I assume you would need to rent GPUs on the cloud and run this?

Hey, I'm curious about the scalability. How many concurrent users can it support on a single GPU? Do you have any plans to develop a hosted version for those who might not want to set it up themselves? Congrats on the launch!

@kyrylosilin thanks for the well wishes. if you do scalability testing, feel free to post that info, I'm sure others might curious about the answer as well. I have no plans for hosting this myself, but as this code is permissively licensed, anyone can adapt or deploy it how they want! (there are so many existing inferencing endpoints w/ cracked teams and deep pockets, its hard to recommend that as a smart business idea though)

voicechat2

Open source voice chat infra that rivals GPT-4o

Open source voice chat infra that rivals GPT-4o

voicechat2

Open source voice chat infra that rivals GPT-4o

Open source voice chat infra that rivals GPT-4o

Similar Products

Do you use voicechat2?

Do you use voicechat2?