Get the latest tech news

Go or Rust? Just Listen to the Bots

It all started as a joke. I was in a group chat with a few of my friends and we were talking about football (soccer for the American readers). I entered the chat during a mildly heated discussion about the manager of a team one of my friends supports. It was going on for a bit while with seemingly no end in sight when it occurred to me that I could just as well clone my friends’ voices and pit them against each other by backing them with LLMs, and I’d probably not see much difference in the conversation.

I buried the original — arguably half broken — code in one of my GitHub gists that night with mild satisafaction from accomplishment and moved on with my life. I could just as well use one of the paid LLM offerings like OpenAI or Anthropic’s Claude etc., but I didn’t want to spend my tokens on a silly side project during the initial development phase: Ollama makes LLMs accessible on your machine via a simple API. Having settled on using Ollama for LLM, PlayHT API for TTS and NATS for message routing the architecture diagram of when zooming in on one part of the conversation looks like this:

Get the Android app