Get the latest tech news

Voice Controlled Swarms


A blog where I write about my computer science projects, usually with some animations, code, and/or simulations.

Inspired by Command School from Enders Game, let’s make swarms that we can control with our voice! The overall architecture for how users interact with the simulation will be as follows: the player holds down a button to speak a command, which gets transcribed using a voice-to-text model. But that requires writing a sufficiently capable swarm simulation, as well as the tools to allow the LLM to convert our commands into actual actions.

Get the Android app

Or read this on Hacker News