Get the latest tech news

I dream of roombas: 1000s of automated AI robots that autonomously maintain code

Just yesterday morning, I was writing a conference talk on best practices for maintaining the LLM context window, which was quite detailed. It contained the then best practices from the two blog posts below. autoregressive queens of failureHave you ever had your AI coding assistant suggest something so off-base that

Just yesterday morning, I was writing a conference talk on best practices for maintaining the LLM context window, which was quite detailed. Instead of running an infinite loop where it would blow up the main context window (which would result in the code base ending up in an incomplete state) resulting in me having to jump back in and gets hands on to do other things with prompting to try and rescue it, now the main thread, the context window, it barely even increments and every loop completes. To be frank, the industry and foundation models aren't yet advanced enough to fully automate software development without engineers being in or out of the loop.

Get the Android app