Get the latest tech news

Focus and Context and LLMs


I decided to write down some thoughts on agentic coding and why it’s a very hyped wrong turn. Let me start with some background on my LLM experience. I adopted LLMs into my work in Aug 2020. I was sold when I saw that GPT-3 could generate usable SQL statements. Something that used to take 4-8 hours of RTFMing, now took 15min. I have since worked on chatcraft.org, various RAG frameworks, etc. I use aider heavily for work, frequently switch models, have been struggling with tool calling since before MCP as even an idea.

I use aider heavily for work, frequently switch models, have been struggling with tool calling since before MCP as even an idea. I would double down on influencer claims and say that LLM-enabled tools can complete software that a large fraction of currently employed engineers would fail at I think until we come up with a better way to curate context for LLMs, they will only be truly impressive in the hands of exceptional software engineers ( Kenton and Sean are also incredible communicators).

Get the Android app

Or read this on Hacker News

Read more on:

Photo of LLMs

LLMs

Photo of Context

Context

Photo of focus

focus

Related news:

News photo

The last six months in LLMs, illustrated by pelicans on bicycles

News photo

A Knockout Blow for LLMs?

News photo

How much information do LLMs really memorize? Now we know, thanks to Meta, Google, Nvidia and Cornell