Get the latest tech news

I Program with LLMs


Generative models can be powerfully useful—if you’re willing to adapt your approach.

My underlying fascination with the new technology is the only way I have managed to figure it out, so I am sympathetic when other engineers claim LLMs are “useless.” But as I have been asked more than once how I can possibly use them effectively, this post is my attempt to describe what I have found so far. If I have a question about a complex environment, say “how do I make a button transparent in CSS,” I will get a far better answer asking any consumer-based LLM—o1, sonnet 3.5, etc.—than I do using an old-fashioned web search engine and trying to parse the details out of whatever page I land on. You can spend a lot more time writing tests to be readable because the LLM is not sitting there constantly thinking, “It would be better for the company if I went and picked another bug off the issue tracker than doing this.” So the trade-off shifts in favor of having more specialized implementations.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of program

program

Photo of LLMs

LLMs

Related news:

News photo

Self-invoking code benchmarks help you decide which LLMs to use for your programming tasks

News photo

Chat-Driven Development: A Better Way to Use LLMs for Coding

News photo

It’s remarkably easy to inject new medical misinformation into LLMs | Changing just 0.001% of inputs to misinformation makes the AI less accurate.