Get the latest tech news

GPT-5 bombed my coding tests, but redeemed itself with code analysis


I asked GPT-5, GPT-5 Pro, GPT-5 Thinking, and o3 to analyze my code repository - and found surprising differences in detail, reasoning, and actionable insights that could change how you work.

I connected them to my private GitHub repository for my open-source free WordPress security plugin and its freemium add-on modules, selected Deep Research, and gave them this prompt. GPT-5 Pro didn't just describe the system; it walked through the process in sequential operational steps, almost like a short runbook you could hand to a developer or QA tester. I found GPT-5's ability to understand and explain a complex interconnected system like my security product, all in one pass, to be a substantial improvement over the GPT-4 generation.

Get the Android app

Or read this on ZDNet

Read more on:

Photo of GPT-5

GPT-5

Photo of coding tests

coding tests

Photo of code analysis

code analysis

Related news:

News photo

How to use GPT-5 in VS Code with GitHub Copilot

News photo

How to restore GPT-4o when you've GPT-5

News photo

I tested GPT-5's coding skills, and it was so bad that I'm sticking with GPT-4o (for now)