Get the latest tech news

'How Good Is ChatGPT at Coding, Really?'


IEEE Spectrum (the IEEE's official publication) asks the question. "How does an AI code generator compare to a human programmer?" A study published in the June issue of IEEE Transactions on Software Engineering evaluated the code produced by OpenAI's ChatGPT in terms of functionality, complexi...

A study published in the June issue of IEEE Transactions on Software Engineering evaluated the code produced by OpenAI's ChatGPT in terms of functionality, complexity and security. The researchers also found that ChatGPT-generated code did have a fair amount of vulnerabilities, such as a missing null test, but many of these were easily fixable. "Interestingly, ChatGPT is able to generate code with smaller runtime and memory overheads than at least 50 percent of human solutions to the same LeetCode problems..."

Get the Android app

Or read this on Slashdot

Read more on:

Photo of ChatGPT

ChatGPT

Photo of Coding

Coding

Related news:

News photo

ChatGPT’s much-heralded Mac app was storing conversations as plain text

News photo

ChatGPT just (accidentally) shared all of its secret rules

News photo

Billionaire Niel’s Voice AI Takes on ChatGPT With French Accent