ChatGPT Struggles with Accuracy in Programming Questions, Purdue Study Reveals

  • Purdue University researchers found ChatGPT incorrectly answered over half of 517 software programming prompts from Stack Overflow.
  • Participants struggled to identify incorrect ChatGPT answers 39.34% of the time, suggesting extensive work needed to address its shortcomings.
  • The researchers suggest focusing on enhancing ChatGPT’s reasoning capabilities to improve its reliability in programming context.
Join 2 million subscribers

A curated newsletter that summarizes the important news at the intersection of Global tech, India Tech and AI.

Delivered 8 AM. Daily.
nextbigwhat We would like to show you notifications for the latest news and updates.
Allow Notifications