AI leaderboard scandal? Study claims LM Arena gave Meta and Google an unfair edge in chatbot testing A new study ignites controversy, alleging LM Arena enabled AI giants like Meta and Google to manipulate chatbot benchmark scores. This raises questions about transparency and fairness in evaluating artificial intelligence advancements.

ON THIS PAGE

AI Labs Accused of Gaming Chatbot Arena A study says LM Arena helped top AI labs like Meta and Google boost their scores. The labs privately tested models, then hid low scores. LM Arena denies the claims, saying scores were fair.

Source: techcrunch.com

Make sense of what's next.

A clear-eyed digest of AI, products, and ideas worth understanding. Join the NextBigWhat newsletter.

Free. Unsubscribe anytime.

more AI news

Nvidia CEO Jensen Huang steps down amid scandal over personal conduct

Jensen Huang has resigned from his position as CEO of Nvidia, following revelations of multiple extramarital affairs, including one with an individual suspected of being a Chinese spy. This unexpected departure raises questions about the company’s leadership and its potential impact on Nvidia’s future. Huang’s resignation marks a significant shift for the tech giant, which has seen rapid growth under his guidance.