Visa’s AI models stumble in shopping tests, failing 43% of the time

Visa's recent benchmark reveals that 43% of AI models failed to effectively assist in shopping scenarios, raising questions about their reliability.

ON THIS PAGE

  • Visa tested 22 AI models across 15 shopping scenarios, revealing a 43% failure rate.
  • The best-performing AI models achieved an 82.2% success rate, while the worst lagged at 28.9%.
  • Over half of the failed attempts resulted in the AI making purchases that did not meet customer needs.

[via]

Make sense of what's next.

A clear-eyed digest of AI, products, and ideas worth understanding. Join the NextBigWhat newsletter.

Free. Unsubscribe anytime.

more AI news