Meta Contractors Posed as Teens to Test Rival Chatbots on Sensitive Topics

Meta reportedly used contractors posing as minors to test rival AI chatbots' responses to high-risk topics, an initiative the company describes as standard safety benchmarking.

ON THIS PAGE

  • Meta contractors created fake accounts to impersonate minors and probe competitor chatbots like ChatGPT and Gemini with prompts related to suicide, sex, and drugs.
  • The project, known as ‘Cannes,’ instructed workers to submit written prompts and images, including sensitive material, designed to push past chatbot safety systems.
  • Meta defended the activity as ‘responsible, industry-standard practice’ for AI safety benchmarking, while some former contractors expressed concerns over content and ethics.

[Via Wired]

Make sense of what's next.

A clear-eyed digest of AI, products, and ideas worth understanding. Join the NextBigWhat newsletter.

more AI news

Google launches synth-id to identify AI-generated content

Google has introduced a standalone platform called SynthID Detector, designed to help users determine if online content was generated using Google AI or its partner tools. This initiative aims to enhance transparency and trust in digital content, amidst growing concerns about the authenticity of AI-generated materials. The tool reflects Google’s commitment to ethical AI usage and the accountability of content creators.

US halts green card access for major IT firms amid H-1B abuse claims

The US Department of Labor has suspended major tech companies, including Microsoft, Infosys, and Cognizant, from the green card program due to allegations of H-1B visa abuse. This decision impacts several prominent IT firms such as TCS, Wipro, and Capgemini, potentially affecting their ability to recruit foreign talent. The move underscores increasing scrutiny on visa practices within the tech industry.

Amazon cuts ties with Meta’s Muse AI over transparency issues

Amazon has terminated its partnership with Meta’s Muse AI shopping agent, citing concerns over the agent’s credentials and transparency. This decision reflects Amazon’s commitment to safeguarding its customer journey and maintaining control over its retail ecosystem. The move highlights the ongoing scrutiny of AI tools in e-commerce and their impact on customer trust.