- OpenAI has open-sourced a software framework called Evals to evaluate the performance of its AI models.
- Evals will allow anyone to report shortcomings in OpenAI models and help guide improvements.
- This is a crowdsourcing approach to model testing.
- OpenAI will use Evals to collect feedback on its models.