In 2020, Dyer and others at Google Research predicted that LLMs would have transformative effects — but what those effects would be remained an open question.
This effort was called the Beyond the Imitation Game Benchmark (BIG-bench) project, riffing on the name of Alan Turing’s “imitation game,” a test for whether a computer could respond to questions in a convincingly human way.
