Why Emergence occurs

Recent findings like these suggest at least two possibilities for why emergence occurs, said Ellie Pavlick, a computer scientist at Brown University who studies computational models of language. One is that, as suggested by comparisons to biological systems, larger models truly do gain new abilities spontaneously.

“It may very well be that the model has learned something fundamentally new and different that it didn’t have at a smaller size,” she said. “That’s what we’re all hoping is the case, that there’s some fundamental shift that happens when models are scaled up.”

Sign Up for NextBigWhat Newsletter

Curated. Summarized. Important News. For free.

You May Also Like

Whole Product Concept

The Whole Product Concept identifies four different perceptions of product: Generic product – This is what’s shipped in the box and what’s covered by the purchasing contract between the seller…
View Post

The Brainstorming Illusion

When you ask people to describe an ideal brainstorming session, the most common elements you hear are people getting together, an energetic and exciting mood, and lots of ideas flying…
View Post