What Is ChatGPT Doing … and Why Does It Work?

It’s Just Adding One Word at a Time

  • ChatGPT can automatically generate something that reads even superficially like human-written text
  • It looks for things that in a certain sense “match in meaning”.
  • The end result is that it produces a ranked list of words that might follow, together with probabilities
  • A temperature parameter determines how often lower-ranked words will be used
  • For essay generation, it turns out that a “temperature” of 0.8 seems best.

Sign Up for NextBigWhat Newsletter

Curated. Summarized. Important News. For free.

You May Also Like