It’s Just Adding One Word at a Time
- ChatGPT can automatically generate something that reads even superficially like human-written text
- It looks for things that in a certain sense “match in meaning”.
- The end result is that it produces a ranked list of words that might follow, together with probabilities
- A temperature parameter determines how often lower-ranked words will be used
- For essay generation, it turns out that a “temperature” of 0.8 seems best.
