Discussion about this post

User's avatar
David McCallie's avatar

Nice article! To Altman, I suspect the Epsilon is the randomness that LLMs throw in as they make their word predictions. Each ChatGPT answer is unique (and therefore “creative”) due to this randomness. So the real question is how does the human Epsilon differ from this kind of mathematical randomness. Is Shakespeare’s genius due to his random mix of genetics and context? If so, perhaps LLMs with their ability to leverage randomness will eventually approach whatever it is that leads to a Shakespeare?

Expand full comment
Michel Schellekens's avatar

It is an insult to human creativity to expect intelligence to arise by magic from this primitive tool (primitive in terms of what it can achieve based on approximations) or to claim that this is all we ever need. I love the progress but let's be realistic about what the underpinning math does and does not do. Articles appear in Nature that do not deliver on their claims (automated generation of new algorithms, really?). Applications like AlphaGo turn out to be very brittle. I can't wait for the hype to wane. It is not doing anyone a favour, masking genuine progress in a mist of delusion. Why does one need to hype up interesting progress to an extent that starts to make even wonderful ideas seem ludicrous?

Expand full comment
28 more comments...

No posts