Discussion about this post

User's avatar
Pascal Montjovent's avatar

Lately, people treat new AI chatbots like kids who torture their new Christmas toys. They poke and stretch them to see if, and when, they’ll break. We endlessly pick at language models to uncover flaws. Come on. Do we gain anything meaningful from this constant prodding? Or does it only briefly satisfy our petty urges?

We’ve become spoiled children surrounded by AI gifts. Obsessing over their imperfections serves little purpose, at least short-term. We would benefit more from marveling at their super-powers before investigating their failures.

Let's wait for rigorous benchmarks to decide if AI Santa truly delivered.

Expand full comment
Chase Hasbrouck's avatar

This is a good writeup. My very early thoughts are that the majority of the early reactions are from power users, who are likely to ask it to do the logic tricks or deep iterative tasks (the areas where Ultra seems weakest). Google is playing the long game and a different style/flavor of GPT-4 level ability + integration with Google data may be good enough for most.

Expand full comment
6 more comments...