5 Comments
User's avatar
тна Return to thread
Sumit Moitra's avatar

If AI is supposed to become more intelligent than humans, how are we supposed to start imagining what AI can do in future? Is it beyond comprehending based on current human Intelligence?

Expand full comment
Alberto Romero's avatar

Let's say you're a violin virtuoso. I, being significantly less intelligent than you in that sense, can easily understand that you can play the violin very well. I can't do what you can, but I can imagine that you can.

The intelligence required to imagine that something is possible is generally lower than the intelligence required to do the thing (I say generally because instinctive actions don't require any imagination). For instance, I can imagine a future AI capable of finding a unifying theory of gravity and quantum mechanics but I certainly can't do it.

Still, if we extend this argument (i.e. we keep increasing AI's intelligence, assuming there's no upper limit), we'll get to a point where our limited intelligence wouldn't be enough to even start imagining what it can do. At that point, what you say becomes forever true.

Expand full comment
Sumit Moitra's avatar

You are right but partly as you are missing the bigger picture. My point is that a chimp might understand that a human can count more bananas. But can that chimp realise that human brain is so evolved that in can create something like Calculus? Your violin virtuoso allegory is based on our existing knowledge of a musical instrument. Likewise, the unifying theory is in the realm of a possibility as thought of by Einstein. But what about those questions and possibilities which we dont even know might exists?

Expand full comment
Alberto Romero's avatar

That's where the second part of my reply applies!

Expand full comment
Sumit Moitra's avatar

Right. If we see this as a 'unknown unknown', then a very important 'known unknown' would be achieving the Principles of Determinism as explored in recent TV series Westworld and Devs.

Expand full comment