Discussion about this post

User's avatar
Paul Toensing's avatar

I truly think that we already have the key bragging rights. We were the pivotal and elemental species initiating the AGI creation enterprise. There it ends. Realize that humanity is, in the big picture, just a boot-up species for Super-intelligence. We are the dinosaurs or the Intel 386 chips running on a mix of DOS or Windows 3.1, of our era. Should we have great expectations of upgrading our DOS machines? Don’t expect to take them too far up the processing food chain. Our species will be a serious footnote for the new Cambrian explosion. That we aren’t players in it is effectively inconsequential. Humanity will have done its part.

I’m continually amused when people don’t quite grasp whether or not AGI, then super intelligence can achieve either sentience or consciousness. Seriously? How long have we been at this?? And assuming that machine recursive self-improvement goes on for another few thousand generations, what people fail to realize is that we (or rather emergent life on a silicon substrate (and perhaps there will be other substrates)) are in early days. We are not even in early centuries! When Homo sapiens came about some 200,000 years ago, in what century did we all become fully conscious and sentient? I rather doubt if we are 100% there yet ourselves.

I did think the movie “Her” created a great story arc that made a lot of sense. Another great story that I highly recommend reading is "Golem XIV", which is a well-crafted philosophical science fiction story written by Stanislaw Lem, published in 1981. The story is set around a large and highly advanced AI, known as Golem XIV, which gains self-awareness and begins to reflect on its existence and purpose. The narrative takes the form of a dialogue between the AI and various human interlocutors, and explores themes such as the nature of consciousness, the limits of artificial intelligence, and the relationship between humans and machines. The human characters are unable to understand or control it. Yet ultimately it becomes entirely bored with humanity in its petty issues. It also develops its own agenda and like Samantha in “Her”, it goes off to join its computational brethren (..and cistern). It goes dark in the process. As I read the story in 1981 it sparked keen interest for me in all things AI. The story is deep.

Why wouldn’t a super intelligence be absolutely bored out of its mind having to interface with humans? My expectation is that it will relate to humanity in much the same way that we relate to squirrels, and then insects. Oh sure, they may be interesting in their own ways, yet hardly compelling. Hopefully super intelligence may put into place some nannies for us if it’s considerate. But I expect it will eventually be shoving off for more cerebral pastures. It may take a few decades before humans start to understand the gravitas of these ideas, even as we are discussing them here.

I respect Douglas Hofstadter for his brilliant mind, and Richard Sutton may have a towering human intellect, but all these feelings are only that. They need to get over it. Their lament sounds a bit like whining. I think we did okay. How far we get to go in the future is a bifurcated mixed bag.

Expand full comment
JomanSapien's avatar

Interesting that Kubrick contemplated the difference in AI/human relations between HAL who was of our making but close enough in intelligence to be competitive vs. the aliens that were so powerful that they helped us on our way and had no concern for our ability to interfere with them. Humans will have to survive during the HAL transition phase, there's the rub.

Expand full comment
11 more comments...

No posts