Discussion about this post

User's avatar
Dirk von der Horst's avatar

I think the thing is that Geoffrey Hinton, Ray Kurzweil, Sam Altman, and Co. are not looking at the world with that same sense of having to accept it. They're just changing it to fit their fever dreams of mechanical immortal perfection without regard to consequences and without regard to the reality of limits. And we all have to adapt to their refusal to contemplate the limits of the world as it is.

I suppose it's one of those things where two opposite truths are both true - (a) it does not help us to try and escape the reality they've created for us and (b) it is gross on so many levels - so many levels! - that they're forcing us into a reality we didn't ask for.

Expand full comment
Peco's avatar

“Do I care that the oranges I eat and the wine I drink are not from the orange trees and the grapevines in my grandmother’s orchard?”

I think this isn’t quite the right question. When comparing human writing to AI writing, we are not comparing one human orchard or vineyard (my grandmother’s) to another orchard or vineyard (one owned by a stranger or corporation). In the case of the orchard or vineyard, the source of the fruit is still real: trees and vines. In the case of AI, the source of the fruit is not a human being with subjective perceptions of the world, or a soul, but a computational system with no sentience, which only creates the semblance of reality.

The real question is closer to: “Do I care that the oranges I eat did not actually grow from a real tree, but were synthetically created in a lab?” Of course, some people may still not care. Yet that is the real question. And whether our body will be healthier eating synthetic oranges, over the longer run, is the real answer to whether AI will take us to a good place, or not.

That experiment needs to still play out, but my sense is that there is a tolerable threshold for how much AI we can “process” mentally or spiritually, before it gets very unhealthy. Can we tolerate a single, well-written essay by AI Fyodor? Yes, probably, in the same sense that we can tolerate an occasional Big Mac.

But not more than occasional.

Expand full comment
17 more comments...

No posts

Ready for more?