In the 1960s, the assumption is that in the future, people will have a computer terminal in their homes and offices which they will use to access an IBM super computer in some enormous facility miles away.
Because no one will ever be able to afford an IBM mainframe except the government or the Fortune 100.
But the economics don't work for kids who want to hack so Gates and Woz and Jobs and a hundred other hobbyists create a small computer where the economics do work.
It's not that I want to be the Pollyanna here. In many ways, because I don't trust human beings to make sensible decisions, I'm more worried about gene editing. But long term, I don't see how destroying the human race makes a profit.
The problem in all of this is that you keep assuming humans will matter. You need to feel the AGI.
I don't actually assume humans will matter.
I assume money will matter.
In the 1960s, the assumption is that in the future, people will have a computer terminal in their homes and offices which they will use to access an IBM super computer in some enormous facility miles away.
Because no one will ever be able to afford an IBM mainframe except the government or the Fortune 100.
But the economics don't work for kids who want to hack so Gates and Woz and Jobs and a hundred other hobbyists create a small computer where the economics do work.
It's not that I want to be the Pollyanna here. In many ways, because I don't trust human beings to make sensible decisions, I'm more worried about gene editing. But long term, I don't see how destroying the human race makes a profit.
And the guys funding this like profits.
You are going in the right direction. Now why does money matter? Because it is power to affect the world.
And if you create AI that can affect the world via prediction and robots, you get power right away.
The incentives do not align well for humanity, my friend
Kings had power.
Merchants had money.
Who won that debate?
The merchants are the ones who can exchange money for power smoothly with robots. And will be advised by machines, to replace humans with machines.
Quite a little kettle of a cycle.
There is a reason why this is existental.
You keep forgetting the customer.
Who buys what the robots produce?