People are mistaken when they think that technology just automatically improves. It does not automatically improve. It only improves if a lot of people work very hard to make it better, and actually it will, I think, by itself degrade
There’s a fundamental difference, if you look into the future, between a humanity that is a space-faring civilization, that’s out there exploring the stars, compared with one where we are forever confined to Earth until some eventual extinction event.
Let’s say you create a self-improving A.I. to pick strawberries, and it gets better and better at picking strawberries and picks more and more, and it is self-improving, so all it really wants to do is pick strawberries. So then it would have all the world be strawberry fields. Strawberry fields forever.
The problem is that at a lot of big companies, process becomes a substitute for thinking. You’re encouraged to behave like a little gear in a complex machine. Frankly, it allows you to keep people who aren’t that smart, who aren’t that creative.