> I don't worry about malevolent AI, because we don't even know what consciousness is, nor the limits of a (presumably) nonconscious entity's attempts to emulate intelligence.
It doesn’t need to be malevolent. You’re made of atoms and if the AI has uses for those atoms goodbye you. There’s no reason to believe consciousness has any impact on the ability to maximize an objective function, i.e. try for a goal.
It doesn’t need to be malevolent. You’re made of atoms and if the AI has uses for those atoms goodbye you. There’s no reason to believe consciousness has any impact on the ability to maximize an objective function, i.e. try for a goal.