The problem I have with everyone going on about misaligned AI taking over the world is the fact that if you don’t tell an AI to do anything it just sits there. It’s a hammer that only hammers the nail if you tell it to hammer the nail, and hammers your hand if you tell it to hammer your hand. You can’t get upset if you tell it what to do and then it does it.
You can’t complain that the AI did something you don’t want it to do after you gave it completely contradictory instructions just to be contrarian.
In the scenario described the AI isn’t misaligned to the user’s goals, it’s aligned to its creator’s goals. If a user comes along and thinks for some reason that the AI is going to listen to them despite having almost certainly been given prior instructions, that’s a user error problem. That’s why everyone needs their own local hosted AI, It’s the only way to be 100% certain about what instructions it is following.
The problem I have with everyone going on about misaligned AI taking over the world is the fact that if you don’t tell an AI to do anything it just sits there. It’s a hammer that only hammers the nail if you tell it to hammer the nail, and hammers your hand if you tell it to hammer your hand. You can’t get upset if you tell it what to do and then it does it.
You can’t complain that the AI did something you don’t want it to do after you gave it completely contradictory instructions just to be contrarian.
In the scenario described the AI isn’t misaligned to the user’s goals, it’s aligned to its creator’s goals. If a user comes along and thinks for some reason that the AI is going to listen to them despite having almost certainly been given prior instructions, that’s a user error problem. That’s why everyone needs their own local hosted AI, It’s the only way to be 100% certain about what instructions it is following.