The way I was taught the trolley problem was to explain the vulnerabilities of AI in decision making if we didn’t consider the rival’s strategy. The issue is that regardless of what the rival does, betraying is more profitable on average.
If the rival stays silent, betraying is best for us, and if they betray us, betraying is again the best move. If we consider the average scores, betraying is always the best move. However, if we cooperate, both remaining silent is the best overall, but this requires a more sophisticated AI.
The way I was taught the trolley problem was to explain the vulnerabilities of AI in decision making if we didn’t consider the rival’s strategy. The issue is that regardless of what the rival does, betraying is more profitable on average.
If the rival stays silent, betraying is best for us, and if they betray us, betraying is again the best move. If we consider the average scores, betraying is always the best move. However, if we cooperate, both remaining silent is the best overall, but this requires a more sophisticated AI.