AI Does Not Know What's the Best for Humans
AI may, when given a goal, be able to optimize its way towards the goal. However, AI do not know what goals to pursue, and what goals to avoid.
As Steven Strogatz and Alex Townsend write in The Guardian:
As optimisation becomes more powerful, avoiding these traps becomes more important. The challenge is not simply finding the best answer. It is deciding what “best” really means – and knowing what not to optimise away.
~
Link:
- The Efficiency Trap: Why Optimising Everything can Backfire, Badly, by Steven Strogatz and Alex Townsend, The Guardian