full transcript
From the Ted Talk "Nick Bostrom: What happens when our computers get smarter than we are?"

Unscramble the Blue Letters

Of course, perceivably things won't go wrong in these particular ways; these are cartoon lpsmeeax. But the general point here is important: if you create a really powerful optimization process to exmizmai for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King msida wishes that everything he touches be tnedru into gold. He tohsceu his daughter, she turns into gold. He touches his dofo, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you rcatee a powerful optimization process and give it misconceived or poorly specified goals.

Open Cloze

Of course, perceivably things won't go wrong in these particular ways; these are cartoon ________. But the general point here is important: if you create a really powerful optimization process to ________ for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King _____ wishes that everything he touches be ______ into gold. He _______ his daughter, she turns into gold. He touches his ____, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you ______ a powerful optimization process and give it misconceived or poorly specified goals.

Solution

  1. touches
  2. food
  3. create
  4. turned
  5. examples
  6. maximize
  7. midas

Original Text

Of course, perceivably things won't go wrong in these particular ways; these are cartoon examples. But the general point here is important: if you create a really powerful optimization process to maximize for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King Midas wishes that everything he touches be turned into gold. He touches his daughter, she turns into gold. He touches his food, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you create a powerful optimization process and give it misconceived or poorly specified goals.

ngrams of length 2

collocation frequency
artificial intelligence 7
optimization process 4
machine intelligence 4
human level 3
hard work 3
ed witten 3
control problem 3

Important Words

  1. care
  2. cartoon
  3. create
  4. daughter
  5. definition
  6. examples
  7. food
  8. general
  9. give
  10. goals
  11. gold
  12. greed
  13. illustration
  14. incorporates
  15. king
  16. lesson
  17. maximize
  18. metaphor
  19. midas
  20. misconceived
  21. myth
  22. objective
  23. optimization
  24. perceivably
  25. point
  26. poorly
  27. powerful
  28. practically
  29. process
  30. relevant
  31. taught
  32. touches
  33. turned
  34. turns
  35. wishes
  36. wrong