full transcript
"From the Ted Talk by Nick Bostrom: What happens when our computers get smarter than we are?"

Unscramble the Blue Letters

Of course, perceivably things won't go wrong in these particular ways; these are cartoon examples. But the general point here is important: if you create a really powerful optimization process to maximize for otvcjiebe x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also thaugt in many a myth. King Midas wishes that everything he touches be turned into gold. He theucos his daughter, she turns into gold. He touches his food, it tnurs into gold. This could become practically relevant, not just as a metaphor for geerd, but as an illustration of what happens if you create a powerful optimization pcroess and give it misconceived or poorly specified gloas.

Open Cloze

Of course, perceivably things won't go wrong in these particular ways; these are cartoon examples. But the general point here is important: if you create a really powerful optimization process to maximize for _________ x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also ______ in many a myth. King Midas wishes that everything he touches be turned into gold. He _______ his daughter, she turns into gold. He touches his food, it _____ into gold. This could become practically relevant, not just as a metaphor for _____, but as an illustration of what happens if you create a powerful optimization _______ and give it misconceived or poorly specified _____.

Solution

  1. turns
  2. touches
  3. objective
  4. taught
  5. greed
  6. goals
  7. process

Original Text

Of course, perceivably things won't go wrong in these particular ways; these are cartoon examples. But the general point here is important: if you create a really powerful optimization process to maximize for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King Midas wishes that everything he touches be turned into gold. He touches his daughter, she turns into gold. He touches his food, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you create a powerful optimization process and give it misconceived or poorly specified goals.

ngrams of length 2

collocation frequency
artificial intelligence 7
machine intelligence 4
optimization process 4
ed witten 3
control problem 3
human level 3
hard work 3

Important Words

  1. care
  2. cartoon
  3. create
  4. daughter
  5. definition
  6. examples
  7. food
  8. general
  9. give
  10. goals
  11. gold
  12. greed
  13. illustration
  14. incorporates
  15. king
  16. lesson
  17. maximize
  18. metaphor
  19. midas
  20. misconceived
  21. myth
  22. objective
  23. optimization
  24. perceivably
  25. point
  26. poorly
  27. powerful
  28. practically
  29. process
  30. relevant
  31. taught
  32. touches
  33. turned
  34. turns
  35. wishes
  36. wrong