full transcript
From the Ted Talk "Nick Bostrom: What happens when our computers get smarter than we are?"

#### Unscramble the Blue Letters

Of course, perceivably things won't go wrong in these particular ways; these are cartoon lpsmeeax. But the general point here is important: if you create a really powerful optimization process to exmizmai for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King msida wishes that everything he touches be tnedru into gold. He tohsceu his daughter, she turns into gold. He touches his dofo, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you rcatee a powerful optimization process and give it misconceived or poorly specified goals.

#### Open Cloze

Of course, perceivably things won't go wrong in these particular ways; these are cartoon ________. But the general point here is important: if you create a really powerful optimization process to ________ for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King _____ wishes that everything he touches be ______ into gold. He _______ his daughter, she turns into gold. He touches his ____, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you ______ a powerful optimization process and give it misconceived or poorly specified goals.

1. touches
2. food
3. create
4. turned
5. examples
6. maximize
7. midas

#### Original Text

Of course, perceivably things won't go wrong in these particular ways; these are cartoon examples. But the general point here is important: if you create a really powerful optimization process to maximize for objective x, you better make sure that your definition of x incorporates everything you care about. This is a lesson that's also taught in many a myth. King Midas wishes that everything he touches be turned into gold. He touches his daughter, she turns into gold. He touches his food, it turns into gold. This could become practically relevant, not just as a metaphor for greed, but as an illustration of what happens if you create a powerful optimization process and give it misconceived or poorly specified goals.

#### ngrams of length 2

collocation frequency
artificial intelligence 7
optimization process 4
machine intelligence 4
human level 3
hard work 3
ed witten 3
control problem 3

#### Important Words

1. care
2. cartoon
3. create
4. daughter
5. definition
6. examples
7. food
8. general
9. give
10. goals
11. gold
12. greed
13. illustration
14. incorporates
15. king
16. lesson
17. maximize
18. metaphor
19. midas
20. misconceived
21. myth
22. objective
23. optimization
24. perceivably
25. point
26. poorly
27. powerful
28. practically
29. process
30. relevant
31. taught
32. touches
33. turned
34. turns
35. wishes
36. wrong