full transcript

From the Ted Talk by Jinha Lee: Reach into the computer and grab a pixel

Unscramble the Blue Letters

Throughout the hroitsy of computers we've been striving to shorten the gap between us and digital information, the gap between our physical world and the world in the screen where our imagination can go wild. And this gap has become shorter, shorter, and even shorter, and now this gap is shortened down to less than a mltmeleiir, the thickness of a touch-screen glass, and the power of computing has become accessible to everyone. But I wdreoend, what if there could be no boundary at all? I started to inmigae what this would look like. First, I created this tool which penetrates into the dtigial space, so when you press it hard on the screen, it tsnefarrs its physical body into pixels. Designers can materialize their ideas directly in 3D, and surgeons can pcatirce on virtual organs underneath the screen. So with this tool, this boundary has been broken. But our two hands still remain outside the secren. How can you reach inside and interact with the digital information using the full dexterity of our hands? At Microsoft aielppd Sciences, along with my mentor Cati Boulanger, I redesigned the computer and turned a little space above the keyboard into a digital workspace. By combining a transparent display and depth cameras for sensing your fingers and face, now you can lift up your hands from the keyboard and reach inside this 3D space and grab pxeils with your bare hands. (Applause) Because windows and files have a position in the real space, selecting them is as easy as grabbing a book off your shelf. Then you can flip through this book while highlighting the lines, words on the virtual touch pad below each floating window. ahectrtics can stretch or rotate the models with their two hands directly. So in these elapemxs, we are rnacheig into the digital world. But how about reversing its role and having the digital information reach us instead? I'm sure many of us have had the experience of buying and returning items olnine. But now you don't have to worry about it. What I got here is an online augmented fitting room. This is a view that you get from head-mounted or see-through display when the system undstaderns the geometry of your body. Taking this idea further, I started to think, instead of just seeing these pixels in our space, how can we make it physical so that we can touch and feel it? What would such a future look like? At MIT Media Lab, along with my avoidsr Hiroshi Ishii and my collaborator Rehmi Post, we created this one physical pixel. Well, in this case, this spherical magnet acts like a 3D pixel in our scape, which means that both computers and poplee can move this object to anywhere within this little 3D space. What we did was essentially canceling gvartiy and cilnntrloog the movement by combining magnetic levioattin and mechanical actuation and sensing technologies. And by digitally programming the object, we are liberating the object from constraints of time and space, which means that now, human minotos can be recorded and played back and left permanently in the physical world. So choreography can be taught physically over distance and Michael Jordan's famous shooting can be replicated over and over as a phscyial reality. Students can use this as a tool to learn about the complex cptencos such as planetary motion, physics, and unlike computer sceners or textbooks, this is a real, tanigble eexicnerpe that you can tcuoh and feel, and it's very powerful. And what's more exciting than just tnnruig what's currently in the cmtuepor physical is to start imagining how pmmorrnigag the world will alter even our daliy physical activities. (Laughter) As you can see, the digital information will not just show us something but it will start directly acting upon us as a part of our physical surroundings without disconnecting ourselves from our wrold. Today, we started by talking about the boundary, but if we remove this boraudny, the only boundary left is our imoangtiain. Thank you. (Applause)

Open Cloze

Throughout the _______ of computers we've been striving to shorten the gap between us and digital information, the gap between our physical world and the world in the screen where our imagination can go wild. And this gap has become shorter, shorter, and even shorter, and now this gap is shortened down to less than a __________, the thickness of a touch-screen glass, and the power of computing has become accessible to everyone. But I ________, what if there could be no boundary at all? I started to _______ what this would look like. First, I created this tool which penetrates into the _______ space, so when you press it hard on the screen, it _________ its physical body into pixels. Designers can materialize their ideas directly in 3D, and surgeons can ________ on virtual organs underneath the screen. So with this tool, this boundary has been broken. But our two hands still remain outside the ______. How can you reach inside and interact with the digital information using the full dexterity of our hands? At Microsoft _______ Sciences, along with my mentor Cati Boulanger, I redesigned the computer and turned a little space above the keyboard into a digital workspace. By combining a transparent display and depth cameras for sensing your fingers and face, now you can lift up your hands from the keyboard and reach inside this 3D space and grab ______ with your bare hands. (Applause) Because windows and files have a position in the real space, selecting them is as easy as grabbing a book off your shelf. Then you can flip through this book while highlighting the lines, words on the virtual touch pad below each floating window. __________ can stretch or rotate the models with their two hands directly. So in these ________, we are ________ into the digital world. But how about reversing its role and having the digital information reach us instead? I'm sure many of us have had the experience of buying and returning items ______. But now you don't have to worry about it. What I got here is an online augmented fitting room. This is a view that you get from head-mounted or see-through display when the system ___________ the geometry of your body. Taking this idea further, I started to think, instead of just seeing these pixels in our space, how can we make it physical so that we can touch and feel it? What would such a future look like? At MIT Media Lab, along with my _______ Hiroshi Ishii and my collaborator Rehmi Post, we created this one physical pixel. Well, in this case, this spherical magnet acts like a 3D pixel in our _____, which means that both computers and ______ can move this object to anywhere within this little 3D space. What we did was essentially canceling _______ and ___________ the movement by combining magnetic __________ and mechanical actuation and sensing technologies. And by digitally programming the object, we are liberating the object from constraints of time and space, which means that now, human _______ can be recorded and played back and left permanently in the physical world. So choreography can be taught physically over distance and Michael Jordan's famous shooting can be replicated over and over as a ________ reality. Students can use this as a tool to learn about the complex ________ such as planetary motion, physics, and unlike computer _______ or textbooks, this is a real, ________ __________ that you can _____ and feel, and it's very powerful. And what's more exciting than just _______ what's currently in the ________ physical is to start imagining how ___________ the world will alter even our _____ physical activities. (Laughter) As you can see, the digital information will not just show us something but it will start directly acting upon us as a part of our physical surroundings without disconnecting ourselves from our _____. Today, we started by talking about the boundary, but if we remove this ________, the only boundary left is our ___________. Thank you. (Applause)

Solution

  1. reaching
  2. space
  3. daily
  4. transfers
  5. controlling
  6. experience
  7. tangible
  8. computer
  9. motions
  10. imagination
  11. applied
  12. people
  13. history
  14. boundary
  15. turning
  16. screen
  17. levitation
  18. examples
  19. architects
  20. screens
  21. understands
  22. concepts
  23. millimeter
  24. wondered
  25. digital
  26. online
  27. imagine
  28. gravity
  29. practice
  30. world
  31. advisor
  32. physical
  33. touch
  34. pixels
  35. programming

Original Text

Throughout the history of computers we've been striving to shorten the gap between us and digital information, the gap between our physical world and the world in the screen where our imagination can go wild. And this gap has become shorter, shorter, and even shorter, and now this gap is shortened down to less than a millimeter, the thickness of a touch-screen glass, and the power of computing has become accessible to everyone. But I wondered, what if there could be no boundary at all? I started to imagine what this would look like. First, I created this tool which penetrates into the digital space, so when you press it hard on the screen, it transfers its physical body into pixels. Designers can materialize their ideas directly in 3D, and surgeons can practice on virtual organs underneath the screen. So with this tool, this boundary has been broken. But our two hands still remain outside the screen. How can you reach inside and interact with the digital information using the full dexterity of our hands? At Microsoft Applied Sciences, along with my mentor Cati Boulanger, I redesigned the computer and turned a little space above the keyboard into a digital workspace. By combining a transparent display and depth cameras for sensing your fingers and face, now you can lift up your hands from the keyboard and reach inside this 3D space and grab pixels with your bare hands. (Applause) Because windows and files have a position in the real space, selecting them is as easy as grabbing a book off your shelf. Then you can flip through this book while highlighting the lines, words on the virtual touch pad below each floating window. Architects can stretch or rotate the models with their two hands directly. So in these examples, we are reaching into the digital world. But how about reversing its role and having the digital information reach us instead? I'm sure many of us have had the experience of buying and returning items online. But now you don't have to worry about it. What I got here is an online augmented fitting room. This is a view that you get from head-mounted or see-through display when the system understands the geometry of your body. Taking this idea further, I started to think, instead of just seeing these pixels in our space, how can we make it physical so that we can touch and feel it? What would such a future look like? At MIT Media Lab, along with my advisor Hiroshi Ishii and my collaborator Rehmi Post, we created this one physical pixel. Well, in this case, this spherical magnet acts like a 3D pixel in our space, which means that both computers and people can move this object to anywhere within this little 3D space. What we did was essentially canceling gravity and controlling the movement by combining magnetic levitation and mechanical actuation and sensing technologies. And by digitally programming the object, we are liberating the object from constraints of time and space, which means that now, human motions can be recorded and played back and left permanently in the physical world. So choreography can be taught physically over distance and Michael Jordan's famous shooting can be replicated over and over as a physical reality. Students can use this as a tool to learn about the complex concepts such as planetary motion, physics, and unlike computer screens or textbooks, this is a real, tangible experience that you can touch and feel, and it's very powerful. And what's more exciting than just turning what's currently in the computer physical is to start imagining how programming the world will alter even our daily physical activities. (Laughter) As you can see, the digital information will not just show us something but it will start directly acting upon us as a part of our physical surroundings without disconnecting ourselves from our world. Today, we started by talking about the boundary, but if we remove this boundary, the only boundary left is our imagination. Thank you. (Applause)

Frequently Occurring Word Combinations

ngrams of length 2

collocation frequency
digital information 3
physical world 2

Important Words

  1. accessible
  2. acting
  3. activities
  4. acts
  5. actuation
  6. advisor
  7. alter
  8. applause
  9. applied
  10. architects
  11. augmented
  12. bare
  13. body
  14. book
  15. boulanger
  16. boundary
  17. broken
  18. buying
  19. cameras
  20. canceling
  21. case
  22. cati
  23. choreography
  24. collaborator
  25. combining
  26. complex
  27. computer
  28. computers
  29. computing
  30. concepts
  31. constraints
  32. controlling
  33. created
  34. daily
  35. depth
  36. designers
  37. dexterity
  38. digital
  39. digitally
  40. disconnecting
  41. display
  42. distance
  43. easy
  44. essentially
  45. examples
  46. exciting
  47. experience
  48. face
  49. famous
  50. feel
  51. files
  52. fingers
  53. fitting
  54. flip
  55. floating
  56. full
  57. future
  58. gap
  59. geometry
  60. glass
  61. grab
  62. grabbing
  63. gravity
  64. hands
  65. hard
  66. highlighting
  67. hiroshi
  68. history
  69. human
  70. idea
  71. ideas
  72. imagination
  73. imagine
  74. imagining
  75. information
  76. interact
  77. ishii
  78. items
  79. keyboard
  80. lab
  81. laughter
  82. learn
  83. left
  84. levitation
  85. liberating
  86. lift
  87. lines
  88. magnet
  89. magnetic
  90. materialize
  91. means
  92. mechanical
  93. media
  94. mentor
  95. michael
  96. microsoft
  97. millimeter
  98. mit
  99. models
  100. motion
  101. motions
  102. move
  103. movement
  104. object
  105. online
  106. organs
  107. pad
  108. part
  109. penetrates
  110. people
  111. permanently
  112. physical
  113. physically
  114. physics
  115. pixel
  116. pixels
  117. planetary
  118. played
  119. position
  120. post
  121. power
  122. powerful
  123. practice
  124. press
  125. programming
  126. reach
  127. reaching
  128. real
  129. reality
  130. recorded
  131. redesigned
  132. rehmi
  133. remain
  134. remove
  135. replicated
  136. returning
  137. reversing
  138. role
  139. room
  140. rotate
  141. sciences
  142. screen
  143. screens
  144. selecting
  145. sensing
  146. shelf
  147. shooting
  148. shorten
  149. shortened
  150. shorter
  151. show
  152. space
  153. spherical
  154. start
  155. started
  156. stretch
  157. striving
  158. students
  159. surgeons
  160. surroundings
  161. system
  162. talking
  163. tangible
  164. taught
  165. technologies
  166. textbooks
  167. thickness
  168. time
  169. today
  170. tool
  171. touch
  172. transfers
  173. transparent
  174. turned
  175. turning
  176. understands
  177. view
  178. virtual
  179. wild
  180. window
  181. windows
  182. wondered
  183. words
  184. workspace
  185. world
  186. worry