Mercurial > cortex
comparison thesis/cortex.org @ 553:20f64a70f8c5
saving image and caption mods suggested by winston.
author | Robert McIntyre <rlm@mit.edu> |
---|---|
date | Fri, 02 May 2014 14:08:09 -0400 |
parents | d304b2ea7c58 |
children | 663e3d4f98c1 |
comparison
equal
deleted
inserted
replaced
552:20e0ec94b35c | 553:20f64a70f8c5 |
---|---|
2417 [[./images/hand-with-all-senses3.png]] | 2417 [[./images/hand-with-all-senses3.png]] |
2418 | 2418 |
2419 With the hand fully rigged with senses, I can run it though a test | 2419 With the hand fully rigged with senses, I can run it though a test |
2420 that will test everything. | 2420 that will test everything. |
2421 | 2421 |
2422 #+caption: A full test of the hand with all senses. Note especially | 2422 #+caption: Selected frames from a full test of the hand with all |
2423 #+caption: the interactions the hand has with itself: it feels | 2423 #+caption: senses. Note especially the interactions the hand has |
2424 #+caption: its own palm and fingers, and when it curls its fingers, | 2424 #+caption: with itself: it feels its own palm and fingers, and when |
2425 #+caption: it sees them with its eye (which is located in the center | 2425 #+caption: it curls its fingers, it sees them with its eye (which |
2426 #+caption: of the palm. The red block appears with a pure tone sound. | 2426 #+caption: is located in the center of the palm. The red block |
2427 #+caption: The hand then uses its muscles to launch the cube! | 2427 #+caption: appears with a pure tone sound. The hand then uses its |
2428 #+caption: muscles to launch the cube! | |
2428 #+name: integration | 2429 #+name: integration |
2429 #+ATTR_LaTeX: :width 16cm | 2430 #+ATTR_LaTeX: :width 15cm |
2430 [[./images/integration.png]] | 2431 [[./images/integration.png]] |
2431 | 2432 |
2432 ** =CORTEX= enables many possibilities for further research | 2433 ** =CORTEX= enables many possibilities for further research |
2433 | 2434 |
2434 Often times, the hardest part of building a system involving | 2435 Often times, the hardest part of building a system involving |
3129 difference : the only sensory information available to the system | 3130 difference : the only sensory information available to the system |
3130 is proprioception. From just the proprioception data and | 3131 is proprioception. From just the proprioception data and |
3131 \Phi-space, =longest-thread= synthesizes a complete record the last | 3132 \Phi-space, =longest-thread= synthesizes a complete record the last |
3132 300 sensory experiences of the worm. These synthesized experiences | 3133 300 sensory experiences of the worm. These synthesized experiences |
3133 are fed directly into the action predicates =grand-circle?=, | 3134 are fed directly into the action predicates =grand-circle?=, |
3134 =curled?=, =wiggling?=, and =resting?= from before and their output | 3135 =curled?=, =wiggling?=, and =resting?= and their outputs are |
3135 is printed to the screen at each frame. | 3136 printed to the screen at each frame. |
3136 | 3137 |
3137 The result of running =empathy-experiment= is that the system is | 3138 The result of running =empathy-experiment= is that the system is |
3138 generally able to interpret worm actions using the action-predicates | 3139 generally able to interpret worm actions using the action-predicates |
3139 on simulated sensory data just as well as with actual data. Figure | 3140 on simulated sensory data just as well as with actual data. Figure |
3140 \ref{empathy-debug-image} was generated using =empathy-experiment=: | 3141 \ref{empathy-debug-image} was generated using =empathy-experiment=: |
3432 (count) (= 1)) | 3433 (count) (= 1)) |
3433 (< 0.03 total-contact)))) | 3434 (< 0.03 total-contact)))) |
3434 #+end_src | 3435 #+end_src |
3435 #+end_listing | 3436 #+end_listing |
3436 | 3437 |
3437 #+caption: The =draped?= predicate detects the presence of the | 3438 #+caption: The =draped?= predicate detects the presence of the cube |
3438 #+caption: cube whenever the worm interacts with it. The details of the | 3439 #+caption: whenever the worm interacts with it. The details of the |
3439 #+caption: cube are irrelevant; only the way it influences the worm's | 3440 #+caption: cube are irrelevant; only the way it influences the |
3440 #+caption: body matters. | 3441 #+caption: worm's body matters. The ``unknown'' label on the fifth |
3442 #+caption: frame is due to the fact that the worm is not | |
3443 #+caption: stationairy. =draped?= will only declare that the worm | |
3444 #+caption: is draped if it has been still for a while. | |
3441 #+name: draped-video | 3445 #+name: draped-video |
3442 #+ATTR_LaTeX: :width 13cm | 3446 #+ATTR_LaTeX: :width 13cm |
3443 [[./images/draped.png]] | 3447 [[./images/draped.png]] |
3444 | 3448 |
3445 Though this is a simple example, using the =draped?= predicate to | 3449 Though this is a simple example, using the =draped?= predicate to |
3454 mimic the appearance of leaning on a cube. The system will | 3458 mimic the appearance of leaning on a cube. The system will |
3455 anticipate that there is an actual invisible cube that provides | 3459 anticipate that there is an actual invisible cube that provides |
3456 support! | 3460 support! |
3457 | 3461 |
3458 #+caption: Can you see the thing that this person is leaning on? | 3462 #+caption: Can you see the thing that this person is leaning on? |
3459 #+caption: What properties does it have, other than how it makes the man's | 3463 #+caption: What properties does it have, other than how it makes |
3460 #+caption: elbow and shoulder feel? I wonder if people who can actually | 3464 #+caption: the man's elbow and shoulder feel? I wonder if people |
3461 #+caption: maintain this pose easily still see the support? | 3465 #+caption: who can actually maintain this pose easily still see the |
3466 #+caption: support? | |
3462 #+name: mime | 3467 #+name: mime |
3463 #+ATTR_LaTeX: :width 6cm | 3468 #+ATTR_LaTeX: :width 6cm |
3464 [[./images/pablo-the-mime.png]] | 3469 [[./images/pablo-the-mime.png]] |
3465 | 3470 |
3466 This makes me wonder about the psychology of actual mimes. Suppose | 3471 This makes me wonder about the psychology of actual mimes. Suppose |
3700 | 3705 |
3701 #+caption: The fingertip UV-image form above applied to a simple | 3706 #+caption: The fingertip UV-image form above applied to a simple |
3702 #+caption: model of a fingertip. | 3707 #+caption: model of a fingertip. |
3703 #+name: guide-fingertip | 3708 #+name: guide-fingertip |
3704 #+ATTR_LaTeX: :width 9cm :placement [H] | 3709 #+ATTR_LaTeX: :width 9cm :placement [H] |
3705 [[./images/finger-2.png]] | 3710 [[./images/finger-1.png]] |
3706 | 3711 |
3707 *** Proprioception | 3712 *** Proprioception |
3708 | 3713 |
3709 Proprioception is tied to each joint node -- nothing special must | 3714 Proprioception is tied to each joint node -- nothing special must |
3710 be done in a blender model to enable proprioception other than | 3715 be done in a blender model to enable proprioception other than |