comparison thesis/cortex.org @ 553:20f64a70f8c5

saving image and caption mods suggested by winston.
author Robert McIntyre <rlm@mit.edu>
date Fri, 02 May 2014 14:08:09 -0400
parents d304b2ea7c58
children 663e3d4f98c1
comparison
equal deleted inserted replaced
552:20e0ec94b35c 553:20f64a70f8c5
2417 [[./images/hand-with-all-senses3.png]] 2417 [[./images/hand-with-all-senses3.png]]
2418 2418
2419 With the hand fully rigged with senses, I can run it though a test 2419 With the hand fully rigged with senses, I can run it though a test
2420 that will test everything. 2420 that will test everything.
2421 2421
2422 #+caption: A full test of the hand with all senses. Note especially 2422 #+caption: Selected frames from a full test of the hand with all
2423 #+caption: the interactions the hand has with itself: it feels 2423 #+caption: senses. Note especially the interactions the hand has
2424 #+caption: its own palm and fingers, and when it curls its fingers, 2424 #+caption: with itself: it feels its own palm and fingers, and when
2425 #+caption: it sees them with its eye (which is located in the center 2425 #+caption: it curls its fingers, it sees them with its eye (which
2426 #+caption: of the palm. The red block appears with a pure tone sound. 2426 #+caption: is located in the center of the palm. The red block
2427 #+caption: The hand then uses its muscles to launch the cube! 2427 #+caption: appears with a pure tone sound. The hand then uses its
2428 #+caption: muscles to launch the cube!
2428 #+name: integration 2429 #+name: integration
2429 #+ATTR_LaTeX: :width 16cm 2430 #+ATTR_LaTeX: :width 15cm
2430 [[./images/integration.png]] 2431 [[./images/integration.png]]
2431 2432
2432 ** =CORTEX= enables many possibilities for further research 2433 ** =CORTEX= enables many possibilities for further research
2433 2434
2434 Often times, the hardest part of building a system involving 2435 Often times, the hardest part of building a system involving
3129 difference : the only sensory information available to the system 3130 difference : the only sensory information available to the system
3130 is proprioception. From just the proprioception data and 3131 is proprioception. From just the proprioception data and
3131 \Phi-space, =longest-thread= synthesizes a complete record the last 3132 \Phi-space, =longest-thread= synthesizes a complete record the last
3132 300 sensory experiences of the worm. These synthesized experiences 3133 300 sensory experiences of the worm. These synthesized experiences
3133 are fed directly into the action predicates =grand-circle?=, 3134 are fed directly into the action predicates =grand-circle?=,
3134 =curled?=, =wiggling?=, and =resting?= from before and their output 3135 =curled?=, =wiggling?=, and =resting?= and their outputs are
3135 is printed to the screen at each frame. 3136 printed to the screen at each frame.
3136 3137
3137 The result of running =empathy-experiment= is that the system is 3138 The result of running =empathy-experiment= is that the system is
3138 generally able to interpret worm actions using the action-predicates 3139 generally able to interpret worm actions using the action-predicates
3139 on simulated sensory data just as well as with actual data. Figure 3140 on simulated sensory data just as well as with actual data. Figure
3140 \ref{empathy-debug-image} was generated using =empathy-experiment=: 3141 \ref{empathy-debug-image} was generated using =empathy-experiment=:
3432 (count) (= 1)) 3433 (count) (= 1))
3433 (< 0.03 total-contact)))) 3434 (< 0.03 total-contact))))
3434 #+end_src 3435 #+end_src
3435 #+end_listing 3436 #+end_listing
3436 3437
3437 #+caption: The =draped?= predicate detects the presence of the 3438 #+caption: The =draped?= predicate detects the presence of the cube
3438 #+caption: cube whenever the worm interacts with it. The details of the 3439 #+caption: whenever the worm interacts with it. The details of the
3439 #+caption: cube are irrelevant; only the way it influences the worm's 3440 #+caption: cube are irrelevant; only the way it influences the
3440 #+caption: body matters. 3441 #+caption: worm's body matters. The ``unknown'' label on the fifth
3442 #+caption: frame is due to the fact that the worm is not
3443 #+caption: stationairy. =draped?= will only declare that the worm
3444 #+caption: is draped if it has been still for a while.
3441 #+name: draped-video 3445 #+name: draped-video
3442 #+ATTR_LaTeX: :width 13cm 3446 #+ATTR_LaTeX: :width 13cm
3443 [[./images/draped.png]] 3447 [[./images/draped.png]]
3444 3448
3445 Though this is a simple example, using the =draped?= predicate to 3449 Though this is a simple example, using the =draped?= predicate to
3454 mimic the appearance of leaning on a cube. The system will 3458 mimic the appearance of leaning on a cube. The system will
3455 anticipate that there is an actual invisible cube that provides 3459 anticipate that there is an actual invisible cube that provides
3456 support! 3460 support!
3457 3461
3458 #+caption: Can you see the thing that this person is leaning on? 3462 #+caption: Can you see the thing that this person is leaning on?
3459 #+caption: What properties does it have, other than how it makes the man's 3463 #+caption: What properties does it have, other than how it makes
3460 #+caption: elbow and shoulder feel? I wonder if people who can actually 3464 #+caption: the man's elbow and shoulder feel? I wonder if people
3461 #+caption: maintain this pose easily still see the support? 3465 #+caption: who can actually maintain this pose easily still see the
3466 #+caption: support?
3462 #+name: mime 3467 #+name: mime
3463 #+ATTR_LaTeX: :width 6cm 3468 #+ATTR_LaTeX: :width 6cm
3464 [[./images/pablo-the-mime.png]] 3469 [[./images/pablo-the-mime.png]]
3465 3470
3466 This makes me wonder about the psychology of actual mimes. Suppose 3471 This makes me wonder about the psychology of actual mimes. Suppose
3700 3705
3701 #+caption: The fingertip UV-image form above applied to a simple 3706 #+caption: The fingertip UV-image form above applied to a simple
3702 #+caption: model of a fingertip. 3707 #+caption: model of a fingertip.
3703 #+name: guide-fingertip 3708 #+name: guide-fingertip
3704 #+ATTR_LaTeX: :width 9cm :placement [H] 3709 #+ATTR_LaTeX: :width 9cm :placement [H]
3705 [[./images/finger-2.png]] 3710 [[./images/finger-1.png]]
3706 3711
3707 *** Proprioception 3712 *** Proprioception
3708 3713
3709 Proprioception is tied to each joint node -- nothing special must 3714 Proprioception is tied to each joint node -- nothing special must
3710 be done in a blender model to enable proprioception other than 3715 be done in a blender model to enable proprioception other than