Mercurial > cortex
comparison thesis/cortex.org @ 540:def6f62831df
misc fixes.
author | Robert McIntyre <rlm@mit.edu> |
---|---|
date | Sun, 27 Apr 2014 21:57:05 -0400 |
parents | fc116e960f56 |
children | d947636fe0ee |
comparison
equal
deleted
inserted
replaced
539:fc116e960f56 | 540:def6f62831df |
---|---|
3389 further research projects. To this end I have included the full | 3389 further research projects. To this end I have included the full |
3390 source to =CORTEX= along with a large suite of tests and examples. I | 3390 source to =CORTEX= along with a large suite of tests and examples. I |
3391 have also created a user guide for =CORTEX= which is included in an | 3391 have also created a user guide for =CORTEX= which is included in an |
3392 appendix to this thesis. | 3392 appendix to this thesis. |
3393 | 3393 |
3394 You have also seen how I used =CORTEX= as a platform to attach the | 3394 You have also seen how I used =CORTEX= as a platform to attack the |
3395 /action recognition/ problem, which is the problem of recognizing | 3395 /action recognition/ problem, which is the problem of recognizing |
3396 actions in video. You saw a simple system called =EMPATH= which | 3396 actions in video. You saw a simple system called =EMPATH= which |
3397 identifies actions by first describing actions in a body-centered, | 3397 identifies actions by first describing actions in a body-centered, |
3398 rich sense language, then inferring a full range of sensory | 3398 rich sense language, then inferring a full range of sensory |
3399 experience from limited data using previous experience gained from | 3399 experience from limited data using previous experience gained from |
3412 | 3412 |
3413 - =EMPATH=, which uses =CORTEX= to identify the actions of a | 3413 - =EMPATH=, which uses =CORTEX= to identify the actions of a |
3414 worm-like creature using a computational model of empathy. | 3414 worm-like creature using a computational model of empathy. |
3415 | 3415 |
3416 #+BEGIN_LaTeX | 3416 #+BEGIN_LaTeX |
3417 \newpage | |
3417 \appendix | 3418 \appendix |
3418 #+END_LaTeX | 3419 #+END_LaTeX |
3419 | |
3420 \newpage | |
3421 | 3420 |
3422 * COMMENT Appendix: =CORTEX= User Guide | 3421 * COMMENT Appendix: =CORTEX= User Guide |
3423 | 3422 |
3424 Those who write a thesis should endeavor to make their code not only | 3423 Those who write a thesis should endeavor to make their code not only |
3425 accessible, but actually usable, as a way to pay back the community | 3424 accessible, but actually usable, as a way to pay back the community |
3471 | 3470 |
3472 Joint nodes should have the following metadata under the ``joint'' | 3471 Joint nodes should have the following metadata under the ``joint'' |
3473 label: | 3472 label: |
3474 | 3473 |
3475 #+BEGIN_SRC clojure | 3474 #+BEGIN_SRC clojure |
3476 ;; ONE OF the following, under the label "joint": | 3475 ;; ONE of the following, under the label "joint": |
3477 {:type :point} | 3476 {:type :point} |
3478 | 3477 |
3479 ;; OR | 3478 ;; OR |
3480 | 3479 |
3481 {:type :hinge | 3480 {:type :hinge |
3678 | 3677 |
3679 - =(sphere radius & {options})= :: create a sphere in the simulation. | 3678 - =(sphere radius & {options})= :: create a sphere in the simulation. |
3680 Options are the same as in =box=. | 3679 Options are the same as in =box=. |
3681 | 3680 |
3682 - =(load-blender-model file-name)= :: create a node structure | 3681 - =(load-blender-model file-name)= :: create a node structure |
3683 representing that described in a blender file. | 3682 representing the model described in a blender file. |
3684 | 3683 |
3685 - =(light-up-everything world)= :: distribute a standard compliment | 3684 - =(light-up-everything world)= :: distribute a standard compliment |
3686 of lights throughout the simulation. Should be adequate for most | 3685 of lights throughout the simulation. Should be adequate for most |
3687 purposes. | 3686 purposes. |
3688 | 3687 |
3700 | 3699 |
3701 - =(asset-manager)= :: get an /AssetManager/, a jMonkeyEngine | 3700 - =(asset-manager)= :: get an /AssetManager/, a jMonkeyEngine |
3702 construct that is useful for loading textures and is required | 3701 construct that is useful for loading textures and is required |
3703 for smooth interaction with jMonkeyEngine library functions. | 3702 for smooth interaction with jMonkeyEngine library functions. |
3704 | 3703 |
3705 - =(load-bullet)= :: unpack native libraries and initialize | 3704 - =(load-bullet)= :: unpack native libraries and initialize the |
3706 blender. This function is required before other world building | 3705 bullet physics subsystem. This function is required before |
3707 functions are called. | 3706 other world building functions are called. |
3708 | 3707 |
3709 *** Creature Manipulation / Import | 3708 *** Creature Manipulation / Import |
3710 | 3709 |
3711 - =(body! creature)= :: give the creature a physical body. | 3710 - =(body! creature)= :: give the creature a physical body. |
3712 | 3711 |
3723 - =(hearing! creature)= :: give the creature a sense of hearing. | 3722 - =(hearing! creature)= :: give the creature a sense of hearing. |
3724 Returns a list of functions, one for each ear, that when | 3723 Returns a list of functions, one for each ear, that when |
3725 called will return a frame's worth of hearing data for that | 3724 called will return a frame's worth of hearing data for that |
3726 ear. The functions are ordered depending on the alphabetical | 3725 ear. The functions are ordered depending on the alphabetical |
3727 order of the names of the ear nodes in the blender file. The | 3726 order of the names of the ear nodes in the blender file. The |
3728 data returned by the functions is an array PCM encoded wav | 3727 data returned by the functions is an array of PCM (pulse code |
3729 data. | 3728 modulated) wav data. |
3730 | 3729 |
3731 - =(touch! creature)= :: give the creature a sense of touch. Returns | 3730 - =(touch! creature)= :: give the creature a sense of touch. Returns |
3732 a single function that must be called with the /root node/ of | 3731 a single function that must be called with the /root node/ of |
3733 the world, and which will return a vector of /touch-data/ | 3732 the world, and which will return a vector of /touch-data/ |
3734 one entry for each touch sensitive component, each entry of | 3733 one entry for each touch sensitive component, each entry of |
3759 - =(view-touch)= :: same as =view-vision= but for touch. | 3758 - =(view-touch)= :: same as =view-vision= but for touch. |
3760 | 3759 |
3761 - =(view-proprioception)= :: same as =view-vision= but for | 3760 - =(view-proprioception)= :: same as =view-vision= but for |
3762 proprioception. | 3761 proprioception. |
3763 | 3762 |
3764 - =(view-movement)= :: same as =view-vision= but for | 3763 - =(view-movement)= :: same as =view-vision= but for muscles. |
3765 proprioception. | |
3766 | 3764 |
3767 - =(view anything)= :: =view= is a polymorphic function that allows | 3765 - =(view anything)= :: =view= is a polymorphic function that allows |
3768 you to inspect almost anything you could reasonably expect to | 3766 you to inspect almost anything you could reasonably expect to |
3769 be able to ``see'' in =CORTEX=. | 3767 be able to ``see'' in =CORTEX=. |
3770 | 3768 |