Mercurial > cortex

     1 * Brainstorming different sensors and effectors.

     2 

     3 Every sense that we have should have an effector that changes what

     4 that sense (or others who have that sense) experiences.

     5 

     6 ** Classic Senses

     7 | Sense                        | Effector                        |

     8 |------------------------------+---------------------------------|

     9 | Vision                       | Variable Coloration             |

    10 | Hearing                      | Speech                          |

    11 | Proprioception               | Movement                        |

    12 | Smell/Taste (Chemoreception) | Pheromones                      |

    13 | Touch                        | Movement / Controllable Texture |

    14 | Acceleration                 | Movement                        |

    15 | Balance (sense gravity)      | Movement                        |

    16 

    17 - New Senses/Effectors

    18 - Levitation

    19 - Telekinesis

    20 - control of gravity within a certain radius

    21 - speed up/slow time

    22 - object creation/destruction

    23 - future-sight -- step the simulation forward a few ticks, gather

    24   sensory data, then supply this data for the creature as one of its

    25   actual senses.

    26 

    27 - Symbol Sense

    28    Where objects in the world can be queried for description /

    29    symbols.

    30 

    31 - Symbol Marking

    32    The ability to mark objects in the world with your own descriptions

    33    and symbols.

    34 

    35 - Vision 

    36   Distinguish the polarization of light

    37   Color

    38   Movement

    39 

    40 * project ideas

    41  - HACKER for writing muscle-control programs : Presented with

    42    low-level muscle control/ sense API, generate higher level programs

    43    for accomplishing various stated goals. Example goals might be

    44    "extend all your fingers" or "move your hand into the area with

    45    blue light" or "decrease the angle of this joint".  It would be

    46    like Sussman's HACKER, except it would operate with much more data

    47    in a more realistic world.  Start off with "calisthenics" to

    48    develop subroutines over the motor control API.  This would be the

    49    "spinal chord" of a more intelligent creature.  The low level

    50    programming code might be a turning machine that could develop

    51    programs to iterate over a "tape" where each entry in the tape

    52    could control recruitment of the fibers in a muscle.

    53  - Make a virtual computer in the virtual world which with which the

    54    creature interacts using its fingers to press keys on a virtual

    55    keyboard.  The creature can access the internet, watch videos, take

    56    over the world, anything it wants.

    57  - Make virtual instruments like pianos, drums, etc that it learns to

    58    play.

    59  - make a joint that figures out what type of joint it is (range of

    60    motion)

    61 

    62    

    63 

    64 

    65 

    66 * goals

    67 

    68 ** have to get done before Winston

    69  - [X] write an explanation for why greyscale bitmaps for senses is

    70        appropriate -- 1/2 day

    71  - [X] muscle control -- day

    72  - [X] proprioception sensor map in the style of the other senses -- day

    73  - [X] refactor integration code to distribute to each of the senses

    74        -- day

    75  - [X] create video showing all the senses for Winston -- 2 days

    76  - [X] spell checking !!!!!

    77  - [X] send package to friends for critiques -- 2 days

    78  - [X] fix videos that were encoded wrong, test on Internet Explorer.

    79  - [X] redo videos vision with new collapse code

    80  - [X] find a topology that looks good. (maybe nil topology?)

    81  - [X] fix red part of touch cube in video and image

    82  - [X] write summary of project for Winston            \

    83  - [X] project proposals for Winston                    \

    84  - [X] additional senses to be implemented for Winston   |  -- 2 days 

    85  - [X] send Winston package                             /

    86 

    87 ** would be cool to get done before Winston

    88  - [X] enable greyscale bitmaps for touch -- 2 hours 

    89  - [X] use sawfish to auto-tile sense windows -- 6 hours

    90  - [X] sawfish keybinding to automatically delete all sense windows

    91  - [ ] proof of concept C sense manipulation  -- 2 days 

    92  - [ ] proof of concept GPU sense manipulation -- week

    93  - [ ] Fourier view of sound -- 2 or 3 days 

    94  - [ ] dancing music listener -- 1 day, depends on Fourier

    95  - [ ] uberjar cortex demo

    96 

    97 ** don't have to get done before winston

    98  - [X] write tests for integration -- 3 days

    99  - [X] usertime/gametime clock HUD display -- day 

   100  - [ ] find papers for each of the senses justifying my own

   101        representation -- week

   102  - [X] show sensor maps in HUD display? -- 4 days

   103  - [X] show sensor maps in AWT display? -- 2 days

   104  - [X] upgrade to clojure 1.3, replace all defvars with new def

   105  - [ ] common video creation code.

   106 

   107 * jMonkeyEngine ideas

   108  - [ ] video showing bullet joints problem

   109  - [ ] add mult for Matrix to Ray

   110  - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,

   111    Matrix3f, Matrix4f, etc

   112 

   113 ;;In the elder days of Art,

   114 ;;Builders wrought with greatest care

   115 ;;Each minute and unseen part;

   116 ;;For the Gods see everywhere.
author	Robert McIntyre <rlm@mit.edu>
date	Thu, 19 Jul 2012 11:12:26 -0500
parents	b6e2b65f43e4
children	e6233ef22a80