* Brainstorming different sensors and effectors.

 

 Every sense that we have should have an effector that changes what

 that sense (or others who have that sense) experiences.

 

 ** Classic Senses

 | Sense                        | Effector                        |

 |------------------------------+---------------------------------|

 | Vision                       | Variable Coloration             |

 | Hearing                      | Speech                          |

 | Proprioception               | Movement                        |

 | Smell/Taste (Chemoreception) | Pheromones                      |

 | Touch                        | Movement / Controllable Texture |

 | Acceleration                 | Movement                        |

 | Balance (sense gravity)      | Movement                        |

 

 - New Senses/Effectors

 - Levitation

 - Telekinesis

 - control of gravity within a certain radius

 - speed up/slow time

 - object creation/destruction

 - future-sight -- step the simulation forward a few ticks, gather

   sensory data, then supply this data for the creature as one of its

   actual senses.

 

 - Symbol Sense

    Where objects in the world can be queried for description /

    symbols.

 

 - Symbol Marking

    The ability to mark objects in the world with your own descriptions

    and symbols.

 

 - Vision 

   Distinguish the polarization of light

   Color

   Movement

 

 * project ideas

  - HACKER for writing muscle-control programs : Presented with

    low-level muscle control/ sense API, generate higher level programs

    for accomplishing various stated goals. Example goals might be

    "extend all your fingers" or "move your hand into the area with

    blue light" or "decrease the angle of this joint".  It would be

    like Sussman's HACKER, except it would operate with much more data

    in a more realistic world.  Start off with "calisthenics" to

    develop subroutines over the motor control API.  This would be the

    "spinal chord" of a more intelligent creature.  The low level

    programming code might be a turning machine that could develop

    programs to iterate over a "tape" where each entry in the tape

    could control recruitment of the fibers in a muscle.

  - Make a virtual computer in the virtual world which with which the

    creature interacts using its fingers to press keys on a virtual

    keyboard.  The creature can access the internet, watch videos, take

    over the world, anything it wants.

  - Make virtual instruments like pianos, drums, etc that it learns to

    play.

  - make a joint that figures out what type of joint it is (range of

    motion)

 

    

 

 

 

 * goals

 

 ** have to get done before Winston

  - [X] write an explanation for why greyscale bitmaps for senses is

        appropriate -- 1/2 day

  - [X] muscle control -- day

  - [X] proprioception sensor map in the style of the other senses -- day

  - [X] refactor integration code to distribute to each of the senses

        -- day

  - [X] create video showing all the senses for Winston -- 2 days

  - [X] spell checking !!!!!

  - [X] send package to friends for critiques -- 2 days

  - [X] fix videos that were encoded wrong, test on Internet Explorer.

  - [X] redo videos vision with new collapse code

  - [X] find a topology that looks good. (maybe nil topology?)

  - [X] fix red part of touch cube in video and image

  - [X] write summary of project for Winston            \

  - [X] project proposals for Winston                    \

  - [X] additional senses to be implemented for Winston   |  -- 2 days 

  - [X] send Winston package                             /

 

 ** would be cool to get done before Winston

  - [X] enable greyscale bitmaps for touch -- 2 hours 

  - [X] use sawfish to auto-tile sense windows -- 6 hours

  - [X] sawfish keybinding to automatically delete all sense windows

  - [ ] proof of concept C sense manipulation  -- 2 days 

  - [ ] proof of concept GPU sense manipulation -- week

  - [ ] Fourier view of sound -- 2 or 3 days 

  - [ ] dancing music listener -- 1 day, depends on Fourier

  - [ ] uberjar cortex demo

 

 ** don't have to get done before winston

  - [X] write tests for integration -- 3 days

  - [X] usertime/gametime clock HUD display -- day 

  - [ ] find papers for each of the senses justifying my own

        representation -- week

  - [X] show sensor maps in HUD display? -- 4 days

  - [X] show sensor maps in AWT display? -- 2 days

  - [X] upgrade to clojure 1.3, replace all defvars with new def

  - [ ] common video creation code.

 

 * jMonkeyEngine ideas

  - [ ] video showing bullet joints problem

  - [ ] add mult for Matrix to Ray

  - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,

    Matrix3f, Matrix4f, etc

 

 ;;In the elder days of Art,

 ;;Builders wrought with greatest care

 ;;Each minute and unseen part;

 ;;For the Gods see everywhere.

 

 

 * misc

   - use object tracking on moving objects to derive good static

     detectors and achieve background separation

   - temporal scale pyramids.  this can help in verb recognition by

     making verb identification time-scale independent (up to a certian

     factor)