Mercurial > cortex

     1 

     2 

     3 * Brainstorming different sensors and effectors.

     4 

     5 Every sense that we have should have an effector that changes what

     6 that sense (or others who have that sense) experiences.

     7 

     8 ** Classic Senses

     9 | Sense                        | Effector                        |

    10 |------------------------------+---------------------------------|

    11 | Vision                       | Variable Coloration             |

    12 | Hearing                      | Speech                          |

    13 | Proprioception               | Movement                        |

    14 | Smell/Taste (Chemoreception) | Pheromones                      |

    15 | Touch                        | Movement / Controllable Texture |

    16 | Acceleration                 | Movement                        |

    17 | Balance (sense gravity)      | Movement                        |

    18 

    19 - New Senses/Effectors

    20 - Levitation

    21 - Telekinesis

    22 - control of gravity within a certain radius

    23 - speed up/slow time

    24 - object creation/destruction

    25 - prescience -- step the simulation forward a few ticks, gather

    26   sensory data, then supply this data for the creature as one of its

    27   actual senses.

    28 

    29 - Symbol Sense

    30    Objects in the world can be queried for description /

    31    symbols.

    32 

    33 - Symbol Marking

    34    The ability to mark objects in the world with your own descriptions

    35    and symbols.

    36 

    37 - Vision 

    38   Distinguish the polarization of light

    39   Color

    40   Movement

    41 

    42 * project ideas

    43  - HACKER for writing muscle-control programs : Presented with

    44    low-level muscle control/ sense API, generate higher level programs

    45    for accomplishing various stated goals. Example goals might be

    46    "extend all your fingers" or "move your hand into the area with

    47    blue light" or "decrease the angle of this joint".  It would be

    48    like Sussman's HACKER, except it would operate with much more data

    49    in a more realistic world.  Start off with "calisthenics" to

    50    develop subroutines over the motor control API.  This would be the

    51    "spinal chord" of a more intelligent creature.  The low level

    52    programming code might be a turning machine that could develop

    53    programs to iterate over a "tape" where each entry in the tape

    54    could control recruitment of the fibers in a muscle.

    55  - Make a virtual computer in the virtual world which with which the

    56    creature interacts using its fingers to press keys on a virtual

    57    keyboard.  The creature can access the internet, watch videos, take

    58    over the world, anything it wants.

    59  - Make virtual instruments like pianos, drums, etc that it learns to

    60    play.

    61  - make a joint that figures out what type of joint it is (range of

    62    motion)

    63 

    64 * goals

    65 

    66 ** have to get done before Winston

    67  - [X] write an explanation for why greyscale bitmaps for senses is

    68        appropriate -- 1/2 day

    69  - [X] muscle control -- day

    70  - [X] proprioception sensor map in the style of the other senses -- day

    71  - [X] refactor integration code to distribute to each of the senses

    72        -- day

    73  - [X] create video showing all the senses for Winston -- 2 days

    74  - [X] spell checking !!!!!

    75  - [X] send package to friends for critiques -- 2 days

    76  - [X] fix videos that were encoded wrong, test on Internet Explorer.

    77  - [X] redo videos vision with new collapse code

    78  - [X] find a topology that looks good. (maybe nil topology?)

    79  - [X] fix red part of touch cube in video and image

    80  - [X] write summary of project for Winston            \

    81  - [X] project proposals for Winston                    \

    82  - [X] additional senses to be implemented for Winston   |  -- 2 days 

    83  - [X] send Winston package                             /

    84 

    85 ** would be cool to get done before Winston

    86  - [X] enable greyscale bitmaps for touch -- 2 hours 

    87  - [X] use sawfish to auto-tile sense windows -- 6 hours

    88  - [X] sawfish keybinding to automatically delete all sense windows

    89  - [ ] proof of concept C sense manipulation  -- 2 days 

    90  - [ ] proof of concept GPU sense manipulation -- week

    91  - [ ] Fourier view of sound -- 2 or 3 days 

    92  - [ ] dancing music listener -- 1 day, depends on Fourier

    93  - [ ] uberjar cortex demo

    94 

    95 ** don't have to get done before winston

    96  - [X] write tests for integration -- 3 days

    97  - [X] usertime/gametime clock HUD display -- day 

    98  - [X] show sensor maps in HUD display? -- 4 days

    99  - [X] show sensor maps in AWT display? -- 2 days

   100  - [X] upgrade to clojure 1.3, replace all defvars with new def

   101  - [ ] common video creation code.

   102 

   103 * jMonkeyEngine ideas

   104  - [ ] video showing bullet joints problem

   105  - [ ] add mult for Matrix to Ray

   106  - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,

   107    Matrix3f, Matrix4f, etc

   108 

   109 ;;In the elder days of Art,

   110 ;;Builders wrought with greatest care

   111 ;;Each minute and unseen part;

   112 ;;For the Gods see everywhere.

   113 

   114 * misc

   115   - use object tracking on moving objects to derive good static

   116     detectors and achieve background separation

   117   - temporal scale pyramids.  this can help in verb recognition by

   118     making verb identification time-scale independent (up to a certian

   119     factor)
author	Robert McIntyre <rlm@mit.edu>
date	Mon, 17 Mar 2014 17:29:59 -0400
parents	30376c1c67c1
children	763d13f77e03