Mercurial > cortex

     1 * Brainstorming different sensors and effectors.

     2 

     3 Every sense that we have should have an effector that changes what

     4 that sense (or others who have that sense) experiences.

     5 

     6 ** Classic Senses

     7 | Sense                        | Effector                        |

     8 |------------------------------+---------------------------------|

     9 | Vision                       | Variable Coloration             |

    10 | Hearing                      | Speech                          |

    11 | Proprioception               | Movement                        |

    12 | Smell/Taste (Chemoreception) | Pheremones                      |

    13 | Touch                        | Movement / Controllable Texture |

    14 | Acceleration                 | Movement                        |

    15 | Balance (sense gravity)      | Movement                        |

    16 |                              |                                 |

    17 

    18 - New Senses/Effectors

    19 - Levitation

    20 - Telekenesis

    21 - control of gravity within a certain radius

    22 - speed up/slow time

    23 - object creation/destruction

    24 

    25 - Symbol Sense

    26    Where objects in the world can be queried for description /

    27    symbols.

    28 

    29 - Symbol Marking

    30    The ability to mark objects in the world with your own descriptions

    31    and symbols.

    32 

    33 - Vision 

    34   Distinguish the polarization of light

    35   Color

    36   Movement

    37 

    38 * project ideas

    39  - HACKER for writing muscle-control programs : Presented with

    40    low-level muscle control/ sense API, generate higher level programs

    41    for accomplishing various stated goals. Example goals might be

    42    "extend all your fingers" or "move your hand into the area with

    43    blue light" or "decrease the angle of this joint".  It would be

    44    like Sussman's HACKER, except it would operate with much more data

    45    in a more realistic world.  Start off with "calestanthics" to

    46    develop subrouitines over the motor control API.  This would be the

    47    "spinal chord" of a more intelligent creature.  The low level

    48    programming code might be a turning machine that could develop

    49    programs to iterate over a "tape" where each entry in the tape

    50    could control recruitment of the fibers in a muscle.

    51  - Make a virtual computer in the virtual world which with which the

    52    creature interacts using its fingers to press keys on a virtual

    53    keyboard.  The creature can access the internet, watch videos, take

    54    over the world, anything it wants.

    55  - Make virtual insturments like pianos, drumbs, etc that it learns to

    56    play.

    57  - make a joint that figures out what type of joint it is (range of

    58    motion)

    59 

    60    

    61 

    62 

    63 

    64 * goals

    65 

    66 ** have to get done before winston

    67  - [ ] write an explination for why greyscale bitmaps for senses is

    68        appropiate -- 1/2 day

    69  - [X] muscle control -- day

    70  - [X] proprioception sensor map in the style of the other senses -- day

    71  - [ ] refactor integration code to distribute to each of the senses

    72        -- day

    73  - [ ] create video showing all the senses for Winston -- 2 days

    74  - [ ] send package to friends for critiques -- 2 days

    75  - [ ] write summary of project for Winston            \

    76  - [ ] project proposals for Winston                    \

    77  - [ ] additional senses to be implemented for Winston   |  -- 2 days 

    78  - [ ] send Winston package                             /

    79 

    80 ** would be cool to get done before winston

    81  - [X] enable greyscale bitmaps for touch -- 2 hours 

    82  - [X] use sawfish to auto-tile sense windows -- 6 hours

    83  - [X] sawfish keybinding to automatically delete all sense windows

    84  - [ ] directly change the UV-pixels to show sensor activation -- 2

    85        days

    86  - [ ] proof of concept C sense manipulation  -- 2 days 

    87  - [ ] proof of concept GPU sense manipulation -- week

    88  - [ ] fourier view of sound -- 2 or 3 days 

    89  - [ ] dancing music listener -- 1 day, depends on fourier

    90 

    91 ** don't have to get done before winston

    92  - [ ] write tests for integration -- 3 days

    93  - [ ] usertime/gametime clock HUD display -- day 

    94  - [ ] find papers for each of the senses justifying my own

    95        representation -- week

    96  - [ ] show sensor maps in HUD display? -- 4 days

    97  - [ ] show sensor maps in AWT display? -- 2 days

    98 

    99 * refactoring objectives

   100  - [ ] consistent, high-quality names

   101  - [ ] joint-creation function in the style of others, kill blender-creature

   102  - [ ] docstrings for every function

   103  - [ ] common image-loading code

   104  - [ ] refactor display/debug code

   105  - [ ] refactor the "get the XX nodes functions"

   106 

   107 

   108 

   109 these are the sense-functions --- they each take a Node which

   110 repepsents the creature

   111 

   112 

   113  - [ ] body!

   114  - [ ] joints!

   115 

   116  - [ ] touch!

   117  - [X] hearing!

   118  - [ ] vision!

   119  - [ ] proprioception!

   120  - [ ] movement!

   121 

   122 

   123 ;;In the elder days of Art,

   124 ;;Builders wrought with greatest care

   125 ;;Each minute and unseen part;

   126 ;;For the Gods see everywhere.
author	Robert McIntyre <rlm@mit.edu>
date	Sat, 04 Feb 2012 04:08:08 -0700
parents	c33a8e5fe7bc
children	bdca0daa3778