annotate org/ideas.org @ 459:a86555b02916

changes from laptop.
author Robert McIntyre <rlm@mit.edu>
date Thu, 27 Mar 2014 17:56:26 -0400
parents 057d47fc4789
children 763d13f77e03
rev   line source
rlm@328 1
rlm@328 2
rlm@155 3 * Brainstorming different sensors and effectors.
rlm@155 4
rlm@459 5 ** toys
rlm@459 6 Make toys in the world with "docking points," which would attach
rlm@459 7 together in physically stable ways. Could make analogs to legos,
rlm@459 8 tinker toys, and lincoln logs.
rlm@459 9
rlm@155 10 Every sense that we have should have an effector that changes what
rlm@155 11 that sense (or others who have that sense) experiences.
rlm@155 12
rlm@155 13 ** Classic Senses
rlm@155 14 | Sense | Effector |
rlm@155 15 |------------------------------+---------------------------------|
rlm@155 16 | Vision | Variable Coloration |
rlm@155 17 | Hearing | Speech |
rlm@155 18 | Proprioception | Movement |
rlm@306 19 | Smell/Taste (Chemoreception) | Pheromones |
rlm@155 20 | Touch | Movement / Controllable Texture |
rlm@155 21 | Acceleration | Movement |
rlm@155 22 | Balance (sense gravity) | Movement |
rlm@155 23
rlm@155 24 - New Senses/Effectors
rlm@155 25 - Levitation
rlm@306 26 - Telekinesis
rlm@155 27 - control of gravity within a certain radius
rlm@155 28 - speed up/slow time
rlm@155 29 - object creation/destruction
rlm@322 30 - future-sight -- step the simulation forward a few ticks, gather
rlm@322 31 sensory data, then supply this data for the creature as one of its
rlm@322 32 actual senses.
rlm@155 33
rlm@155 34 - Symbol Sense
rlm@155 35 Where objects in the world can be queried for description /
rlm@155 36 symbols.
rlm@155 37
rlm@155 38 - Symbol Marking
rlm@155 39 The ability to mark objects in the world with your own descriptions
rlm@155 40 and symbols.
rlm@155 41
rlm@155 42 - Vision
rlm@155 43 Distinguish the polarization of light
rlm@155 44 Color
rlm@155 45 Movement
rlm@155 46
rlm@155 47 * project ideas
rlm@155 48 - HACKER for writing muscle-control programs : Presented with
rlm@155 49 low-level muscle control/ sense API, generate higher level programs
rlm@155 50 for accomplishing various stated goals. Example goals might be
rlm@155 51 "extend all your fingers" or "move your hand into the area with
rlm@155 52 blue light" or "decrease the angle of this joint". It would be
rlm@155 53 like Sussman's HACKER, except it would operate with much more data
rlm@306 54 in a more realistic world. Start off with "calisthenics" to
rlm@306 55 develop subroutines over the motor control API. This would be the
rlm@155 56 "spinal chord" of a more intelligent creature. The low level
rlm@155 57 programming code might be a turning machine that could develop
rlm@155 58 programs to iterate over a "tape" where each entry in the tape
rlm@155 59 could control recruitment of the fibers in a muscle.
rlm@155 60 - Make a virtual computer in the virtual world which with which the
rlm@155 61 creature interacts using its fingers to press keys on a virtual
rlm@155 62 keyboard. The creature can access the internet, watch videos, take
rlm@155 63 over the world, anything it wants.
rlm@306 64 - Make virtual instruments like pianos, drums, etc that it learns to
rlm@155 65 play.
rlm@155 66 - make a joint that figures out what type of joint it is (range of
rlm@155 67 motion)
rlm@155 68
rlm@155 69
rlm@155 70
rlm@155 71
rlm@155 72
rlm@155 73 * goals
rlm@155 74
rlm@306 75 ** have to get done before Winston
rlm@306 76 - [X] write an explanation for why greyscale bitmaps for senses is
rlm@306 77 appropriate -- 1/2 day
rlm@155 78 - [X] muscle control -- day
rlm@155 79 - [X] proprioception sensor map in the style of the other senses -- day
rlm@193 80 - [X] refactor integration code to distribute to each of the senses
rlm@155 81 -- day
rlm@302 82 - [X] create video showing all the senses for Winston -- 2 days
rlm@322 83 - [X] spell checking !!!!!
rlm@322 84 - [X] send package to friends for critiques -- 2 days
rlm@306 85 - [X] fix videos that were encoded wrong, test on Internet Explorer.
rlm@302 86 - [X] redo videos vision with new collapse code
rlm@273 87 - [X] find a topology that looks good. (maybe nil topology?)
rlm@273 88 - [X] fix red part of touch cube in video and image
rlm@322 89 - [X] write summary of project for Winston \
rlm@322 90 - [X] project proposals for Winston \
rlm@322 91 - [X] additional senses to be implemented for Winston | -- 2 days
rlm@322 92 - [X] send Winston package /
rlm@155 93
rlm@306 94 ** would be cool to get done before Winston
rlm@155 95 - [X] enable greyscale bitmaps for touch -- 2 hours
rlm@155 96 - [X] use sawfish to auto-tile sense windows -- 6 hours
rlm@155 97 - [X] sawfish keybinding to automatically delete all sense windows
rlm@155 98 - [ ] proof of concept C sense manipulation -- 2 days
rlm@155 99 - [ ] proof of concept GPU sense manipulation -- week
rlm@306 100 - [ ] Fourier view of sound -- 2 or 3 days
rlm@306 101 - [ ] dancing music listener -- 1 day, depends on Fourier
rlm@269 102 - [ ] uberjar cortex demo
rlm@155 103
rlm@155 104 ** don't have to get done before winston
rlm@322 105 - [X] write tests for integration -- 3 days
rlm@205 106 - [X] usertime/gametime clock HUD display -- day
rlm@155 107 - [ ] find papers for each of the senses justifying my own
rlm@155 108 representation -- week
rlm@273 109 - [X] show sensor maps in HUD display? -- 4 days
rlm@273 110 - [X] show sensor maps in AWT display? -- 2 days
rlm@322 111 - [X] upgrade to clojure 1.3, replace all defvars with new def
rlm@261 112 - [ ] common video creation code.
rlm@155 113
rlm@234 114 * jMonkeyEngine ideas
rlm@234 115 - [ ] video showing bullet joints problem
rlm@234 116 - [ ] add mult for Matrix to Ray
rlm@306 117 - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,
rlm@234 118 Matrix3f, Matrix4f, etc
rlm@234 119
rlm@164 120 ;;In the elder days of Art,
rlm@164 121 ;;Builders wrought with greatest care
rlm@164 122 ;;Each minute and unseen part;
rlm@164 123 ;;For the Gods see everywhere.
rlm@376 124
rlm@376 125
rlm@376 126 * misc
rlm@376 127 - use object tracking on moving objects to derive good static
rlm@376 128 detectors and achieve background separation
rlm@376 129 - temporal scale pyramids. this can help in verb recognition by
rlm@376 130 making verb identification time-scale independent (up to a certian
rlm@376 131 factor)