view org/ideas.org @ 479:a5480a06d5fe

first draft of proprioception complete.
author Robert McIntyre <rlm@mit.edu>
date Fri, 28 Mar 2014 23:16:32 -0400
parents 763d13f77e03
children
line wrap: on
line source


3 * Brainstorming different sensors and effectors.
5 ** toys
6 Make toys in the world with "docking points," which would attach
7 together in physically stable ways. Could make analogs to legos,
8 tinker toys, and lincoln logs.
10 Every sense that we have should have an effector that changes what
11 that sense (or others who have that sense) experiences.
13 ** Classic Senses
14 | Sense | Effector |
15 |------------------------------+---------------------------------|
16 | Vision | Variable Coloration |
17 | Hearing | Speech |
18 | Proprioception | Movement |
19 | Smell/Taste (Chemoreception) | Pheromones |
20 | Touch | Movement / Controllable Texture |
21 | Acceleration | Movement |
22 | Balance (sense gravity) | Movement |
24 - New Senses/Effectors
25 - Levitation
26 - Telekinesis
27 - control of gravity within a certain radius
28 - speed up/slow time
29 - object creation/destruction
30 - prescience -- step the simulation forward a few ticks, gather
31 sensory data, then supply this data for the creature as one of its
32 actual senses.
34 - Symbol Sense
35 Objects in the world can be queried for description /
36 symbols.
38 - Symbol Marking
39 The ability to mark objects in the world with your own descriptions
40 and symbols.
42 - Vision
43 Distinguish the polarization of light
44 Color
45 Movement
47 * project ideas
48 - HACKER for writing muscle-control programs : Presented with
49 low-level muscle control/ sense API, generate higher level programs
50 for accomplishing various stated goals. Example goals might be
51 "extend all your fingers" or "move your hand into the area with
52 blue light" or "decrease the angle of this joint". It would be
53 like Sussman's HACKER, except it would operate with much more data
54 in a more realistic world. Start off with "calisthenics" to
55 develop subroutines over the motor control API. This would be the
56 "spinal chord" of a more intelligent creature. The low level
57 programming code might be a turning machine that could develop
58 programs to iterate over a "tape" where each entry in the tape
59 could control recruitment of the fibers in a muscle.
60 - Make a virtual computer in the virtual world which with which the
61 creature interacts using its fingers to press keys on a virtual
62 keyboard. The creature can access the internet, watch videos, take
63 over the world, anything it wants.
64 - Make virtual instruments like pianos, drums, etc that it learns to
65 play.
66 - make a joint that figures out what type of joint it is (range of
67 motion)
69 * goals
71 ** have to get done before Winston
72 - [X] write an explanation for why greyscale bitmaps for senses is
73 appropriate -- 1/2 day
74 - [X] muscle control -- day
75 - [X] proprioception sensor map in the style of the other senses -- day
76 - [X] refactor integration code to distribute to each of the senses
77 -- day
78 - [X] create video showing all the senses for Winston -- 2 days
79 - [X] spell checking !!!!!
80 - [X] send package to friends for critiques -- 2 days
81 - [X] fix videos that were encoded wrong, test on Internet Explorer.
82 - [X] redo videos vision with new collapse code
83 - [X] find a topology that looks good. (maybe nil topology?)
84 - [X] fix red part of touch cube in video and image
85 - [X] write summary of project for Winston \
86 - [X] project proposals for Winston \
87 - [X] additional senses to be implemented for Winston | -- 2 days
88 - [X] send Winston package /
90 ** would be cool to get done before Winston
91 - [X] enable greyscale bitmaps for touch -- 2 hours
92 - [X] use sawfish to auto-tile sense windows -- 6 hours
93 - [X] sawfish keybinding to automatically delete all sense windows
94 - [ ] proof of concept C sense manipulation -- 2 days
95 - [ ] proof of concept GPU sense manipulation -- week
96 - [ ] Fourier view of sound -- 2 or 3 days
97 - [ ] dancing music listener -- 1 day, depends on Fourier
98 - [ ] uberjar cortex demo
100 ** don't have to get done before winston
101 - [X] write tests for integration -- 3 days
102 - [X] usertime/gametime clock HUD display -- day
103 - [X] show sensor maps in HUD display? -- 4 days
104 - [X] show sensor maps in AWT display? -- 2 days
105 - [X] upgrade to clojure 1.3, replace all defvars with new def
106 - [ ] common video creation code.
108 * jMonkeyEngine ideas
109 - [ ] video showing bullet joints problem
110 - [ ] add mult for Matrix to Ray
111 - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,
112 Matrix3f, Matrix4f, etc
114 ;;In the elder days of Art,
115 ;;Builders wrought with greatest care
116 ;;Each minute and unseen part;
117 ;;For the Gods see everywhere.
119 * misc
120 - use object tracking on moving objects to derive good static
121 detectors and achieve background separation
122 - temporal scale pyramids. this can help in verb recognition by
123 making verb identification time-scale independent (up to a certian
124 factor)