view org/ideas.org @ 430:5205535237fb

fix skew in self-organizing-touch, work on thesis.
author Robert McIntyre <rlm@mit.edu>
date Sat, 22 Mar 2014 16:10:34 -0400
parents 30376c1c67c1
children 763d13f77e03
line wrap: on
line source


3 * Brainstorming different sensors and effectors.
5 Every sense that we have should have an effector that changes what
6 that sense (or others who have that sense) experiences.
8 ** Classic Senses
9 | Sense | Effector |
10 |------------------------------+---------------------------------|
11 | Vision | Variable Coloration |
12 | Hearing | Speech |
13 | Proprioception | Movement |
14 | Smell/Taste (Chemoreception) | Pheromones |
15 | Touch | Movement / Controllable Texture |
16 | Acceleration | Movement |
17 | Balance (sense gravity) | Movement |
19 - New Senses/Effectors
20 - Levitation
21 - Telekinesis
22 - control of gravity within a certain radius
23 - speed up/slow time
24 - object creation/destruction
25 - prescience -- step the simulation forward a few ticks, gather
26 sensory data, then supply this data for the creature as one of its
27 actual senses.
29 - Symbol Sense
30 Objects in the world can be queried for description /
31 symbols.
33 - Symbol Marking
34 The ability to mark objects in the world with your own descriptions
35 and symbols.
37 - Vision
38 Distinguish the polarization of light
39 Color
40 Movement
42 * project ideas
43 - HACKER for writing muscle-control programs : Presented with
44 low-level muscle control/ sense API, generate higher level programs
45 for accomplishing various stated goals. Example goals might be
46 "extend all your fingers" or "move your hand into the area with
47 blue light" or "decrease the angle of this joint". It would be
48 like Sussman's HACKER, except it would operate with much more data
49 in a more realistic world. Start off with "calisthenics" to
50 develop subroutines over the motor control API. This would be the
51 "spinal chord" of a more intelligent creature. The low level
52 programming code might be a turning machine that could develop
53 programs to iterate over a "tape" where each entry in the tape
54 could control recruitment of the fibers in a muscle.
55 - Make a virtual computer in the virtual world which with which the
56 creature interacts using its fingers to press keys on a virtual
57 keyboard. The creature can access the internet, watch videos, take
58 over the world, anything it wants.
59 - Make virtual instruments like pianos, drums, etc that it learns to
60 play.
61 - make a joint that figures out what type of joint it is (range of
62 motion)
64 * goals
66 ** have to get done before Winston
67 - [X] write an explanation for why greyscale bitmaps for senses is
68 appropriate -- 1/2 day
69 - [X] muscle control -- day
70 - [X] proprioception sensor map in the style of the other senses -- day
71 - [X] refactor integration code to distribute to each of the senses
72 -- day
73 - [X] create video showing all the senses for Winston -- 2 days
74 - [X] spell checking !!!!!
75 - [X] send package to friends for critiques -- 2 days
76 - [X] fix videos that were encoded wrong, test on Internet Explorer.
77 - [X] redo videos vision with new collapse code
78 - [X] find a topology that looks good. (maybe nil topology?)
79 - [X] fix red part of touch cube in video and image
80 - [X] write summary of project for Winston \
81 - [X] project proposals for Winston \
82 - [X] additional senses to be implemented for Winston | -- 2 days
83 - [X] send Winston package /
85 ** would be cool to get done before Winston
86 - [X] enable greyscale bitmaps for touch -- 2 hours
87 - [X] use sawfish to auto-tile sense windows -- 6 hours
88 - [X] sawfish keybinding to automatically delete all sense windows
89 - [ ] proof of concept C sense manipulation -- 2 days
90 - [ ] proof of concept GPU sense manipulation -- week
91 - [ ] Fourier view of sound -- 2 or 3 days
92 - [ ] dancing music listener -- 1 day, depends on Fourier
93 - [ ] uberjar cortex demo
95 ** don't have to get done before winston
96 - [X] write tests for integration -- 3 days
97 - [X] usertime/gametime clock HUD display -- day
98 - [X] show sensor maps in HUD display? -- 4 days
99 - [X] show sensor maps in AWT display? -- 2 days
100 - [X] upgrade to clojure 1.3, replace all defvars with new def
101 - [ ] common video creation code.
103 * jMonkeyEngine ideas
104 - [ ] video showing bullet joints problem
105 - [ ] add mult for Matrix to Ray
106 - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,
107 Matrix3f, Matrix4f, etc
109 ;;In the elder days of Art,
110 ;;Builders wrought with greatest care
111 ;;Each minute and unseen part;
112 ;;For the Gods see everywhere.
114 * misc
115 - use object tracking on moving objects to derive good static
116 detectors and achieve background separation
117 - temporal scale pyramids. this can help in verb recognition by
118 making verb identification time-scale independent (up to a certian
119 factor)