|
rlm@328
|
1
|
|
rlm@328
|
2
|
|
rlm@155
|
3 * Brainstorming different sensors and effectors.
|
|
rlm@155
|
4
|
|
rlm@155
|
5 Every sense that we have should have an effector that changes what
|
|
rlm@155
|
6 that sense (or others who have that sense) experiences.
|
|
rlm@155
|
7
|
|
rlm@155
|
8 ** Classic Senses
|
|
rlm@155
|
9 | Sense | Effector |
|
|
rlm@155
|
10 |------------------------------+---------------------------------|
|
|
rlm@155
|
11 | Vision | Variable Coloration |
|
|
rlm@155
|
12 | Hearing | Speech |
|
|
rlm@155
|
13 | Proprioception | Movement |
|
|
rlm@306
|
14 | Smell/Taste (Chemoreception) | Pheromones |
|
|
rlm@155
|
15 | Touch | Movement / Controllable Texture |
|
|
rlm@155
|
16 | Acceleration | Movement |
|
|
rlm@155
|
17 | Balance (sense gravity) | Movement |
|
|
rlm@155
|
18
|
|
rlm@155
|
19 - New Senses/Effectors
|
|
rlm@155
|
20 - Levitation
|
|
rlm@306
|
21 - Telekinesis
|
|
rlm@155
|
22 - control of gravity within a certain radius
|
|
rlm@155
|
23 - speed up/slow time
|
|
rlm@155
|
24 - object creation/destruction
|
|
rlm@322
|
25 - future-sight -- step the simulation forward a few ticks, gather
|
|
rlm@322
|
26 sensory data, then supply this data for the creature as one of its
|
|
rlm@322
|
27 actual senses.
|
|
rlm@155
|
28
|
|
rlm@155
|
29 - Symbol Sense
|
|
rlm@155
|
30 Where objects in the world can be queried for description /
|
|
rlm@155
|
31 symbols.
|
|
rlm@155
|
32
|
|
rlm@155
|
33 - Symbol Marking
|
|
rlm@155
|
34 The ability to mark objects in the world with your own descriptions
|
|
rlm@155
|
35 and symbols.
|
|
rlm@155
|
36
|
|
rlm@155
|
37 - Vision
|
|
rlm@155
|
38 Distinguish the polarization of light
|
|
rlm@155
|
39 Color
|
|
rlm@155
|
40 Movement
|
|
rlm@155
|
41
|
|
rlm@155
|
42 * project ideas
|
|
rlm@155
|
43 - HACKER for writing muscle-control programs : Presented with
|
|
rlm@155
|
44 low-level muscle control/ sense API, generate higher level programs
|
|
rlm@155
|
45 for accomplishing various stated goals. Example goals might be
|
|
rlm@155
|
46 "extend all your fingers" or "move your hand into the area with
|
|
rlm@155
|
47 blue light" or "decrease the angle of this joint". It would be
|
|
rlm@155
|
48 like Sussman's HACKER, except it would operate with much more data
|
|
rlm@306
|
49 in a more realistic world. Start off with "calisthenics" to
|
|
rlm@306
|
50 develop subroutines over the motor control API. This would be the
|
|
rlm@155
|
51 "spinal chord" of a more intelligent creature. The low level
|
|
rlm@155
|
52 programming code might be a turning machine that could develop
|
|
rlm@155
|
53 programs to iterate over a "tape" where each entry in the tape
|
|
rlm@155
|
54 could control recruitment of the fibers in a muscle.
|
|
rlm@155
|
55 - Make a virtual computer in the virtual world which with which the
|
|
rlm@155
|
56 creature interacts using its fingers to press keys on a virtual
|
|
rlm@155
|
57 keyboard. The creature can access the internet, watch videos, take
|
|
rlm@155
|
58 over the world, anything it wants.
|
|
rlm@306
|
59 - Make virtual instruments like pianos, drums, etc that it learns to
|
|
rlm@155
|
60 play.
|
|
rlm@155
|
61 - make a joint that figures out what type of joint it is (range of
|
|
rlm@155
|
62 motion)
|
|
rlm@155
|
63
|
|
rlm@155
|
64
|
|
rlm@155
|
65
|
|
rlm@155
|
66
|
|
rlm@155
|
67
|
|
rlm@155
|
68 * goals
|
|
rlm@155
|
69
|
|
rlm@306
|
70 ** have to get done before Winston
|
|
rlm@306
|
71 - [X] write an explanation for why greyscale bitmaps for senses is
|
|
rlm@306
|
72 appropriate -- 1/2 day
|
|
rlm@155
|
73 - [X] muscle control -- day
|
|
rlm@155
|
74 - [X] proprioception sensor map in the style of the other senses -- day
|
|
rlm@193
|
75 - [X] refactor integration code to distribute to each of the senses
|
|
rlm@155
|
76 -- day
|
|
rlm@302
|
77 - [X] create video showing all the senses for Winston -- 2 days
|
|
rlm@322
|
78 - [X] spell checking !!!!!
|
|
rlm@322
|
79 - [X] send package to friends for critiques -- 2 days
|
|
rlm@306
|
80 - [X] fix videos that were encoded wrong, test on Internet Explorer.
|
|
rlm@302
|
81 - [X] redo videos vision with new collapse code
|
|
rlm@273
|
82 - [X] find a topology that looks good. (maybe nil topology?)
|
|
rlm@273
|
83 - [X] fix red part of touch cube in video and image
|
|
rlm@322
|
84 - [X] write summary of project for Winston \
|
|
rlm@322
|
85 - [X] project proposals for Winston \
|
|
rlm@322
|
86 - [X] additional senses to be implemented for Winston | -- 2 days
|
|
rlm@322
|
87 - [X] send Winston package /
|
|
rlm@155
|
88
|
|
rlm@306
|
89 ** would be cool to get done before Winston
|
|
rlm@155
|
90 - [X] enable greyscale bitmaps for touch -- 2 hours
|
|
rlm@155
|
91 - [X] use sawfish to auto-tile sense windows -- 6 hours
|
|
rlm@155
|
92 - [X] sawfish keybinding to automatically delete all sense windows
|
|
rlm@155
|
93 - [ ] proof of concept C sense manipulation -- 2 days
|
|
rlm@155
|
94 - [ ] proof of concept GPU sense manipulation -- week
|
|
rlm@306
|
95 - [ ] Fourier view of sound -- 2 or 3 days
|
|
rlm@306
|
96 - [ ] dancing music listener -- 1 day, depends on Fourier
|
|
rlm@269
|
97 - [ ] uberjar cortex demo
|
|
rlm@155
|
98
|
|
rlm@155
|
99 ** don't have to get done before winston
|
|
rlm@322
|
100 - [X] write tests for integration -- 3 days
|
|
rlm@205
|
101 - [X] usertime/gametime clock HUD display -- day
|
|
rlm@155
|
102 - [ ] find papers for each of the senses justifying my own
|
|
rlm@155
|
103 representation -- week
|
|
rlm@273
|
104 - [X] show sensor maps in HUD display? -- 4 days
|
|
rlm@273
|
105 - [X] show sensor maps in AWT display? -- 2 days
|
|
rlm@322
|
106 - [X] upgrade to clojure 1.3, replace all defvars with new def
|
|
rlm@261
|
107 - [ ] common video creation code.
|
|
rlm@155
|
108
|
|
rlm@234
|
109 * jMonkeyEngine ideas
|
|
rlm@234
|
110 - [ ] video showing bullet joints problem
|
|
rlm@234
|
111 - [ ] add mult for Matrix to Ray
|
|
rlm@306
|
112 - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,
|
|
rlm@234
|
113 Matrix3f, Matrix4f, etc
|
|
rlm@234
|
114
|
|
rlm@164
|
115 ;;In the elder days of Art,
|
|
rlm@164
|
116 ;;Builders wrought with greatest care
|
|
rlm@164
|
117 ;;Each minute and unseen part;
|
|
rlm@164
|
118 ;;For the Gods see everywhere.
|
|
rlm@376
|
119
|
|
rlm@376
|
120
|
|
rlm@376
|
121 * misc
|
|
rlm@376
|
122 - use object tracking on moving objects to derive good static
|
|
rlm@376
|
123 detectors and achieve background separation
|
|
rlm@376
|
124 - temporal scale pyramids. this can help in verb recognition by
|
|
rlm@376
|
125 making verb identification time-scale independent (up to a certian
|
|
rlm@376
|
126 factor) |
