|
rlm@328
|
1
|
|
rlm@328
|
2
|
|
rlm@155
|
3 * Brainstorming different sensors and effectors.
|
|
rlm@155
|
4
|
|
rlm@155
|
5 Every sense that we have should have an effector that changes what
|
|
rlm@155
|
6 that sense (or others who have that sense) experiences.
|
|
rlm@155
|
7
|
|
rlm@155
|
8 ** Classic Senses
|
|
rlm@155
|
9 | Sense | Effector |
|
|
rlm@155
|
10 |------------------------------+---------------------------------|
|
|
rlm@155
|
11 | Vision | Variable Coloration |
|
|
rlm@155
|
12 | Hearing | Speech |
|
|
rlm@155
|
13 | Proprioception | Movement |
|
|
rlm@306
|
14 | Smell/Taste (Chemoreception) | Pheromones |
|
|
rlm@155
|
15 | Touch | Movement / Controllable Texture |
|
|
rlm@155
|
16 | Acceleration | Movement |
|
|
rlm@155
|
17 | Balance (sense gravity) | Movement |
|
|
rlm@155
|
18
|
|
rlm@155
|
19 - New Senses/Effectors
|
|
rlm@155
|
20 - Levitation
|
|
rlm@306
|
21 - Telekinesis
|
|
rlm@155
|
22 - control of gravity within a certain radius
|
|
rlm@155
|
23 - speed up/slow time
|
|
rlm@155
|
24 - object creation/destruction
|
|
rlm@391
|
25 - prescience -- step the simulation forward a few ticks, gather
|
|
rlm@322
|
26 sensory data, then supply this data for the creature as one of its
|
|
rlm@322
|
27 actual senses.
|
|
rlm@155
|
28
|
|
rlm@155
|
29 - Symbol Sense
|
|
rlm@391
|
30 Objects in the world can be queried for description /
|
|
rlm@155
|
31 symbols.
|
|
rlm@155
|
32
|
|
rlm@155
|
33 - Symbol Marking
|
|
rlm@155
|
34 The ability to mark objects in the world with your own descriptions
|
|
rlm@155
|
35 and symbols.
|
|
rlm@155
|
36
|
|
rlm@155
|
37 - Vision
|
|
rlm@155
|
38 Distinguish the polarization of light
|
|
rlm@155
|
39 Color
|
|
rlm@155
|
40 Movement
|
|
rlm@155
|
41
|
|
rlm@155
|
42 * project ideas
|
|
rlm@155
|
43 - HACKER for writing muscle-control programs : Presented with
|
|
rlm@155
|
44 low-level muscle control/ sense API, generate higher level programs
|
|
rlm@155
|
45 for accomplishing various stated goals. Example goals might be
|
|
rlm@155
|
46 "extend all your fingers" or "move your hand into the area with
|
|
rlm@155
|
47 blue light" or "decrease the angle of this joint". It would be
|
|
rlm@155
|
48 like Sussman's HACKER, except it would operate with much more data
|
|
rlm@306
|
49 in a more realistic world. Start off with "calisthenics" to
|
|
rlm@306
|
50 develop subroutines over the motor control API. This would be the
|
|
rlm@155
|
51 "spinal chord" of a more intelligent creature. The low level
|
|
rlm@155
|
52 programming code might be a turning machine that could develop
|
|
rlm@155
|
53 programs to iterate over a "tape" where each entry in the tape
|
|
rlm@155
|
54 could control recruitment of the fibers in a muscle.
|
|
rlm@155
|
55 - Make a virtual computer in the virtual world which with which the
|
|
rlm@155
|
56 creature interacts using its fingers to press keys on a virtual
|
|
rlm@155
|
57 keyboard. The creature can access the internet, watch videos, take
|
|
rlm@155
|
58 over the world, anything it wants.
|
|
rlm@306
|
59 - Make virtual instruments like pianos, drums, etc that it learns to
|
|
rlm@155
|
60 play.
|
|
rlm@155
|
61 - make a joint that figures out what type of joint it is (range of
|
|
rlm@155
|
62 motion)
|
|
rlm@155
|
63
|
|
rlm@155
|
64 * goals
|
|
rlm@155
|
65
|
|
rlm@306
|
66 ** have to get done before Winston
|
|
rlm@306
|
67 - [X] write an explanation for why greyscale bitmaps for senses is
|
|
rlm@306
|
68 appropriate -- 1/2 day
|
|
rlm@155
|
69 - [X] muscle control -- day
|
|
rlm@155
|
70 - [X] proprioception sensor map in the style of the other senses -- day
|
|
rlm@193
|
71 - [X] refactor integration code to distribute to each of the senses
|
|
rlm@155
|
72 -- day
|
|
rlm@302
|
73 - [X] create video showing all the senses for Winston -- 2 days
|
|
rlm@322
|
74 - [X] spell checking !!!!!
|
|
rlm@322
|
75 - [X] send package to friends for critiques -- 2 days
|
|
rlm@306
|
76 - [X] fix videos that were encoded wrong, test on Internet Explorer.
|
|
rlm@302
|
77 - [X] redo videos vision with new collapse code
|
|
rlm@273
|
78 - [X] find a topology that looks good. (maybe nil topology?)
|
|
rlm@273
|
79 - [X] fix red part of touch cube in video and image
|
|
rlm@322
|
80 - [X] write summary of project for Winston \
|
|
rlm@322
|
81 - [X] project proposals for Winston \
|
|
rlm@322
|
82 - [X] additional senses to be implemented for Winston | -- 2 days
|
|
rlm@322
|
83 - [X] send Winston package /
|
|
rlm@155
|
84
|
|
rlm@306
|
85 ** would be cool to get done before Winston
|
|
rlm@155
|
86 - [X] enable greyscale bitmaps for touch -- 2 hours
|
|
rlm@155
|
87 - [X] use sawfish to auto-tile sense windows -- 6 hours
|
|
rlm@155
|
88 - [X] sawfish keybinding to automatically delete all sense windows
|
|
rlm@155
|
89 - [ ] proof of concept C sense manipulation -- 2 days
|
|
rlm@155
|
90 - [ ] proof of concept GPU sense manipulation -- week
|
|
rlm@306
|
91 - [ ] Fourier view of sound -- 2 or 3 days
|
|
rlm@306
|
92 - [ ] dancing music listener -- 1 day, depends on Fourier
|
|
rlm@269
|
93 - [ ] uberjar cortex demo
|
|
rlm@155
|
94
|
|
rlm@155
|
95 ** don't have to get done before winston
|
|
rlm@322
|
96 - [X] write tests for integration -- 3 days
|
|
rlm@205
|
97 - [X] usertime/gametime clock HUD display -- day
|
|
rlm@273
|
98 - [X] show sensor maps in HUD display? -- 4 days
|
|
rlm@273
|
99 - [X] show sensor maps in AWT display? -- 2 days
|
|
rlm@322
|
100 - [X] upgrade to clojure 1.3, replace all defvars with new def
|
|
rlm@261
|
101 - [ ] common video creation code.
|
|
rlm@155
|
102
|
|
rlm@234
|
103 * jMonkeyEngine ideas
|
|
rlm@234
|
104 - [ ] video showing bullet joints problem
|
|
rlm@234
|
105 - [ ] add mult for Matrix to Ray
|
|
rlm@306
|
106 - [ ] add iterator constructs to Vector3f, Vector2f, Triangle,
|
|
rlm@234
|
107 Matrix3f, Matrix4f, etc
|
|
rlm@234
|
108
|
|
rlm@164
|
109 ;;In the elder days of Art,
|
|
rlm@164
|
110 ;;Builders wrought with greatest care
|
|
rlm@164
|
111 ;;Each minute and unseen part;
|
|
rlm@164
|
112 ;;For the Gods see everywhere.
|
|
rlm@376
|
113
|
|
rlm@376
|
114 * misc
|
|
rlm@376
|
115 - use object tracking on moving objects to derive good static
|
|
rlm@376
|
116 detectors and achieve background separation
|
|
rlm@376
|
117 - temporal scale pyramids. this can help in verb recognition by
|
|
rlm@376
|
118 making verb identification time-scale independent (up to a certian
|
|
rlm@391
|
119 factor)
|
