# HG changeset patch
# User Robert McIntyre <rlm@mit.edu>
# Date 1329586094 25200
# Node ID 19c43ec6958d9d3cb6d9dae1d8179fa025b11ad9
# Parent  2dfebf71053c2c7dba93a67299edf5a0be67f9ff
modified cover letter, wonston-letter, and began uploading files to youtube for backup

diff -r 2dfebf71053c -r 19c43ec6958d org/cover.html
--- a/org/cover.html	Sat Feb 18 02:07:40 2012 -0600
+++ b/org/cover.html	Sat Feb 18 10:28:14 2012 -0700
@@ -35,50 +35,59 @@
 <br><br>
 
 <p>
-The purpose of this project is to create a framework for sensate
-creatures in a virtual environment. This approach is advantageous
-because of timing.
 
-You can see a showcase of each sense below, as well as a short article
-explaining how I implemented it.
+<video controls="controls" width="755">
+  <source src="../video/hand.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+</video>
 
-<h2>Vision</h2>
-<a href="./vision.html">Read the article on implementing vision &raquo;</a>
+Here are videos which showcase each of the senses shown in the video
+above, as well as links to full source and an article explaining how I
+implemented each of them.
+
+<h2>Physical Bodies</h2>
+<a href="../html/body.html">Read the article on implementing physical bodies &raquo;</a>
 <video controls="controls" width="755">
-  <source src="./video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+  <source src="../video/full-hand.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
 </video>
 
 <h2>Vision</h2>
-<a href="./vision.html">Read the article on implementing vision &raquo;</a>
+<a href="../html/vision.html">Read the article on implementing vision &raquo;</a>
 <video controls="controls" width="755">
-  <source src="./video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+  <source src="../video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
 </video>
 
-<h2>Vision</h2>
-<a href="./vision.html">Read the article on implementing vision &raquo;</a>
+
+<h2>Hearing</h2>
+<a href="../html/hearing.html">Read the article on implementing hearing &raquo;</a>
 <video controls="controls" width="755">
-  <source src="./video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+  <source src="../video/java-hearing-test.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+</video>
+<video controls="controls" width="755">
+  <source src="../video/worm-hearing.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
 </video>
 
-<h2>Vision</h2>
-<a href="./vision.html">Read the article on implementing vision &raquo;</a>
+
+<h2>Touch</h2>
+<a href="../html/touch.html">Read the article on implementing touch &raquo;</a>
 <video controls="controls" width="755">
-  <source src="./video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+  <source src="../video/basic-touch.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+</video>
+<video controls="controls" width="755">
+  <source src="../video/worm-touch.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
 </video>
 
-<h2>Vision</h2>
-<a href="./vision.html">Read the article on implementing vision &raquo;</a>
+<h2>Proprioception</h2>
+<a href="../html/proprioception.html">Read the article on implementing proprioception &raquo;</a>
 <video controls="controls" width="755">
-  <source src="./video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+  <source src="../video/test-proprioception.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
 </video>
 
-<h2>Vision</h2>
-<a href="./vision.html">Read the article on implementing vision &raquo;</a>
+<h2>Movement</h2>
+<a href="../html/movement.html">Read the article on implementing muscles &raquo;</a>
 <video controls="controls" width="755">
-  <source src="./video/worm-vision.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
+  <source src="../video/worm-muscles.ogg" type="video/ogg" preload="none" poster="../images/aurellem-1280x480.png">
 </video>
 
-
 </p>
 
 </body>
diff -r 2dfebf71053c -r 19c43ec6958d org/youtube.org
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/org/youtube.org	Sat Feb 18 10:28:14 2012 -0700
@@ -0,0 +1,21 @@
+| local-file              | youtube-url |
+|-------------------------+-------------|
+| basic-touch.ogg         |             |
+| hand.ogg                |             |
+| worm-hearing.ogg        |             |
+| bind-sense.ogg          |             |
+| java-hearing-test.ogg   |             |
+| worm-muscles.ogg        |             |
+| crumbly-hand.ogg        |             |
+| spinning-cube.ogg       |             |
+| worm-touch.ogg          |             |
+| cube.ogg                |             |
+| test-proprioception.ogg |             |
+| worm-vision.ogg         |             |
+| full-hand.ogg           |             |
+| touch-cube.ogg          |             |
+| ghost-hand.ogg          |             |
+| worm-1.ogg              |             |
+|-------------------------+-------------|
+
+
diff -r 2dfebf71053c -r 19c43ec6958d winston-intro.txt
--- a/winston-intro.txt	Sat Feb 18 02:07:40 2012 -0600
+++ b/winston-intro.txt	Sat Feb 18 10:28:14 2012 -0700
@@ -1,103 +1,85 @@
 Dear Professor Winston,
 
-I'm ready for you to look through the work that I've done so far. It's
-a sequence of posts describing the different simulated senses I've
-implemented, with videos. 
+I've finished the first part of my project, building a framework for
+virtual sensate creatures; I would like your help evaluating what I've
+done so far, and deciding what to do next.
 
-It's "blocks world reloaded", because like you say, you need multiple
-senses to enable intelligence.
+For the work I've done so far, I compiled the results into short
+articles that explain how I implemented each sense, with videos that
+show each sense in action. Please look through the articles, in
+particular the video showcase, and tell me what you think.
 
-Please look through the videos and skim the text and tell me what
-you think:
+Video Showcase : http://aurellem.localhost/cortex/org/cover.html
 
 Introduction:
 http://aurellem.org/cortex/html/intro.html
 http://aurellem.org/cortex/html/sense.html
 
-http://aurellem.org/cortex/html/body.html  -- simulated physical bodies
-http://aurellem.org/cortex/html/vision.html -- simulated eyes
-http://aurellem.org/cortex/html/hearing.html -- simulated ears
-http://aurellem.org/cortex/html/touch.html   -- simulated skin/hairs
-http://aurellem.org/cortex/html/proprioception.html -- simulated proprioception
-http://aurellem.org/cortex/html/movement.html       -- simulated muscles
-http://aurellem.org/cortex/html/integration.html  -- full demonstration 
+Physical Bodies : http://aurellem.org/cortex/html/body.html
+Vision  : http://aurellem.org/cortex/html/vision.html
+Hearing : http://aurellem.org/cortex/html/hearing.html
+Touch   : http://aurellem.org/cortex/html/touch.html
+Proprioception     : http://aurellem.org/cortex/html/proprioception.html
+Muscles            : http://aurellem.org/cortex/html/movement.html
+Full Demonstration : http://aurellem.org/cortex/html/integration.html
 
-In particular, look at the video at
-http://aurellem.org/cortex/html/integration.html.  It shows a
-simulated hand equipped with all of the senses I've built so far.
+I think this work could be a fruitful foundation for a Master's
+thesis, so in particular, I'd like critiques, suggestions, and project
+ideas. For example, here are some projects I think would be worthy, in
+increasing order of complexity:
 
-There's some more background information and full source code at 
-http://aurellem.org
+    * Create a self-powered joint that can determine its range of
+      motion and joint type (hinge, cone, point-to-point, etc.) by
+      making exploratory muscle movements and observing their effect.
 
-If you can't see a video, let me know and I'll upload it to YouTube so
-you can see it.
+    * Develop an agent that writes and debugs low-level motor control
+      programs to achieve simple goals like "look at the light" or
+      "extend all of your fingers". These simple "calisthenic"
+      programs could then be combined to form more elaborate
+      procedures of motion, which in turn could be the basic
+      instinctive reflexes in the "spinal cord" of some more advanced
+      creature. (like Sussman's HACKER program but in a richer world)
 
+    * Program a group of creatures that cooperate with each
+      other. Because the creatures would be simulated, I could
+      investigate computationally complex rules of behavior which
+      still, from the group's point of view, would happen in "real
+      time". Interactions could be as simple as cellular organisms
+      communicating via flashing lights, or as complex as humanoids
+      completing social tasks, etc.
 
+    * Simulated Imagination -- this would involve a creature with an
+      effector which creates an entire new sub-simulation where the
+      creature has direct control over placement/creation of objects
+      via simulated telekinesis. The creature observes this sub-world
+      through it's normal senses and uses its observations to make
+      predictions about it's top level world.
 
+    * Integrate the simulated world with Genesis, so that Genesis
+      could use the simulated world to answer questions about a
+      proposed physical scenario. For example "You stack two blocks
+      together, then hit the bottom block with your hand. Does the top
+      block move?". This project is complicated and very large in
+      scope, but it could be narrowed to focus on a single key
+      aspect. For example, one key aspect of turning a scenario into a
+      simulation is knowing when you're constructing "typical" or
+      "atypical" examples of the scenario. So, a narrower project
+      might simply learn about the edge cases of different scenarios
+      (e.g. "A block stacked on top of another block is usually
+      stable, provided the bottom block is large enough, and is not
+      moving, and is level, etc."). With this knowledge, this kind of
+      program could aid Genesis not only in answering common-sense
+      questions, but in refining them: "A block is stacked on top of
+      another block. Is it stable?"; "Usually, but do you know if the
+      bottom block is slanted?", etc.
 
-Now, I need your help moving forward. Can I use this work as a base
-for a Masters thesis with you when I come back to MIT this coming Fall?
-What critiques and project ideas do you have after looking through
-what I've done so far?
+These are some ideas, but I think you can come up with better ones. I
+can't wait to hear your critiques and suggestions.
 
-I have some ideas on where I can go with this project but I think you
-will have some better ones.
+Finally, regarding next year at MIT, can I be considered for the
+position of TA for 6.034 or 6.xxx? Also, do you want me to return Fall
+or Summer?
 
-Here are some possible projects I might do with this as a base that I
-think would be worthy Masters projects.
+Sincerely, 
 
- - HACKER for writing muscle-control programs : Presented with
-   low-level muscle control/ sense API, generate higher level programs
-   for accomplishing various stated goals. Example goals might be
-   "extend all your fingers" or "move your hand into the area with
-   blue light" or "decrease the angle of this joint".  It would be
-   like Sussman's HACKER, except it would operate with much more data
-   in a more realistic world.  Start off with "calisthenics" to
-   develop subroutines over the motor control API.  This would be the
-   "spinal chord" of a more intelligent creature.
-
- - Create hundreds of small creatures and have them do simple
-   simulated swarm tasks.
- 
- - A joint that learns what sort of joint it (cone, point-to-point,
-   hinge, etc.) is by correlating exploratory muscle movements with
-   vision.
-
- - Something with cross-modal clustering using the rich sense
-   data. This might prove difficult due to the higher dimensionality
-   of my senses.
-
- - Simulated Imagination --- this would involve a creature with an
-   effector which creates an /entire new sub-simulation/ where the
-   creature has direct control over placement/creation of objects via
-   simulated telekinesis. The creature observes this sub-world through
-   it's normal senses and uses its observations to make predictions
-   about it's top level world.
-
- - Hook it up with Genesis --- I could make a "semantic effector"
-   which marks objects/sensory states with semantic information. In
-   conjunction with Simulated Imagination, and HACKER-like motor
-   control, Genesis might be able to ask simple questions like "stack
-   two blocks together and hit the top one with your hand; does the
-   bottom block move?" and the system could answer "yes".  This would
-   be rather complicated to do and involves many of the above
-   projects, but there may be a way to scale it down to Master's
-   thesis size.
-
- - Make a virtual computer in the virtual world which with which the
-   creature interacts using its fingers to press keys on a virtual
-   keyboard. The creature can access the internet, watch videos, take
-   over the world, anything it wants. (This is probably not worthy of
-   a Masters project, I just thought it was a neat idea. It's possible
-   to use videos/etc in the simulated world at any rate.)
-
-
-I can't wait to hear your critiques and ideas.  If you think I
-shouldn't use this system as a base and should instead do something
-else, that's fine too. 
-
-On a related note, can I be considered for the position of TA next
-year for 6.034 or 6.xxx?
-
-sincerely,
 --Robert McIntyre