Mercurial > cortex
annotate thesis/cortex.tex @ 432:1e5ea711857d
abstract first draft.
| author | Robert McIntyre <rlm@mit.edu> |
|---|---|
| date | Sun, 23 Mar 2014 16:33:01 -0400 |
| parents | 7410f0d8011c |
| children |
| rev | line source |
|---|---|
| rlm@422 | 1 |
| rlm@432 | 2 \section{Vision} |
| rlm@425 | 3 \label{sec-1} |
| rlm@422 | 4 |
| rlm@432 | 5 System for understanding what the actors in a video are doing -- |
| rlm@432 | 6 Action Recognition. |
| rlm@422 | 7 |
| rlm@432 | 8 Separate action recognition into three components: |
| rlm@426 | 9 |
| rlm@426 | 10 \begin{itemize} |
| rlm@432 | 11 \item free play |
| rlm@432 | 12 \item embodied action predicates |
| rlm@432 | 13 \item model alignment |
| rlm@432 | 14 \item sensory imagination |
| rlm@432 | 15 \end{itemize} |
| rlm@432 | 16 \section{Steps} |
| rlm@432 | 17 \label{sec-2} |
| rlm@432 | 18 |
| rlm@432 | 19 \begin{itemize} |
| rlm@432 | 20 \item Build cortex, a simulated environment for sensate AI |
| rlm@432 | 21 \begin{itemize} |
| rlm@432 | 22 \item solid bodies w/ joints |
| rlm@432 | 23 \item vision |
| rlm@432 | 24 \item touch |
| rlm@432 | 25 \item vision |
| rlm@432 | 26 \item hearing |
| rlm@432 | 27 \item proprioception |
| rlm@432 | 28 \item muscle contraction |
| rlm@426 | 29 \end{itemize} |
| rlm@429 | 30 |
| rlm@432 | 31 \item Build experimental framework for worm-actions |
| rlm@432 | 32 \begin{itemize} |
| rlm@432 | 33 \item embodied stream predicates |
| rlm@432 | 34 \item \(\phi\)-space |
| rlm@432 | 35 \item \(\phi\)-scan |
| rlm@432 | 36 \end{itemize} |
| rlm@432 | 37 \end{itemize} |
| rlm@432 | 38 \section{News} |
| rlm@432 | 39 \label{sec-3} |
| rlm@432 | 40 |
| rlm@432 | 41 Experimental results: |
| rlm@432 | 42 |
| rlm@432 | 43 \begin{itemize} |
| rlm@432 | 44 \item \(\phi\)-space actually works very well for the worm! |
| rlm@432 | 45 \item self organizing touch map |
| rlm@432 | 46 \end{itemize} |
| rlm@432 | 47 |
| rlm@432 | 48 \section{Contributions} |
| rlm@432 | 49 \label{sec-4} |
| rlm@432 | 50 \begin{itemize} |
| rlm@432 | 51 \item Built \texttt{CORTEX}, a comprehensive platform for embodied AI |
| rlm@432 | 52 experiments. Has many new features lacking in other systems, such |
| rlm@432 | 53 as sound. Easy to model/create new creatures. |
| rlm@432 | 54 \item created a novel concept for action recognition by using artificial |
| rlm@432 | 55 imagination. |
| rlm@432 | 56 \end{itemize} |