Mercurial > cortex

     1 

     2 \section{Vision}

     3 \label{sec-1}

     4 

     5 System for understanding what the actors in a video are doing --

     6 Action Recognition.

     7 

     8 Separate action recognition into three components:

     9 

    10 \begin{itemize}

    11 \item free play

    12 \item embodied action predicates

    13 \item model alignment

    14 \item sensory imagination

    15 \end{itemize}

    16 \section{Steps}

    17 \label{sec-2}

    18 

    19 \begin{itemize}

    20 \item Build cortex, a simulated environment for sensate AI

    21 \begin{itemize}

    22 \item solid bodies w/ joints

    23 \item vision

    24 \item touch

    25 \item vision

    26 \item hearing

    27 \item proprioception

    28 \item muscle contraction

    29 \end{itemize}

    30 

    31 \item Build experimental framework for worm-actions

    32 \begin{itemize}

    33 \item embodied stream predicates

    34 \item \(\phi\)-space

    35 \item \(\phi\)-scan

    36 \end{itemize}

    37 \end{itemize}

    38 \section{News}

    39 \label{sec-3}

    40 

    41 Experimental results:

    42 

    43 \begin{itemize}

    44 \item \(\phi\)-space actually works very well for the worm!

    45 \item self organizing touch map

    46 \end{itemize}

    47 

    48 \section{Contributions}

    49 \label{sec-4}

    50 \begin{itemize}

    51 \item Built \texttt{CORTEX}, a comprehensive platform for embodied AI

    52 experiments. Has many new features lacking in other systems, such

    53 as sound. Easy to model/create new creatures.

    54 \item created a novel concept for action recognition by using artificial

    55 imagination.

    56 \end{itemize}
author	Robert McIntyre <rlm@mit.edu>
date	Sun, 23 Mar 2014 16:33:01 -0400
parents	7410f0d8011c
children