rlm@422: rlm@432: \section{Vision} rlm@425: \label{sec-1} rlm@422: rlm@432: System for understanding what the actors in a video are doing -- rlm@432: Action Recognition. rlm@422: rlm@432: Separate action recognition into three components: rlm@426: rlm@426: \begin{itemize} rlm@432: \item free play rlm@432: \item embodied action predicates rlm@432: \item model alignment rlm@432: \item sensory imagination rlm@432: \end{itemize} rlm@432: \section{Steps} rlm@432: \label{sec-2} rlm@432: rlm@432: \begin{itemize} rlm@432: \item Build cortex, a simulated environment for sensate AI rlm@432: \begin{itemize} rlm@432: \item solid bodies w/ joints rlm@432: \item vision rlm@432: \item touch rlm@432: \item vision rlm@432: \item hearing rlm@432: \item proprioception rlm@432: \item muscle contraction rlm@426: \end{itemize} rlm@429: rlm@432: \item Build experimental framework for worm-actions rlm@432: \begin{itemize} rlm@432: \item embodied stream predicates rlm@432: \item \(\phi\)-space rlm@432: \item \(\phi\)-scan rlm@432: \end{itemize} rlm@432: \end{itemize} rlm@432: \section{News} rlm@432: \label{sec-3} rlm@432: rlm@432: Experimental results: rlm@432: rlm@432: \begin{itemize} rlm@432: \item \(\phi\)-space actually works very well for the worm! rlm@432: \item self organizing touch map rlm@432: \end{itemize} rlm@432: rlm@432: \section{Contributions} rlm@432: \label{sec-4} rlm@432: \begin{itemize} rlm@432: \item Built \texttt{CORTEX}, a comprehensive platform for embodied AI rlm@432: experiments. Has many new features lacking in other systems, such rlm@432: as sound. Easy to model/create new creatures. rlm@432: \item created a novel concept for action recognition by using artificial rlm@432: imagination. rlm@432: \end{itemize}