cortex: org/sense.org comparison

comparison org/sense.org @ 200:7eb966144dad

finished video for sense.org, now with subtitles!

author	Robert McIntyre <rlm@mit.edu>
date	Mon, 06 Feb 2012 08:26:20 -0700
parents	305439cec54d
children	1c915cc1118b

comparison

equal deleted inserted replaced

-:305439cec54d
+:7eb966144dad
 relocated)))
 #+end_src
 * Viewing Sense Data
 It's vital to /see/ the sense data to make sure that everything is
-behaving as it should. =(view-sense)= is here so that each sense can
+behaving as it should. =(view-sense)= and its helper, =(view-image)=
-define its own way of turning sense-data into pictures, while the
+are here so that each sense can define its own way of turning
-actual rendering of said pictures stays in one central place.
+sense-data into pictures, while the actual rendering of said pictures
-=(points->image)= helps senses generate a base image onto which they
+stays in one central place.  =(points->image)= helps senses generate a
-can overlay actual sense data.
+base image onto which they can overlay actual sense data.
 #+name: view-senses
 #+begin_src clojure
 (in-ns 'cortex.sense)
-(defn points->image
-"Take a collection of points and visuliaze it as a BufferedImage."
-[points]
-(if (empty? points)
-(BufferedImage. 1 1 BufferedImage/TYPE_BYTE_BINARY)
-(let [xs (vec (map first points))
-ys (vec (map second points))
-x0 (apply min xs)
-y0 (apply min ys)
-width (- (apply max xs) x0)
-height (- (apply max ys) y0)
-image (BufferedImage. (inc width) (inc height)
-BufferedImage/TYPE_INT_RGB)]
-(dorun
-(for [x (range (.getWidth image))
-y (range (.getHeight image))]
-(.setRGB image x y 0xFF0000)))
-(dorun
-(for [index (range (count points))]
-(.setRGB image (- (xs index) x0) (- (ys index) y0) -1)))
-image)))
 (defn view-image
 "Initailizes a JPanel on which you may draw a BufferedImage.
 Returns a function that accepts a BufferedImage and draws it to the
 JPanel. If given a directory it will save the images as png files
 (map
 (fn [display datum]
 (display (sense-display-kernel datum)))
 @windows data)))))
+(defn points->image
+"Take a collection of points and visuliaze it as a BufferedImage."
+[points]
+(if (empty? points)
+(BufferedImage. 1 1 BufferedImage/TYPE_BYTE_BINARY)
+(let [xs (vec (map first points))
+ys (vec (map second points))
+x0 (apply min xs)
+y0 (apply min ys)
+width (- (apply max xs) x0)
+height (- (apply max ys) y0)
+image (BufferedImage. (inc width) (inc height)
+BufferedImage/TYPE_INT_RGB)]
+(dorun
+(for [x (range (.getWidth image))
+y (range (.getHeight image))]
+(.setRGB image x y 0xFF0000)))
+(dorun
+(for [index (range (count points))]
+(.setRGB image (- (xs index) x0) (- (ys index) y0) -1)))
+image)))
 (defn gray
 "Create a gray RGB pixel with R, G, and B set to num. num must be
 between 0 and 255."
 [num]
 (+ num
 (defn local-to-world
 "Convert the local coordinates into world relative coordinates"
 [#^Spatial object local-coordinate]
 (.localToWorld object local-coordinate nil))
 #+end_src
+** Sense Binding
 =(bind-sense)= binds either a Camera or a Listener object to any
 object so that they will follow that object no matter how it
 moves. It is used to create both eyes and ears.
 sense
 (.mult total-rotation initial-sense-rotation))))
 (controlRender [_ _])))))
 #+end_src
-Here is some example code which shows a camera bound to a blue
+Here is some example code which shows how a camera bound to a blue box
-box as it is buffeted by white cannonballs.
+with =(bind-sense)= moves as the box is buffeted by white cannonballs.
 #+name: test
 #+begin_src clojure
 (ns cortex.test.sense
 (:use (cortex world util sense vision))
 BufferedImage!))
 (add-camera! world (.getCamera world) no-op)))
 no-op)))
 #+end_src
-** Demo Video
 #+begin_html
 <video controls="controls" width="755">
 <source src="../video/bind-sense.ogg" type="video/ogg"
 	  preload="none" poster="../images/aurellem-1280x480.png" />
 </video>
 #+end_html
-note to self: the video was created with the following commands:
+With this, eyes are easy --- you just bind the camera closer to the
+desired object, and set it to look outward instead of inward as it
+does in the video.
+(nb : the video was created with the following commands)
+*** Combine Frames with ImageMagick
 #+begin_src clojure :results silent
 (in-ns 'user)
 (import java.io.File)
 (use 'clojure.contrib.shell-out)
 (let
 [idx (atom -1)
 left (rest
 (sort
 (file-seq (File. "/home/r/proj/cortex/render/bind-sense0/"))))
 right (rest
 (sort
-(file-seq (File. "/home/r/proj/cortex/render/bind-sense1/"))))]
+(file-seq
+(File. "/home/r/proj/cortex/render/bind-sense1/"))))
+sub (rest
+(sort
+(file-seq
+(File. "/home/r/proj/cortex/render/bind-senseB/"))))
+sub* (concat sub (repeat 1000 (last sub)))]
 (dorun
 (map
-(fn [im-1 im-2]
+(fn [im-1 im-2 sub]
-(println idx)
 (sh "convert" (.getCanonicalPath im-1)
 (.getCanonicalPath im-2) "+append"
+(.getCanonicalPath sub) "-append"
 (.getCanonicalPath
 (File. "/home/r/proj/cortex/render/bind-sense/"
 (format "%07d.png" (swap! idx inc))))))
-left right)))
+left right sub*)))
 #+end_src
+*** Encode Frames with ffmpeg
 #+begin_src sh :results silent
 cd /home/r/proj/cortex/render/
-cp ../images/aurellem-1280x480.png bind-sense/0000000.png
 ffmpeg -r 60 -b 9000k -i bind-sense/%07d.png bind-sense.ogg
 #+end_src
 * Bookkeeping
 Here is the header for this namespace, included for completness.
 #+name: header
 #+begin_src clojure
 (:import com.jme3.scene.control.AbstractControl)
 (:import (com.jme3.math Quaternion Vector3f))
 (:import javax.imageio.ImageIO)
 (:import java.io.File)
 (:import (javax.swing JPanel JFrame SwingUtilities)))
 #+end_src
 * Source Listing
 Full source: [[../src/cortex/sense.clj][sense.clj]]

Mercurial > cortex

comparison org/sense.org @ 200:7eb966144dad