Technical Aspects
Jul 4th, 2008 | By admin | Category: UncategorizedAn OpenSource application was developed for Frontera v.2. The Frontera team is planning a workshop at the beginning of September on this subject so that other people can create with such software, specially with the motion tracking part. Stay tunned for info in such workshops. For now, you can find the software and related info at: sourceforge.net/projects/frontera
Or read a summary bellow:
Motion tracking
Frontera’s motion tracking application uses Intel’s OpenCV library to read out the two cameras which are mounted on the portrait’s frame. The cameras are continuously detecting the position of “blobs” (usually hands) in the image, and, combining these two detections, generates an (x,y) pair which it sends out over OSC, the Open Sound Control protocol, for use in external applications. The program is configured using a GUI, which lets you control all aspects of the application, from detection thresholds to optional visualization.
Recording and playback
For Frontera v.2, the videobooth uses a camera from Elphel Inc. to record video. This camera is “open hardware”, meaning that all its specs are opened to the public. The camera is a linux machine by itself, connected (and powered) over ethernet to a host computer or directly to the network. The video booth uses a combination of standard open video tools, ‘mencoder’ for the re-encoding of the video and ‘xjadeo’ for the playback engine.
Furthermore, for storage of the motion tracking data in combination with the recorded footage, a sqlite database is used. All interaction between these programs is again handled by the OSC protocol.