interfaces
SideBySide projection system enables collaborative interaction
Researchers at Carnegie Mellon University and Disney Research (Karl D.D. Willis, Ivan Poupyrev, Scott E. Hudson, Moshe Mahler) have developed a projection system on smart phones called SideBySide. The system enables animated images from two separate devices to interact with each other when projected on the same surface. The handheld projectors emit both visible and IR (infrared) light, and contain a camera that can monitor the projected images, a range sensor, and an IMU (inertial measurement unit). The IR light is used by the system to see how the images are moving or overlapping. It is also used to as a means of communication between the devices. More information is available in a press release.
Omnitouch wearable depth-sensing multitouch system
Researchers from Carnegie Mellon University (Chris Harrison) and Microsoft (Hrvoje Benko and Andrew D. Wilson) have developed OmniTouch, a wearable projection system that makes any object a graphical, interactive surface. The projector can superimpose images of keyboards and other controls on any surface, adjusting for the object's surface and size. The system uses a depth-sensing camera to track the user's fingers on the object surface. According to Benko, "We see this work as an evolutionary step in a larger effort at Microsoft Research to investigate the unconventional use of touch and gesture in devices to extend our vision of ubiquitous computing even further."
The current system is shoulder mounted, but future models would be smaller and could be integrated into handheld devices. More information is available in a press relesae.
Computer vision and 3D printing for drug discovery
A fastcodesign.com article reports on an augmented reality (AR) tool for molecular drug design. Arthur Olson of the Scripps Institute Molecular Graphics Laboratory has developed a aystem in which a 3D printer creates solid models of drug and enzyme molecules; and a web cam tracks them to create AR overlays that help scientists figure out how the molecules can fit together.
UC-Irvine to develop multi camera-projection system
Researchers at UC-Irvine, led by professor Aditi Majumder, are developing new technology in digital projection. Using everyday cameras and projectors, the researchers are working on ways to allow multiple cell phone users to simultaneously project a video clip on a wall in a group setting. The technology involves a bank of cameras and projectors that adjust data seamlessly based on hand movements. More information is available in a press release .
Android Ice Cream Sandwich to include new vision functions
At the recent Google I/O developer event, Google demonstrated new camera functions that would be released in Android 4.0 (codenamed Ice Cream Sandwich). The YouTube video below (starting around the three-minute mark) shows capabilities such as head tracking to control a virtual display, image augmentation for camera tricks, and face detection for seamless zooming in video conferencing.
Aurasma augmented reality app turns static content into tracked video
Aurasma makes a mobile augmented reality (AR) app that detects a target, such as an ad or a T-shirt design, and turns it into a video that tracks the ad as the mobile device is moved. The video below shows an example of the app in use.
OpenNI launches developer Arena for gesture-based apps and games
OpenNI.org, an industry organization of gesture-based and other advanced interfaces that use vision and audio sensors, has launched the OpenNI Arena at http://arena.openni.org/. The Arena allows developers to showcase apps and games based on natural interaction. OpenNI was founded by PrimeSense, the developer of the 3D sensor used in the Microsoft Kinect; WillowGarage, currently leading OpenCV development; Side-Kick; and Asus. OpenNI makes available an open-source framework with APIs to low-level vision and audio sensors and to high-level computer vision software (e.g., for tracking).
Related articles:
Kinect gesture controls Roomba vacuum
Japanese researcher Akihiro Nakamura from the Nara Institute of Science and Technology (NAIST) has developed an interesting gesture-based application using a Kinect and a Roomba vacuum cleaner. Using regular vacuuming gestures, Nakamura can remotely control the roomba direction using a FRISK Bluetooth module, which is placed on top of the Roomba. (Nakamura also goes by the name Ogutti online.) The application is listed as one of the top ten Kinect applications in an IEEE Spectrum blog.
Web-cam enabled music interface
Dr. Enrico Costanza of the University of Southampton, U.K., has developed a marker-based music system. A computer vision system recognizes the types and positions of different markers to interactively create multiple tracks of music. The open-source software is available from d-touch.org. The system is demonstrated in the video below.
ZigFu provides rapid-setup motion capture
Venture Beat reports that startup Zigfu is releasing software to enable developers to set up motion capture in minutes. The software integrates the OpenNI framework for natural gestural interaction, the Unity3D game engine, and the PrimeSense NITE middleware for 3D perception. According to ZigFu co-founder Amir Hirsch, "It takes about two minutes of click-and-drag work to get your own motion-controlled avatar up and running. The task involves connecting the shoulders, elbows, knees and hips on your 3-D character to the data output by the skeleton tracking module." The software also supports the Kinect SDK.
Related articles: