SMART LASER SCANNER [2004]

The problem of tracking hands and fingers on natural scenes has received much attention using passive acquisition vision systems and computationally intense image processing. We are currently studying a simple active tracking system using a laser diode (visible or invisible light), steering mirrors, and a single non-imaging photodetector. The system is capable of acquiring three dimensional coordinates in real time without the need of any image processing at all (no camera). Essentially, it is a smart rangefinder scanner that instead of continuously scanning over the full field of view, restricts its scanning are to a very narrow window precisely the size of the target.

Applications of a multiple target tracking system are countless. Such a configuration allows, for instance, multiple users to interact on the same virtual space; or a single user to control several virtual tools at the same time, resize windows and control information screens, as imagined in Spielberg’s film “Minority Report” – but without the need to wear special gloves nor markers.

Tracking of multiple targets is also possible without replicating any part of the system (targets are considered sequentially).

Camera-less interactive display on the palm of the hand

A very interesting characteristic of the proposed 3D laser-based locator, is that it also can be used as an output device: indeed, the laser scanner can be used to write information back to the user, by projecting alphanumeric data onto any available surface, like the palm of the hand. This has been successfully demonstrated, without having to stop the tracking (see below).

MOEMS integration for wearable spatial augmented reality

Finally, hardware simplicity is such that using state-of-the-art Micro-Opto-Electro-Mechanical-System (MOEMS) technology, it should be possible to integrate the whole system on a single chip, making a versatile human-machine input/output interface for use in mobile computing devices and wearables.

Alvaro Cassinelli, Stephane Perrin and Masatoshi Ishikawa : Markerless Laser-based Tracking for Real-Time 3D Gesture Acquisition, ACM SIGGRAPH 2004 (Los Angeles, 2004)

VIDEO DEMOS

For more:

References: 

  1. Alvaro Cassinelli, Stephane Perrin and Masatoshi Ishikawa : Smart Laser-Scanner for 3D Human-Machine Interface, ACM SIGCHI (CHI’05), pp.1138-1139, Portland, April 2-7, 2005)
  2. Alvaro Cassinelli, Stephane Perrin and Masatoshi Ishikawa : Markerless Laser-based Tracking for Real-Time 3D Gesture Acquisition, ACM SIGGRAPH 2004 (Los Angeles, 2004)
  3. Stephane Perrin, Alvaro Cassinelli and Masatoshi Ishikawa : Gesture Recognition Using Laser-based Tracking System, 6th International Conference on Automatic Face and Gesture Recognition 2004(FG 2004) (Seoul, 2004.5.17-19)
  4. Stephane Perrin, Alvaro Cassinelli and Masatoshi Ishikawa : Laser-Based Finger Tracking System Suitable for MOEMS Integration, Image and Vision Computing, New Zealand(IVCNZ 2003) (Massey Univ., 2003.11.26-28)/pp.131-136 (2003)
Share: