Eye, face and hand tracking

Enabling the next generation of interactive experiences, through our comprehensive range of IR emitters and sensors.

Eye tracking

Eye tracking is becoming a critical feature of the latest Virtual and Augmented reality headsets. New interactive experiences are enabled by using eye gaze as a user interface and including it in photorealistic avatars. It can also be used to reduce system power through foveated rendering, and eye movements are also a potential new vital sign.

High accuracy, fast update rates, minimum power consumption, and a tiny form factor are critical to fitting eye tracking into VR and AR glasses. ams-OSRAM offers a leading range of components to make this possible, including:

MIRA global shutter image sensors and custom wafer level optics can be combined to create ultra-small, IR enhanced, low power camera modules.
SH4060 Firefly® infrared LEDs offer a tiny form factor

We are constantly innovating in this field, looking at new and advanced eye tracking architectures that draw on our comprehensive portfolio of emitters and sensors.

Face tracking

Social and professional interactions between photorealistic avatars are expected to become a key use case across virtual and augmented reality systems. Reproducing realistic facial expressions will be crucial to enabling natural human interactions.
We offer a range of tiny, efficient emitters and sensors to enable precise sensing of facial movements, including:

MIRA global shutter image sensors and custom wafer level optics, combined to create ultra-small, IR enhanced, low power camera modules.
NanEyeC rolling shutter micro-camera - the smallest on the market with a footprint of just 1mm2.
Tiny and efficient infrared LEDs.
Infrared VCSELs and integrated dot or flood illuminator modules
Integrated proximity sensors for detecting subtle movements at short distances

Hand tracking

Whether for a user interface, or an essential feature of a photorealistic avatar: hand tracking is another must have feature for intuitive and interactive experiences – whether on a computing or smart home device, or Virtual and Augmented reality headsets.

Our compact and low power emitters and sensors are ideally suited for multiple hand tracking implementations. These include:

MIRA global shutter image sensors and custom wafer level optics, combined to create ultra-small, IR enhanced, low power camera modules.
Our comprehensive portfolio of infrared LEDs of all sizes and powers
Infrared VCSELs and integrated dot or flood illuminator modules
Integrated Multi-Zone Direct Time of Flight sensors

Featured Products

ams Mira220

2.2 MP NIR enhanced global shutter image sensor designed for 2D and 3D consumer and industrial machine vision applications. Due to its small size, configurability and high sensitivity both in visual as well as NIR, the Mira220 is well suited for 2D and 3D applications, which include Active Stereo Vision, Structured Light Vision for Robotics and AR/VR.

Datasheet Infos

OSRAM FIREFLY®, SFH 4060

Infrared Emitter (850 nm)

Datasheet Infos

ams BELAGO1.1 Dot Projector

BELAGO1.1 is a proprietary infrared dot-pattern illuminator for stereoscopic imaging and structured light platforms with eye-safety feature. It produces a focus-free, high-contrast dot pattern that algorithms can use to address low-texture situations and achieve high-accuracy depth maps. An additional benefit of the dot pattern is a reduction of the computational load required to perform the depth calculation.The BELAGO1.1 dot-pattern illuminator is provided in a miniature package that is compatible with standard lead-free reflow processes. As such, it can be successfully used onboard of a great variety of 3D sensing platforms, from mobile to IoT to robotics, both for stereoscopic imaging and structured light. BELAGO1.1 emitters project 5k dots, focus-free, in a random pattern at 940nm.

Datasheet Infos

ams TMF8828 configurable 8x8 multi-zone Time-of-Flight Sensor

The TMF8828 is a direct time-of-flight (dToF) sensor in a single modular package with associated VCSEL. The dToF device is based on SPAD, TDC and histogram technology and achieves 5000 mm detection range. Due to its lens on the SPAD, it supports 3x3, 4x4, 3x6 and 8x8 multizone output data and a wide, dynamically adjustable, field of view. A multi-lens-array (MLA) inside the package above the VCSEL widens up the FoI (field of illumination). All processing of the raw data is performed on-chip and the TMF8828 provides distance information together with confidence values on its I2C interface.

Datasheet Infos