Facial Tracking SDK

Pinscreen’s Facial Tracking SDK is the most advanced real-time 3D facial performance capture solution for mobile phones and desktop machines. All you need is a video stream or a webcam, and your facial expressions can be instantly tracked.

Full 3D Capture

While most other solutions are limited to 2D facial landmarks, our deep learning-based technology directly provides an accurate dense 3D mesh of a person, including 51 facial expressions, and 3D head pose in world space.

Technical Specifications

Gears
Model Size

Deep Learning Model Size

10 MB
Tracking Angle

Maximum Tracking Angle

Pitch ≤ ±30°, Roll ≤ ±30°, Yaw ≤ ±40°
Tracking Speed

Tracking Speed

Desktop (GPU): 1000fps, Desktop (CPU): 100fps, Mobile: 45fps
Input

Input

2D RGB Image or Video
Output

Output

51 FACS Expressions (ARKit Compatible), Dense 3D Mesh (incl. 68 Landmarks),
Eye Gaze, Rigid Head Pose

Platforms

iOS

iOS

Mac OS X

Mac

Windows

Windows

Android

Android

Unity

Unity