Facial Tracking SDK
Pinscreen’s Facial Tracking SDK is the most advanced real-time 3D facial performance capture solution for mobile phones and desktop machines. All you need is a video stream or a webcam, and your facial expressions can be instantly tracked.
Full 3D Capture
While most other solutions are limited to 2D facial landmarks, our deep learning-based technology directly provides an accurate dense 3D mesh of a person, including 51 facial expressions, and 3D head pose in world space.
Technical Specifications
Deep Learning Model Size
10 MB
Maximum Tracking Angle
Pitch ≤ ±30°, Roll ≤ ±30°, Yaw ≤ ±40°
Tracking Speed
Desktop (GPU): 1000fps, Desktop (CPU): 100fps, Mobile: 45fps
Input
2D RGB Image or Video
Output
51 FACS Expressions (ARKit Compatible), Dense 3D Mesh (incl. 68 Landmarks),
Eye Gaze, Rigid Head Pose
Platforms
iOS
Mac
Windows
Android
