Be the first to test new features of Face AR SDK!
New Background Segmentation Neural Networks On Desktop Devices
Background segmentation used in videos has lately become a must-have feature. Face tracking applications that employ our SDK can carry out background segmentation with stable performance on mid-level iOS and Android devices.
With Face AR SDK release version 0.35, developers can animate and replace backgrounds in videos on desktop devices. This change now makes the background subtraction feature truly cross-platformed.
At the moment, we're focused on improving the functionality of tracking the human's body movements even further, ensuring that the person's hands would not be cropped in a video while the background subtraction effect is being applied. So, keep an eye on the updates!
Background segmentation technology supports devices running on:
- iOS
- Android
- macOS
- Windows (Desktop)
- Unity
Face AR SDK version 0.35: Background segmentation technology demo
Hair Segmentation Support For Windows OS
We've also updated the functionality of our hair segmentation neural networks. Hair recoloring can now be implemented on devices running Windows OS thanks toTFLite inference.
By taking advantage of our hair segmentation technology, developers can excite users with realistic virtual hair dying experiences. Apart from Windows OS, our technology can also work on mobile, ensuring your app stays lightweight and functions well both on iOS and Android devices.
Face AR SDK. Hair segmentation technology demo.
New API To Dynamically Set Different AR Effects In Video Files
The release of Face AR SDK v.035 introduced a new API which developers can utilize to select animated backgrounds, AR face filters, or 3D masks and easily match them with a video file from the device's memory.
Other improvements:
- WebAR: Our SDK will now throw an exception if the effect’s underlying source is not a .zip archive
- Initial support of Apple M1
- Support of non-ASCII symbols in file paths
- Stripping of unnecessary symbols on macOS.
- Removing an unnecessary subset of data from the OpenCV library on macOS
- Removing Metal delegate from TFLite 2.4.1 on macOS
- ARKit face tracking disabled by default
Fixed issues:
- WebAR: Firefox video processing issue
- Android: Orientation fixes
- Android: Sound issues and minor improvements
- Unity: iOS plugin size decreased by 300 megabytes.