Snapchat, the popular social media platform known for its instant messaging and fun filters, has recently unveiled its latest advancements in augmented reality (AR) through the use of advanced AI technology.
With these new tools and capabilities, Snapchat aims to take AR experiences to the next level, providing users with more creative possibilities and realistic transformations.
Snapchat has offered a sneak peek into its upcoming on-device AI model, which can transform a user's surroundings in real-time using augmented reality.
This innovative technology allows creators to turn a text prompt into a custom lens, enabling users to try on various virtual looks and share them with friends. The new AI model is expected to be officially launched in the coming months, meaning that creators will be making lenses using this model by the end of the year, according to TechCrunch.
A Suite of New AI Tools for Creators to Develop Custom AR Effects
To further empower creators in the development of custom AR effects, Snapchat has introduced a suite of new AI tools through its Lens Studio update.
These tools include new face effects that enable creators to write prompts or upload images to create lenses that completely transform a user's face.
Additionally, the suite offers a feature called Immersive ML, which applies “realistic transformation over the user’s face, body, and surroundings in real-time.” Lens creators can also produce 3D content from text or images, design face masks and patterns, and craft 3D character faces that imitate a user's emotions.
Whether it's turning into a different character or immersing oneself in a new environment, the Immersive ML feature provides users with more engaging and lifelike AR experiences.
Democratizing AR Creation with Generative AI
These generative AI tools allow users to describe a scene, and the AI technology will translate it into a digital environment with which users can interact. This real-time rendering of AI-generated visuals opens up new possibilities for creating dynamic and interactive AR experiences.
By simplifying the AR creation process through prompts, Snapchat aims to make it easier for users without technical knowledge to create their own unique AR experiences. This democratization of AR creation encourages more people to engage with AR technology and unleash their creativity within the Snapchat app.
Furthermore, these advancements in generative AI pave the way for similar developments in virtual reality (VR) experiences, enabling users to generate their own immersive VR experiences through simple prompts.
Snapchat's CEO, Evan Spiegel, recognizes the potential of AI and machine learning in enhancing the platform's offerings. In a recent interview, Spiegel highlighted the company's commitment to improving its machine-learning capabilities to reach state-of-the-art standards.