Snapchat AI turns prompts into new lens
What is the core functionality of Snapchat's newly introduced on-device AI model?
Snapchat's new on-device AI model can transform a user's surroundings using augmented reality (AR). It will allow creators to turn a text prompt into a custom lens, potentially offering many unique looks for users to try on and share with friends. The model will be available for lens creation by the end of the year. Additionally, Snapchat is releasing a suite of AI tools to help creators make custom AR effects, including face effects, Immersive ML for realistic transformations, and tools for generating 3D assets, face masks, and 3D character heads.
What specific example was given to demonstrate the capabilities of Snapchat's new AI model?
The specific example given to demonstrate the capabilities of Snapchat's new AI model is the transformation of a user's surroundings with augmented reality (AR) based on the text prompt "50s sci-fi film." In the GIF provided, a person's clothing and background change in real-time to match the theme of a 1950s science fiction film. This showcases the AI model's ability to generate custom lenses from text prompts, potentially allowing for a wide range of creative and unique AR experiences for users to try and share with friends.
How does the new AI model on Snapchat transform a user's surroundings using augmented reality?
Snapchat's new AI model transforms a user's surroundings using augmented reality by allowing creators to turn a text prompt into a custom lens3. This capability enables real-time transformation of a user's clothing and background based on the given prompt. The AI model, which is small enough to run on a smartphone, can re-render frames guided by a text prompt, generating vivid AR experiences. This innovative feature opens up a wide range of possibilities for users to experiment with and share unique, creative content with their friends.