Lens Studio 5.0 Graduates from Beta with GenAI Suite for AR Creation

Products & Applications

The Engineer

28 Jun 2024 · 3 min read

Snapchat's Lens Studio 5.0 debuts officially, bringing a suite of generative AI tools to the table for AR creators, promising faster development and enhanced creativity beyond its predecessor.

Lens Studio 5.0: A New Era in AR Development

On June 18, 2024, Snapchat announced the official release of Lens Studio 5.0 at the Augmented World Expo (AWE) USA. This marks a significant milestone for the platform, which has been in Beta since its launch at Lens Fest 2023. The new version is designed to enhance productivity, modularity, and speed, making it the go-to tool for Snap AR developers.

What’s New in Lens Studio 5.0

Feature Parity with 4.55: While in Beta, the team focused on achieving feature parity with the previous version (4.55) and introduced several new features.
Plugin System: Developers can now extend Editor capabilities through a plugin system, allowing for more customized workflows.
Team Development Support: Enhanced support for JavaScript, TypeScript, version control, and package management makes it easier for teams to collaborate on projects.
GenAI Suite: A powerful set of AI tools that enable creators to generate custom assets and effects with minimal effort.

From Concept to (Augmented) Reality: The GenAI Suite

The GenAI Suite is a game changer for AR creation in Lens Studio. Powered by SnapML technology, it offers a range of tools designed to simplify the asset creation process. Here are the key features:

AI Assistant: Integrated directly into Lens Studio, the AI Assistant can answer questions and provide guidance throughout the development process.
Asset Generation: With just a text or image prompt, you can generate Lens-ready assets like 3D models, textures, and animations. This saves time and reduces the need for specialized skills.
Effect Creation: The suite also includes tools for creating advanced AR effects, such as dynamic lighting, particle systems, and physics simulations.

How It Works

Prompt Input: Enter a text or image prompt in the GenAI Suite.
Asset Generation: The AI generates assets that are compatible with Lens Studio.
Integration: These assets can be seamlessly integrated into your AR projects without additional coding.

Technical Details and Implementation Notes

Architecture: The GenAI Suite leverages SnapML, a proprietary machine learning framework optimized for real-time performance on mobile devices.
Performance: Benchmarks show that the AI-generated assets are highly optimized, ensuring smooth performance in AR experiences.
Scalability: The plugin system allows developers to scale their projects by adding custom tools and workflows.

Why It Matters to Practitioners

Time Savings: By automating asset creation, the GenAI Suite can significantly reduce development time.
Skill Accessibility: Even creators with limited technical skills can produce high-quality AR content.
Collaboration: Enhanced support for team development features like version control and package management makes it easier to work on large-scale projects.

Getting Started

To get started with Lens Studio 5.0 and the GenAI Suite, visit the official documentation for detailed guides and tutorials. Join us at AWE USA to learn more about building WebAR experiences and creating AR content with the new tools.