Mystical Forest
Scenery + LUMA AI
Immersive AR experience built with Scenery and Luma AI for Apple Vision Pro.
I was excited to bring together Artifical Intelligence and Augmented Reality to create a playful immersive experience. The experience was interactive, with on-tap elements that make the forest grow around you, audio and haptics to compliment user- triggered interactions. Realistic fog in the Apple Vision Pro. The Material maps from the AI models were altered for more luminous glow.
The experience turned out to be successful and Scenery used it for it's app launch video on App Store.
Tools
Context
What can you create when you combine AI and AR?
Creating immersive AR environments using AI-generated assets and Scenery's built-in features.
Building the experience in Reality Composer Pro.
Approach
3D AI Assets, Custom Material Maps, Interactive features and Immersive elements.
I was eager to combine AI and AR together to create an immersive experience by leveraging Scenery's new features.
Utilized Luma AI to generate initial 3D assets
Refined AI-generated assets with custom material maps created in Photoshop
Developed interactive elements and animations using Scenery's built-in tools
Integrated audio and haptic feedback to enhance immersion
Implemented particle effects and custom shaders for environmental elements
Created a promotional video to showcase the experience-building process
Building the water shader material map in Reality Composer Pro.
Solution
User-triggered events and interactions.
The final AR experience for Apple Vision Pro features:
A cohesive, visually striking environment with AI-generated and custom-refined 3D assets
Interactive elements with smooth animations
Immersive audio and haptic feedback
Particle effects, including fog and a custom water shader for a pond
User-triggered events and interactions (e.g., on-tap actions)
Seamless integration with Apple Vision Pro's capabilities
Geospatial API Tile - Colosseum and SketchFab Whale Asset (purchased)
Takeaways
Enhancing immersive experiences.
Integrating AI-generated 3D assets into an AR experience
Balancing visual fidelity with interactive elements in AR environments
Enhancing immersion and user engagement
