Creating Immersive Experiences with OpenUSD and Digital Twins
Summary
Moment Factory, a global multimedia entertainment studio, uses OpenUSD and digital twins to create immersive events. By simulating real-world experiences in a virtual environment, they can test and refine their designs before deploying them in the real world. This approach streamlines production processes, enhances collaboration, and reduces costs.
The Challenge of Creating Immersive Events
Creating immersive events requires large teams of highly skilled experts with diverse specialties, all using unique tools. To achieve optimal efficiency in their highly complex production processes, Moment Factory looked to implement an interoperable open data format and development platform that could seamlessly integrate all aspects, from concept to operation.
The Solution: OpenUSD and Digital Twins
Moment Factory chose Universal Scene Description, also known as OpenUSD, as the solution. OpenUSD is an extensible framework and ecosystem for describing, composing, simulating, and collaborating within 3D worlds. NVIDIA Omniverse is a software platform that enables teams to develop OpenUSD-based 3D workflows and applications. It provides the unified environment to visualize and collaborate on digital twins in real time with live connections to Moment Factory’s tools.
How Digital Twins Work
Digital twins are virtual representations of physical spaces. They simulate real-world experiences, allowing teams to test and refine their designs before deploying them in the real world. Moment Factory uses digital twins to simulate immersive events, such as live performances and multimedia shows. They create detailed 3D models of the venue, including décor, lighting, and layouts, which can be adjusted and tested remotely.
Benefits of Digital Twins
Digital twins offer several benefits, including:
- Greater Efficiency: Digital twins reduce uncertainty and errors. Visualization tools allow organizers and planners to design spaces right down to the power outlets and light switches, identifying potential issues early.
- Real-Time Collaboration: Stakeholders from around the globe can collaborate on the same project, access shared databases, and explore spaces interactively in real-time. This drastically reduces coordination efforts and associated costs.
- Immersive Previews: Seating arrangements, décor, lighting, and sound can all be previewed and refined in detail before the event.
- Sustainability: Digital twins contribute to greener events by minimizing the need for travel and transportation.
Case Study: Moment Factory’s Blackbox
Moment Factory created a digital twin of their Blackbox, an experimentation and prototyping space. They used USD Composer, a fully customizable foundation application built on NVIDIA Omniverse, to build the digital twin. This allowed them to simulate immersive events before deploying them in the real world.
Developing Omniverse Connectors and Extensions
Moment Factory is continuously building and testing extensions for Omniverse to bring new functionalities and possibilities into their digital twins. They developed an Omniverse Connector for X-Agora, their proprietary multi-display software that allows designers to plan and operate shows.
Best Practices for Using Digital Twins
To get the most out of digital twins, it’s essential to follow best practices:
- Collaboration: Ensure all stakeholders are involved in the planning process to ensure everyone is on the same page.
- Visualization: Use visualization tools to design spaces in detail, identifying potential issues early.
- Testing: Test and refine designs before deploying them in the real world.
The Future of Immersive Events
The future of immersive events is digital. As the capabilities of digital twins expand, software becomes more advanced and user-friendly, offering undeniable benefits: greater efficiency, more options, enhanced sustainability—and reduced costs, time, and coordination efforts.
Table: Benefits of Digital Twins
| Benefit | Description |
|---|---|
| Greater Efficiency | Reduces uncertainty and errors by designing spaces in detail. |
| Real-Time Collaboration | Allows stakeholders to collaborate on the same project in real-time. |
| Immersive Previews | Enables previewing and refining seating arrangements, décor, lighting, and sound before the event. |
| Sustainability | Minimizes the need for travel and transportation, contributing to greener events. |
Table: Tools Used by Moment Factory
| Tool | Description |
|---|---|
| OpenUSD | An extensible framework and ecosystem for describing, composing, simulating, and collaborating within 3D worlds. |
| NVIDIA Omniverse | A software platform that enables teams to develop OpenUSD-based 3D workflows and applications. |
| USD Composer | A fully customizable foundation application built on NVIDIA Omniverse. |
| X-Agora | Moment Factory’s proprietary multi-display software that allows designers to plan and operate shows. |
Conclusion
Moment Factory’s use of OpenUSD and digital twins is transforming the way they create immersive events. By simulating real-world experiences in a virtual environment, they can test and refine their designs before deploying them in the real world. This approach streamlines production processes, enhances collaboration, and reduces costs. As the event industry continues to evolve, digital twins will play an increasingly important role in creating immersive and engaging experiences.