Skip to content
A warm gradient of coral and soft peach dominates the central interface panel in Jiayi Chen's Mukden Palace Experience Mixed Reality Interface, floating ethereally against the softly blurred…

Mukden Palace Experience Mixed Reality Interface by Jiayi Chen is a highly esteemed winner of the very prestigious 2024 Silver A' Design Award in Interface, Interaction and User Experience Design Competition Category.


SilverInterface· 2024

Mukden Palace Experience Mixed Reality Interface

by Jiayi Chen

Client: Jiayi Chen

Silver A' Design Award Winner in Interface Category

82,053

Verified Award Winner

Verify Award Status for #160260

Colors

The Design

About Mukden Palace Experience Mixed Reality Interface

Unlike modern museums, which are typically built with innovative digital interactive experiences, those located within cultural landmarks and heritage sites often face a common challenge: the lack of digital experiences. By designing the Mixed Reality interface in the Apple VisionPro, The Palace Museum Interactive Experience, represents a pioneering approach by introducing new ways to display exhibits in heritage museums. This method not only balances preserving cultural artifacts with digital interaction but also sets a pioneering example for heritage museums worldwide.

The Recognition

About the Silver A' Design Award

Mukden Palace Experience Mixed Reality Interface is a Silver A' Design Award winner, an extraordinarily prestigious recognition granted to top-of-the-line, gorgeous, and impressive designs. Silver winners are tremendously brilliant and exceedingly creative works that illustrate the outstanding expertise, talent, and acuity of their designers. Mukden Palace Experience Mixed Reality Interface is expected to be a wonderful, showpiece work that is remarkably professional and profoundly innovative. This Silver A' Design Award-winning design is a highly notable, admired invention that benefits and advances the boundaries of art, science, design, and technology. Mukden Palace Experience Mixed Reality Interface is a vastly envied creation that evokes desires, introduces positive feelings, and sparks amazement and wonderment.

Where to Get It

Automotive and Mixed Reality UI/UX Design

We specialize in creating innovative user experiences for automotive infotainment systems, AR interfaces, and mixed reality applications. With expertise from Toyota and award-winning design capabilities, we transform complex interactions into intuitive, user-centered solutions that delight and engage.

Book Consultation

Interviews

Design Interview

What is the main principle, idea and inspiration behind your design?

In designing the Mukden Palace Experience, we deeply understood the importance of preserving traditional museums and ancient architecture. Therefore, we emphasized respecting and safeguarding the authenticity of cultural relics in our digital interactive experience. In addition to providing more detailed information about artifacts, we also focused on providing detailed interpretations of calligraphy and paintings, allowing visitors to gain a deeper understanding of the cultural significance behind history. For artifacts such as ceramics, armor, and jade, we utilized 3D technology to enable visitors to experience these precious relics in a more immersive way. Through these designs, our goal is to respect and carry forward the essence of history while providing visitors with a unique and enriching cultural journey.

What has been your main focus in designing this work? Especially what did you want to achieve?

In designing the Mukden Palace Experience, my main focus was to strike a delicate balance between innovation and tradition. I wanted to achieve a design that seamlessly integrated modern technology, specifically Apple Vision Pro, with the rich cultural heritage of the Shenyang Palace Museum. By leveraging mixed reality technology, I aimed to provide visitors with an immersive and interactive exploration of the museum's exhibits, while also preserving the authenticity and historical significance of the artifacts.

Additionally, as the first A' Design Award-winning project based on Apple Vision Pro, I was driven by a desire to showcase the project's innovative nature and its potential to inspire future generations of designers. I wanted to demonstrate the possibilities of utilizing emerging technologies in the field of user experience design, particularly in the context of cultural heritage sites. By pushing the boundaries of traditional museum experiences, I hoped to encourage other designers to explore the endless opportunities presented by spatial computing and mixed reality interfaces.

In essence, my main focus in designing the Mukden Palace Experience was to create a truly immersive and educational experience for museum visitors, while also pushing the boundaries of design innovation in the digital age.

What are your future plans for this award winning design?

Moving forward, my plans for the award-winning Mukden Palace Experience involve further refinement and expansion, with the ultimate goal of establishing it as a prominent application on the market for Apple Vision Pro users. I aim to continue collaborating with stakeholders, including museum curators, technologists, and user experience experts, to enhance the functionality and usability of the application.

Additionally, I plan to explore opportunities for partnerships and collaborations with other cultural heritage institutions to adapt the Mukden Palace Experience for use in different contexts and settings. By leveraging the flexibility and scalability of mixed reality technology, I envision the potential for this design to be applied to various historical sites and museums around the world, providing visitors with immersive and educational experiences wherever they go.

Furthermore, I am committed to staying updated on the latest advancements in spatial computing and mixed reality interfaces, and integrating new features and functionalities into the Mukden Palace Experience to ensure its relevance and effectiveness in the ever-evolving landscape of digital design.

Overall, my future plans for this award-winning design revolve around continuous improvement, innovation, and expansion, with the aim of making it a benchmark application in the field of cultural heritage and mixed reality experiences.

Read the Full Interview

Grand Interview

Your innovative approach to balancing digital interaction with cultural preservation in the Mukden Palace Experience Mixed Reality Interface has earned recognition with the Silver A' Design Award - could you share the key principles that guided your design philosophy in creating this groundbreaking museum experience?

Our design philosophy was guided by three key principles: preserving cultural authenticity, prioritizing user immersion, and leveraging cutting-edge technology responsibly. We aimed to enhance visitors' understanding of heritage artifacts without overshadowing their original essence. This balance was achieved by integrating subtle yet powerful mixed-reality interactions that feel natural and intuitive. We also emphasized inclusivity, ensuring the experience would resonate with audiences of diverse ages and cultural backgrounds.

The Mukden Palace Experience Mixed Reality Interface introduces a pioneering solution for heritage sites - what specific research insights led you to identify the gap between traditional museum experiences and modern digital expectations?

Through field observations and interviews, we discovered that visitors often felt disconnected from static displays, finding them insufficiently engaging. Surveys revealed a demand for more dynamic storytelling and interactive exhibits akin to modern science museums. However, our analysis also highlighted the fear that such technologies might overshadow or distort cultural authenticity. This insight led us to design an experience that harmonizes digital interaction with historical preservation.

How did your background in automotive UI/UX design influence your approach to creating the gesture controls and eye-tracking features in the Mukden Palace Experience Mixed Reality Interface?

My experience with automotive interfaces, particularly in designing for augmented reality head-up displays, provided valuable insights into creating intuitive gesture and eye-tracking controls. In both contexts, users require seamless interaction without cognitive overload. Applying these principles, we prioritized simplicity and clarity, ensuring that gestures such as grabbing and zooming felt natural and aligned with visitors' expectations.

Read the Full Interview

Behind the Design

Press Kit

Credits, team members and technical details provided by the designer.

Unique Properties
Modern Museums typically built with innovative interactive experiences, those located within cultural landmarks and heritage sites often face a common challenge: the lack of such experiences. By using mixed reality design, Mukden Palace Experience, represents a pioneering approach by introducing new ways to display exhibits in heritage museums. This not only balances preserving cultural artifacts with digital interaction but also sets a pioneering example for heritage museums worldwide.
Dimensions & Packaging
In our design specifications, button dimensions are set at 16mm x 16mm, with a minimum spacing of 16mm between buttons. The maximum button height is 48mm. Default font size is 16 pixels, with auxiliary text set at 12 pixels, and subtitles and titles reaching up to 48 pixels. We utilize the SF Pro font from Apple Vision Pro, incorporating variations in weight to aid visual hierarchy across different contexts, ensuring users can quickly locate key elements.
Tags
Virtual Reality, Interactive Experience, Museum, Vision Pro, Interaction Design, User Experience Design, User Interface Design
Production Technology
We utilized Figma and Adobe Photoshop for interface design, supplemented by the macOS Xcode beta 6 virtual machine simulator for usability testing. Following Apple VisionPro's design guidelines, we ensured compliance with minimum button size and spacing requirements, optimizing gesture recognition and eye-tracking for an enhanced museum exploration experience.
Design Challenge
The creative challenge lay in deciphering users' true needs amidst their direct but often vague complaints. During primary research, I encountered feedback about exhibit boredom, overly complex audio guides, and lack of video content. By combining internet ethnography with deeper exploration of user motivations, we utilized brainstorming in the ideation phase of design thinking. This led us to discover that users desired immersive digital interactive experiences akin to modern museums.
Research
We conducted field observations, surveys, and interviews to understand user needs, supplemented by internet ethnography. Analyzing this data, we called out "How might we enhance the immersive touring experience for visitors to cultural heritage sites? ". Through user personas, empathy maps, and stakeholder analysis, we addressed key pain points in the user journey, guiding our design process to meet the needs of visitors and stakeholders.
Inspiration
The inspiration arose from recognizing the need to strike a balance between digital interactive experiences at cultural heritage sites and preserving their authenticity. Shenyang Palace Museum, as a model, I aimed to offer visitors a more immersive exploration of cultural landmarks through Mixed Reality. Visitors can delve deeper into the historical significance of exhibits, moving beyond mere textual explanations or superficial glances, and truly connecting with the richness of our heritage.
Project Duration
The project commenced in March 2023 in Shenyang, Liaoning Province, China, and concluded its design, development, and testing phases in January 2024 in Plano, Texas, United States.
Operation Flow
Users need to wear devices like Apple Vision Pro that support mixed reality display and install our application. They can then immerse themselves in the exhibits using eye-tracking and gesture controls, such as grabbing and zooming. The museum enriches the experience by providing detailed descriptions, further analysis, images, videos, and more for users to explore the exhibits in depth.
Image Credits
Image #1: Photographer Jiayi Chen, Shenyang Palace Museum Interior, 2023.
Image #2: Photographer Jiayi Chen, Shenyang Palace Museum Exterior, 2023.
Image #3: Photographer Jiayi Chen, Shenyang Palace Museum Exhibit, 2023.
Image #4: Photographer Jiayi Chen, Shenyang Palace Museum Visitor Experience, 2023.
Image #5: Photographer Jiayi Chen, Shenyang Palace Museum Interactive Display, 2023.

Sponsored

Explore Beyond Designers.org

Discover products, services and opportunities from our advertising partners.

Good Design Deserves Great Recognition

The A' Design Award is an international, juried accolade for good design. Take part in the A' Design Award to get an opportunity to earn meritocratic recognition, gain fame, prestige and publicity for your work. Nominate your work for the A' Design Award and compete for the coveted A' Design Prize.

Nominate