Silver Interface, Interaction and User Experience Design · 2024
Mukden Palace Experience Mixed Reality Interface
by Jiayi Chen
- A' Design Award 2024 Silver Winner in Interface, Interaction and User Experience Design
- Awarded April 15, 2024
- CLIENT: Jiayi Chen
- Estimated Number of Design Views: 80,152
- Verification code DD487C8D04 · Verify this award
About Mukden Palace Experience Mixed Reality Interface
Unlike modern museums, which are typically built with innovative digital interactive experiences, those located within cultural landmarks and heritage sites often face a common challenge: the lack of digital experiences. By designing the Mixed Reality interface in the Apple VisionPro, The Palace Museum Interactive Experience, represents a pioneering approach by introducing new ways to display exhibits in heritage museums. This method not only balances preserving cultural artifacts with digital interaction but also sets a pioneering example for heritage museums worldwide.
Jiayi Chen's Mukden Palace Experience Mixed Reality Interface represents a thoughtful convergence of digital interaction design and cultural heritage interpretation, positioning itself within the contemporary discourse surrounding immersive technologies as instruments of historical education and preservation. The work appears to engage with questions central to museum studies and experiential design, namely how emerging technologies might facilitate deeper, more embodied connections between contemporary audiences and historical sites without diminishing the authentic weight of place and tradition. The interface design demonstrates considerable sophistication in its visual hierarchy, employing a warm coral-to-peach gradient that evokes both technological modernity and the warmth of traditional lacquerwork, while the prominent placement of calligraphic characters alongside English translation suggests careful attention to cultural authenticity and accessibility across linguistic communities. The compositional choice to position the user figure with back turned toward the viewer invites a participatory identification, encouraging audiences to imagine themselves similarly engaged in this threshold moment between physical presence and digitally augmented understanding. Technical accomplishment is evident in the seamless integration of the luminous interface panel within the architectural environment, the soft atmospheric rendering of traditional structures providing dignified context without competing for visual attention with the interactive elements. Thematically, the work seems to explore the potential for technology to serve as a bridge across temporal distances, connecting contemporary visitors with historical spaces through layers of interpretive information while maintaining reverence for the original architectural achievements. The choice to visualize the welcome screen as a moment of invitation suggests an understanding of user psychology, recognizing that the threshold experience shapes all subsequent engagement. One might observe how the warm tones suffusing both interface and environment create visual continuity between digital and physical realms, implying that technology here serves integration rather than separation from authentic cultural experience. What possibilities emerge when emerging technologies are designed not merely for novelty but for deepening our relationship with inherited cultural treasures?
Press Kit
- Unique Properties
- Modern Museums typically built with innovative interactive experiences, those located within cultural landmarks and heritage sites often face a common challenge: the lack of such experiences. By using mixed reality design, Mukden Palace Experience, represents a pioneering approach by introducing new ways to display exhibits in heritage museums. This not only balances preserving cultural artifacts with digital interaction but also sets a pioneering example for heritage museums worldwide.
- Dimensions & Packaging
- In our design specifications, button dimensions are set at 16mm x 16mm, with a minimum spacing of 16mm between buttons. The maximum button height is 48mm. Default font size is 16 pixels, with auxiliary text set at 12 pixels, and subtitles and titles reaching up to 48 pixels. We utilize the SF Pro font from Apple Vision Pro, incorporating variations in weight to aid visual hierarchy across different contexts, ensuring users can quickly locate key elements.
- Tags
- Virtual Reality, Interactive Experience, Museum, Vision Pro, Interaction Design, User Experience Design, User Interface Design
- Production Technology
- We utilized Figma and Adobe Photoshop for interface design, supplemented by the macOS Xcode beta 6 virtual machine simulator for usability testing. Following Apple VisionPro's design guidelines, we ensured compliance with minimum button size and spacing requirements, optimizing gesture recognition and eye-tracking for an enhanced museum exploration experience.
- Design Challenge
- The creative challenge lay in deciphering users' true needs amidst their direct but often vague complaints. During primary research, I encountered feedback about exhibit boredom, overly complex audio guides, and lack of video content. By combining internet ethnography with deeper exploration of user motivations, we utilized brainstorming in the ideation phase of design thinking. This led us to discover that users desired immersive digital interactive experiences akin to modern museums.
- Project Duration
- The project commenced in March 2023 in Shenyang, Liaoning Province, China, and concluded its design, development, and testing phases in January 2024 in Plano, Texas, United States.
- Operation Flow
- Users need to wear devices like Apple Vision Pro that support mixed reality display and install our application. They can then immerse themselves in the exhibits using eye-tracking and gesture controls, such as grabbing and zooming. The museum enriches the experience by providing detailed descriptions, further analysis, images, videos, and more for users to explore the exhibits in depth.
- Research
- We conducted field observations, surveys, and interviews to understand user needs, supplemented by internet ethnography. Analyzing this data, we called out "How might we enhance the immersive touring experience for visitors to cultural heritage sites? ". Through user personas, empathy maps, and stakeholder analysis, we addressed key pain points in the user journey, guiding our design process to meet the needs of visitors and stakeholders.
- Inspiration
- The inspiration arose from recognizing the need to strike a balance between digital interactive experiences at cultural heritage sites and preserving their authenticity. Shenyang Palace Museum, as a model, I aimed to offer visitors a more immersive exploration of cultural landmarks through Mixed Reality. Visitors can delve deeper into the historical significance of exhibits, moving beyond mere textual explanations or superficial glances, and truly connecting with the richness of our heritage.
- Image Credits
- Image #1: Photographer Jiayi Chen, Shenyang Palace Museum Interior, 2023.
Image #2: Photographer Jiayi Chen, Shenyang Palace Museum Exterior, 2023.
Image #3: Photographer Jiayi Chen, Shenyang Palace Museum Exhibit, 2023.
Image #4: Photographer Jiayi Chen, Shenyang Palace Museum Visitor Experience, 2023.
Image #5: Photographer Jiayi Chen, Shenyang Palace Museum Interactive Display, 2023.
Colors of Mukden Palace Experience Mixed Reality Interface
Get Mukden Palace Experience Mixed Reality Interface
Automotive and Mixed Reality UI/UX Design
We specialize in creating innovative user experiences for automotive infotainment systems, AR interfaces, and mixed reality applications. With expertise from Toyota and award-winning design capabilities, we transform complex interactions into intuitive, user-centered solutions that delight and…
G0E9 ShopDesign Interview about Mukden Palace Experience Mixed Reality Interface
In designing the Mukden Palace Experience, we deeply understood the importance of preserving traditional museums and ancient architecture. Therefore, we emphasized respecting and safeguarding the authenticity of cultural relics in our digital interactive experience. In addition to providing more detailed information about artifacts, we also focused on providing detailed interpretations of calligraphy and paintings, allowing visitors to gain a deeper understanding of the cultural significance behind history. For artifacts such as ceramics, armor, and jade, we utilized 3D technology to enable visitors to experience these precious relics in a more immersive way. Through these designs, our goal is to respect and carry forward the essence of history while providing visitors with a unique and enriching cultural journey.
In designing the Mukden Palace Experience, my main focus was to strike a delicate balance between innovation and tradition. I wanted to achieve a design that seamlessly integrated modern technology, specifically Apple Vision Pro, with the rich cultural heritage of the Shenyang Palace Museum. By leveraging mixed reality technology, I aimed to provide visitors with an immersive and interactive exploration of the museum's exhibits, while also preserving the authenticity and historical significance of the artifacts.
Additionally, as the first A' Design Award-winning project based on Apple Vision Pro, I was driven by a desire to showcase the project's innovative nature and its potential to inspire future generations of designers. I wanted to demonstrate the possibilities of utilizing emerging technologies in the field of user experience design, particularly in the context of cultural heritage sites. By pushing the boundaries of traditional museum experiences, I hoped to encourage other designers to explore the endless opportunities presented by spatial computing and mixed reality interfaces.
In essence, my main focus in designing the Mukden Palace Experience was to create a truly immersive and educational experience for museum visitors, while also pushing the boundaries of design innovation in the digital age.
Additionally, as the first A' Design Award-winning project based on Apple Vision Pro, I was driven by a desire to showcase the project's innovative nature and its potential to inspire future generations of designers. I wanted to demonstrate the possibilities of utilizing emerging technologies in the field of user experience design, particularly in the context of cultural heritage sites. By pushing the boundaries of traditional museum experiences, I hoped to encourage other designers to explore the endless opportunities presented by spatial computing and mixed reality interfaces.
In essence, my main focus in designing the Mukden Palace Experience was to create a truly immersive and educational experience for museum visitors, while also pushing the boundaries of design innovation in the digital age.
Moving forward, my plans for the award-winning Mukden Palace Experience involve further refinement and expansion, with the ultimate goal of establishing it as a prominent application on the market for Apple Vision Pro users. I aim to continue collaborating with stakeholders, including museum curators, technologists, and user experience experts, to enhance the functionality and usability of the application.
Additionally, I plan to explore opportunities for partnerships and collaborations with other cultural heritage institutions to adapt the Mukden Palace Experience for use in different contexts and settings. By leveraging the flexibility and scalability of mixed reality technology, I envision the potential for this design to be applied to various historical sites and museums around the world, providing visitors with immersive and educational experiences wherever they go.
Furthermore, I am committed to staying updated on the latest advancements in spatial computing and mixed reality interfaces, and integrating new features and functionalities into the Mukden Palace Experience to ensure its relevance and effectiveness in the ever-evolving landscape of digital design.
Overall, my future plans for this award-winning design revolve around continuous improvement, innovation, and expansion, with the aim of making it a benchmark application in the field of cultural heritage and mixed reality experiences.
Additionally, I plan to explore opportunities for partnerships and collaborations with other cultural heritage institutions to adapt the Mukden Palace Experience for use in different contexts and settings. By leveraging the flexibility and scalability of mixed reality technology, I envision the potential for this design to be applied to various historical sites and museums around the world, providing visitors with immersive and educational experiences wherever they go.
Furthermore, I am committed to staying updated on the latest advancements in spatial computing and mixed reality interfaces, and integrating new features and functionalities into the Mukden Palace Experience to ensure its relevance and effectiveness in the ever-evolving landscape of digital design.
Overall, my future plans for this award-winning design revolve around continuous improvement, innovation, and expansion, with the aim of making it a benchmark application in the field of cultural heritage and mixed reality experiences.
It took approximately one month for initial research and ideation, followed by two months of design iteration and usability testing. In total, the concept was developed over a period of about three months. This timeline allowed for thorough exploration of user needs, iterative design refinement, and comprehensive testing to ensure the effectiveness and usability of the final product.
This design was not commissioned; rather, it stemmed from a personal aspiration to innovate and explore the potential of mixed reality in cultural heritage sites. Inspired by the need to bridge the gap between traditional museum experiences and modern interactive technologies, I embarked on this project with a vision to create a more immersive and engaging way for visitors to connect with historical artifacts. By leveraging mixed reality and incorporating user-centered design principles, I aimed to provide an enriching experience that would resonate with both casual visitors and history enthusiasts alike.
Certainly, I do maintain an open stance regarding the potential production or utilization of my design. While there are currently no definitive plans in place for its commercialization, I am open to exploring opportunities for collaboration or partnerships with companies interested in bringing this concept to fruition. Whether through licensing the production rights, co-developing with a manufacturing partner, or even self-production, I am flexible and eager to see this design contribute to enhancing cultural experiences for a broader audience.
The inspiration behind designing this particular type of work stemmed from a desire to address a significant gap in the realm of cultural heritage experiences. Traditional museums often struggle to provide engaging and immersive interactions with historical artifacts, especially within the confines of ancient structures like palaces. Recognizing this challenge, I was motivated to leverage cutting-edge technology, such as mixed reality, to create a solution that would bridge the gap between traditional museum exhibits and modern digital experiences.
Moreover, my personal passion for preserving cultural heritage and making it accessible to a broader audience also fueled the design process. I wanted to create an innovative solution that not only enhances the visitor experience but also preserves the authenticity and historical significance of cultural landmarks like the Mukden Palace. By combining technology with a deep appreciation for history and culture, I aimed to design an experience that resonates with both contemporary audiences and heritage enthusiasts alike.
Moreover, my personal passion for preserving cultural heritage and making it accessible to a broader audience also fueled the design process. I wanted to create an innovative solution that not only enhances the visitor experience but also preserves the authenticity and historical significance of cultural landmarks like the Mukden Palace. By combining technology with a deep appreciation for history and culture, I aimed to design an experience that resonates with both contemporary audiences and heritage enthusiasts alike.
The design of my work was significantly influenced by the introduction of new technologies, particularly the Apple Vision Pro. This innovative technology provided a foundation for creating immersive mixed reality experiences that seamlessly integrate digital content with real-world environments. Drawing inspiration from the capabilities of Apple Vision Pro, I envisioned a design that leverages eye-tracking and gesture controls to enhance the exploration of cultural heritage sites like the Mukden Palace.
Additionally, while I drew inspiration from various sources within the design community, including other designers and their works, the primary driving force behind the design was the potential of emerging technologies to transform the way we interact with historical artifacts and cultural landmarks. By embracing advancements like Apple Vision Pro, I sought to push the boundaries of traditional museum experiences and pave the way for more engaging and immersive interactions in the future.
Additionally, while I drew inspiration from various sources within the design community, including other designers and their works, the primary driving force behind the design was the potential of emerging technologies to transform the way we interact with historical artifacts and cultural landmarks. By embracing advancements like Apple Vision Pro, I sought to push the boundaries of traditional museum experiences and pave the way for more engaging and immersive interactions in the future.
The target customers for this design are visitors to cultural heritage sites, particularly those who visit the Mukden Palace Museum. The design aims to cater to a diverse audience, including history enthusiasts, tourists, families, and children. By providing an immersive and interactive experience, the design seeks to engage visitors of all ages and backgrounds, sparking their curiosity and enhancing their understanding of the historical artifacts and cultural significance of the site. Specifically, the design is tailored to appeal to individuals interested in history, art, and cultural heritage, with a focus on making the museum experience more enjoyable and educational for children and families.
This design stands out from other similar concepts due to its innovative use of mixed reality technology to enhance the museum experience. While there may be other digital interactive experiences in cultural heritage sites, the Mukden Palace Experience distinguishes itself by offering a truly immersive and engaging exploration of historical exhibits.
One key aspect that sets this design apart is its emphasis on preserving the authenticity of cultural artifacts while providing a modern and interactive experience. By incorporating mixed reality technology, the design allows visitors to delve deeper into the exhibits, providing detailed descriptions, 3D visualizations, and interactive elements that enrich their understanding of the historical significance of each artifact.
Additionally, the design's focus on user experience and accessibility sets it apart from other similar concepts. By utilizing eye-tracking and gesture controls, the experience is intuitive and user-friendly, allowing visitors of all ages and backgrounds to interact with the exhibits seamlessly.
Overall, the Mukden Palace Experience stands out for its combination of cutting-edge technology, preservation of cultural heritage, and emphasis on user engagement, making it a unique and memorable experience for museum visitors.
One key aspect that sets this design apart is its emphasis on preserving the authenticity of cultural artifacts while providing a modern and interactive experience. By incorporating mixed reality technology, the design allows visitors to delve deeper into the exhibits, providing detailed descriptions, 3D visualizations, and interactive elements that enrich their understanding of the historical significance of each artifact.
Additionally, the design's focus on user experience and accessibility sets it apart from other similar concepts. By utilizing eye-tracking and gesture controls, the experience is intuitive and user-friendly, allowing visitors of all ages and backgrounds to interact with the exhibits seamlessly.
Overall, the Mukden Palace Experience stands out for its combination of cutting-edge technology, preservation of cultural heritage, and emphasis on user engagement, making it a unique and memorable experience for museum visitors.
The name "Mukden Palace Experience" was inspired by the location of the project and the immersive nature of the design. "Mukden Palace" refers to the historical site where the project is based, which is also known as the Shenyang Imperial Palace or Shenyang Gugong. This palace served as the residence of the early Qing dynasty emperors and is now a UNESCO World Heritage Site.
The term "Experience" was chosen to convey the immersive and interactive nature of the design. By using mixed reality technology, the project aims to provide visitors with a unique and memorable experience of exploring the palace and its exhibits. The word "Experience" also signifies the emphasis on user engagement and participation, inviting visitors to actively interact with the cultural artifacts and historical content presented in the museum.
Overall, the name "Mukden Palace Experience" encapsulates the essence of the project, which is to offer visitors an immersive and enriching experience of the historical site and its treasures through innovative digital interaction.
The term "Experience" was chosen to convey the immersive and interactive nature of the design. By using mixed reality technology, the project aims to provide visitors with a unique and memorable experience of exploring the palace and its exhibits. The word "Experience" also signifies the emphasis on user engagement and participation, inviting visitors to actively interact with the cultural artifacts and historical content presented in the museum.
Overall, the name "Mukden Palace Experience" encapsulates the essence of the project, which is to offer visitors an immersive and enriching experience of the historical site and its treasures through innovative digital interaction.
Figma and Adobe Photoshop were the primary design tools used for this project. Figma is a collaborative interface design tool that allows for the creation of interactive prototypes and user interface designs. It was used for wireframing, creating interface mockups, and designing the overall user experience.
Adobe Photoshop, on the other hand, is a versatile graphic design software widely used for image editing and digital art creation. In this project, Photoshop was utilized for tasks such as image manipulation, creating visual assets, and refining the visual aesthetics of the interface elements.
These tools were chosen for their flexibility, efficiency, and compatibility with the project's requirements. By leveraging the capabilities of Figma and Photoshop, we were able to streamline the design process and create high-quality visual assets that contributed to the overall success of the project.
Adobe Photoshop, on the other hand, is a versatile graphic design software widely used for image editing and digital art creation. In this project, Photoshop was utilized for tasks such as image manipulation, creating visual assets, and refining the visual aesthetics of the interface elements.
These tools were chosen for their flexibility, efficiency, and compatibility with the project's requirements. By leveraging the capabilities of Figma and Photoshop, we were able to streamline the design process and create high-quality visual assets that contributed to the overall success of the project.
The most unique aspect of the "Mukden Palace Experience" design is its utilization of mixed reality technology to enhance the exploration of cultural heritage sites. Unlike traditional museum experiences that rely solely on physical exhibits and textual descriptions, this design offers visitors an immersive journey through history using cutting-edge technology.
By leveraging devices like the Apple Vision Pro and an interactive application, users can engage with exhibits in a more interactive and dynamic manner. They can delve deeper into the historical significance of artifacts, explore detailed descriptions, and even experience 3D renderings of items like ceramics, armor, and jade artifacts.
This blending of physical artifacts with digital interaction creates a truly unique and immersive experience, bridging the gap between the past and the present. It allows visitors to engage with history in a more tangible and memorable way, fostering a deeper appreciation for cultural heritage and historical significance.
By leveraging devices like the Apple Vision Pro and an interactive application, users can engage with exhibits in a more interactive and dynamic manner. They can delve deeper into the historical significance of artifacts, explore detailed descriptions, and even experience 3D renderings of items like ceramics, armor, and jade artifacts.
This blending of physical artifacts with digital interaction creates a truly unique and immersive experience, bridging the gap between the past and the present. It allows visitors to engage with history in a more tangible and memorable way, fostering a deeper appreciation for cultural heritage and historical significance.
For the "Mukden Palace Experience" design, I primarily collaborated with myself, taking on multiple roles throughout the project. As the sole designer, I was responsible for conceptualizing, designing, and implementing the mixed reality interface.
While I didn't collaborate with individuals possessing technical or specialized skills directly, I did rely on resources and documentation provided by companies like Apple for their Vision Pro technology. Additionally, I stayed informed about the latest developments in mixed reality and user experience design to ensure the project's success.
By taking on various roles and staying updated on relevant technologies, I was able to create a comprehensive design that effectively utilized mixed reality to enhance the museum experience at the Mukden Palace.
While I didn't collaborate with individuals possessing technical or specialized skills directly, I did rely on resources and documentation provided by companies like Apple for their Vision Pro technology. Additionally, I stayed informed about the latest developments in mixed reality and user experience design to ensure the project's success.
By taking on various roles and staying updated on relevant technologies, I was able to create a comprehensive design that effectively utilized mixed reality to enhance the museum experience at the Mukden Palace.
Technology plays a central role in the "Mukden Palace Experience" design, particularly through the implementation of mixed reality technology, specifically Apple's Vision Pro platform. This technology allows visitors to immerse themselves in a digital interactive experience while exploring the exhibits at the Mukden Palace Museum.
The use of mixed reality technology enhances the traditional museum experience by providing visitors with additional layers of information, interactivity, and engagement. Through eye-tracking and gesture controls, users can interact with the exhibits in a more intuitive and immersive manner, gaining deeper insights into the cultural significance and historical context of the artifacts on display.
By leveraging technology, this design not only preserves the authenticity of the cultural heritage site but also enhances the visitor experience, making it more engaging, informative, and memorable.
The use of mixed reality technology enhances the traditional museum experience by providing visitors with additional layers of information, interactivity, and engagement. Through eye-tracking and gesture controls, users can interact with the exhibits in a more intuitive and immersive manner, gaining deeper insights into the cultural significance and historical context of the artifacts on display.
By leveraging technology, this design not only preserves the authenticity of the cultural heritage site but also enhances the visitor experience, making it more engaging, informative, and memorable.
The design of the "Mukden Palace Experience" was indeed influenced by extensive data and analytical research. To ensure the effectiveness and relevance of the design, I conducted field research at the Shenyang Palace Museum in Shenyang, Liaoning Province, China. This involved observing how visitors interacted with historical exhibits and identifying any challenges or limitations in their exploration methods.
Through this field research, I discovered that many visitors relied on traditional audio guide devices, which provided fixed explanations activated by entering corresponding numbers. However, this approach lacked novelty and interactivity, particularly for repeat visitors. Additionally, visitors often faced difficulties in obtaining detailed information or clarifications about specific exhibit details in the absence of experts on-site.
Furthermore, I conducted ethnographic research to understand the diverse demographics of visitors to the museum and their expectations. This research revealed a significant interest among visitors in experiencing the integration of heritage sites with technology, indicating a desire for innovative and immersive experiences.
Based on these insights, the design of the "Mukden Palace Experience" aimed to address these challenges and cater to the evolving needs and expectations of visitors. By leveraging mixed reality technology and intuitive interaction methods, the design seeks to enhance the visitor experience, providing them with deeper insights, interactivity, and engagement while exploring the cultural heritage site.
Through this field research, I discovered that many visitors relied on traditional audio guide devices, which provided fixed explanations activated by entering corresponding numbers. However, this approach lacked novelty and interactivity, particularly for repeat visitors. Additionally, visitors often faced difficulties in obtaining detailed information or clarifications about specific exhibit details in the absence of experts on-site.
Furthermore, I conducted ethnographic research to understand the diverse demographics of visitors to the museum and their expectations. This research revealed a significant interest among visitors in experiencing the integration of heritage sites with technology, indicating a desire for innovative and immersive experiences.
Based on these insights, the design of the "Mukden Palace Experience" aimed to address these challenges and cater to the evolving needs and expectations of visitors. By leveraging mixed reality technology and intuitive interaction methods, the design seeks to enhance the visitor experience, providing them with deeper insights, interactivity, and engagement while exploring the cultural heritage site.
Some of the challenges I encountered during the design and realization of the "Mukden Palace Experience" concept included:
Technical Understanding: Given the innovative nature of the project, one of the primary challenges was gaining a comprehensive understanding of the capabilities and technical specifications of the Apple Vision Pro device. This involved delving into the intricacies of the hardware and software components, as well as understanding its limitations and potential for integration with mixed reality experiences.
Parameter Optimization: Ensuring optimal performance and user experience required meticulous parameter optimization, particularly concerning eye-tracking accuracy and gesture interaction. Fine-tuning these parameters was crucial to achieving seamless interaction and minimizing user frustration.
User Interface Design: Designing an intuitive and user-friendly interface for the mixed reality application posed its own set of challenges. Balancing aesthetic appeal with functional usability, while adhering to Apple Vision Pro's design guidelines, required careful consideration of layout, typography, and interactive elements.
Content Integration: Incorporating detailed descriptions, historical analysis, multimedia assets, and 3D experiences for the exhibits presented logistical challenges in terms of content integration and synchronization. Ensuring that the content seamlessly aligned with the user's exploration journey while maintaining coherence and relevance was a complex task.
Testing and Validation: Conducting thorough testing and validation of the mixed reality experience across various devices and user scenarios was essential to identify and address any usability issues or technical glitches. This iterative process required time and resources to refine the design based on user feedback and performance metrics.
Overall, overcoming these challenges involved a combination of technical expertise, creative problem-solving, and iterative design refinement to deliver a compelling and immersive experience for visitors to the Shenyang Palace Museum.
Technical Understanding: Given the innovative nature of the project, one of the primary challenges was gaining a comprehensive understanding of the capabilities and technical specifications of the Apple Vision Pro device. This involved delving into the intricacies of the hardware and software components, as well as understanding its limitations and potential for integration with mixed reality experiences.
Parameter Optimization: Ensuring optimal performance and user experience required meticulous parameter optimization, particularly concerning eye-tracking accuracy and gesture interaction. Fine-tuning these parameters was crucial to achieving seamless interaction and minimizing user frustration.
User Interface Design: Designing an intuitive and user-friendly interface for the mixed reality application posed its own set of challenges. Balancing aesthetic appeal with functional usability, while adhering to Apple Vision Pro's design guidelines, required careful consideration of layout, typography, and interactive elements.
Content Integration: Incorporating detailed descriptions, historical analysis, multimedia assets, and 3D experiences for the exhibits presented logistical challenges in terms of content integration and synchronization. Ensuring that the content seamlessly aligned with the user's exploration journey while maintaining coherence and relevance was a complex task.
Testing and Validation: Conducting thorough testing and validation of the mixed reality experience across various devices and user scenarios was essential to identify and address any usability issues or technical glitches. This iterative process required time and resources to refine the design based on user feedback and performance metrics.
Overall, overcoming these challenges involved a combination of technical expertise, creative problem-solving, and iterative design refinement to deliver a compelling and immersive experience for visitors to the Shenyang Palace Museum.
Submitting my design to an international design competition like A' Design was a decision influenced by several factors. Firstly, I admired the international prestige and recognition associated with the A' Design Awards. I saw it as an opportunity to showcase my design skills on a global platform and gain validation for my work from esteemed professionals in the field.
Moreover, participating in such competitions provides valuable exposure and networking opportunities, allowing me to connect with fellow designers, industry experts, and potential collaborators from around the world. It also offers a chance to benchmark my work against other outstanding designs and learn from their innovative approaches and best practices.
Ultimately, my decision to submit to A' Design was driven by a desire to seek recognition for my design achievements, elevate my professional profile, and contribute to the global design community by sharing my unique perspectives and insights.
Moreover, participating in such competitions provides valuable exposure and networking opportunities, allowing me to connect with fellow designers, industry experts, and potential collaborators from around the world. It also offers a chance to benchmark my work against other outstanding designs and learn from their innovative approaches and best practices.
Ultimately, my decision to submit to A' Design was driven by a desire to seek recognition for my design achievements, elevate my professional profile, and contribute to the global design community by sharing my unique perspectives and insights.
During the design process of this work, I learned several valuable lessons and experienced significant personal growth. Firstly, I deepened my understanding of mixed reality technologies, particularly Apple Vision Pro, and gained proficiency in incorporating them into interactive design solutions. This project provided me with hands-on experience in utilizing eye-tracking and gesture recognition functionalities to enhance user experiences.
Additionally, I honed my skills in user research and empathy-driven design. Through field observations, surveys, and interviews, I gained insights into the diverse needs and preferences of museum visitors, which informed the development of user personas and journey maps. This enabled me to tailor the design to meet the specific needs of different user groups and create a more inclusive and engaging experience for all.
Furthermore, the collaborative nature of this project allowed me to enhance my communication and teamwork skills. Working closely with stakeholders, developers, and other design professionals, I learned to effectively communicate my ideas, solicit feedback, and iterate on designs based on user insights and stakeholder input.
Overall, the designing of this work was a transformative learning experience that not only expanded my technical skills but also deepened my appreciation for the role of design in creating meaningful and impactful experiences for users.
Additionally, I honed my skills in user research and empathy-driven design. Through field observations, surveys, and interviews, I gained insights into the diverse needs and preferences of museum visitors, which informed the development of user personas and journey maps. This enabled me to tailor the design to meet the specific needs of different user groups and create a more inclusive and engaging experience for all.
Furthermore, the collaborative nature of this project allowed me to enhance my communication and teamwork skills. Working closely with stakeholders, developers, and other design professionals, I learned to effectively communicate my ideas, solicit feedback, and iterate on designs based on user insights and stakeholder input.
Overall, the designing of this work was a transformative learning experience that not only expanded my technical skills but also deepened my appreciation for the role of design in creating meaningful and impactful experiences for users.
Grand Interview about Mukden Palace Experience Mixed Reality Interface
Our design philosophy was guided by three key principles: preserving cultural authenticity, prioritizing user immersion, and leveraging cutting-edge technology responsibly. We aimed to enhance visitors' understanding of heritage artifacts without overshadowing their original essence. This balance was achieved by integrating subtle yet powerful mixed-reality interactions that feel natural and intuitive. We also emphasized inclusivity, ensuring the experience would resonate with audiences of diverse ages and cultural backgrounds.
Through field observations and interviews, we discovered that visitors often felt disconnected from static displays, finding them insufficiently engaging. Surveys revealed a demand for more dynamic storytelling and interactive exhibits akin to modern science museums. However, our analysis also highlighted the fear that such technologies might overshadow or distort cultural authenticity. This insight led us to design an experience that harmonizes digital interaction with historical preservation.
My experience with automotive interfaces, particularly in designing for augmented reality head-up displays, provided valuable insights into creating intuitive gesture and eye-tracking controls. In both contexts, users require seamless interaction without cognitive overload. Applying these principles, we prioritized simplicity and clarity, ensuring that gestures such as grabbing and zooming felt natural and aligned with visitors' expectations.
One major challenge was adhering to Apple Vision Pro's strict design guidelines while ensuring the interface complemented the historical aesthetic of Mukden Palace. For example, the color palette and typography needed to reflect the cultural context while maintaining legibility and accessibility. Additionally, ensuring precise eye-tracking and gesture recognition in a museum environment with varying lighting conditions required extensive usability testing and calibration.
These dimensions and typography choices ensure users can interact confidently without errors, especially in a mixed-reality environment where precise actions are critical. The SF Pro font, paired with appropriate weights, helps create a clear visual hierarchy, enabling visitors to focus on key content effortlessly. Such thoughtful details enhance both usability and engagement, making the experience seamless and enjoyable.
Growing up near Mukden Palace, I was deeply inspired by its historical significance. However, I realized many visitors struggled to connect with its rich stories through static displays. This motivated me to bring the past to life using modern technology. In the future, I envision this technology expanding to other heritage sites, enabling global audiences to experience history more intimately and interactively.
We started by studying each artifact's cultural and historical context through archival research and expert consultations. Then, we collaborated with historians and digital artists to recreate 3D models. The digital representations retained fine details while adding interactivity, such as annotations and layered information. This approach ensured an authentic yet engaging experience.
Collaborating across the U.S. and China exposed us to diverse cultural perspectives and technological insights. This broadened our understanding of how global audiences engage with heritage. We incorporated inclusive design principles, such as multilingual support and adaptable features, ensuring accessibility for users from various backgrounds.
Early testers expressed amazement at how the interface allowed them to see artifacts "come alive" but requested more context for their historical significance. This feedback led us to enrich the app with layered storytelling, combining text, videos, and augmented visuals to enhance both understanding and immersion.
I envision this technology bridging the gap between past and present, offering an unprecedented level of engagement. Visitors will no longer passively observe but actively participate in history through dynamic interactions. Moreover, this model could set new standards for cultural preservation, demonstrating how technology can coexist harmoniously with heritage.