Inspiring Formosa Саҳнаороии виртуалии генеративӣ by Hsiaoyi Yu

Inspiring Formosa Саҳнаороии виртуалии генеративӣ by Hsiaoyi Yu is a highly esteemed winner of the very prestigious 2026 Ҷоизаи биринҷии A' Design Award in Дизайни санъати саҳнавӣ, услуб ва манзара Competition Category.

БиринҷСанъати саҳнавӣ· 2026

Inspiring Formosa Саҳнаороии виртуалии генеративӣ

by Hsiaoyi Yu

Client: Formosa Pipe Organ Society

Ҷоизаи биринҷии A' Design Award Winner in Санъати саҳнавӣ Category

6,451

Verified Award Winner

Verify Award Status for #182998

Visit Site View at A' Design Award Press Release Award Badge

Colors

The Design

About Inspiring Formosa Саҳнаороии виртуалии генеративӣ

Inspiring Formosa як системаи саҳнаороии виртуалии генеративӣ барои консертҳои зиндаи органи қубурӣ мебошад. Ба ҷои декоратсияҳои физикӣ, система бо истифода аз муҳаррики зеҳни сунъӣ ва шабакаи 5G бо таъхири кам садои зинда ва ҳаракатҳои органнавозро ба манзараҳои визуалии мутаҳаррик табдил медиҳад. Тасвирҳо тавассути проексияи харитавӣ ба меъмории толор ва қубурҳои орган инъикос мешаванд ва бо рӯшноии саҳна ҳамоҳанг мегарданд. Ин усул аз ҳама гуна тағйир додани толорҳои консертии мероси таърихӣ худдорӣ мекунад ва зарурати сохтан ва интиқоли декоратсияҳоро аз байн мебарад.

The Recognition

About the Ҷоизаи биринҷии A' Design Award

Inspiring Formosa Саҳнаороии виртуалии генеративӣ ғолиби Ҷоизаи биринҷии A' Design Award аст, ки эътирофи басо обрӯманд буда, ба тарҳҳои барҷаста дода мешавад, ки бо эҷодкорӣ, зеҳни тез ва зиракӣ фарқ мекунанд. Ғолибони биринҷ артефактҳои хеле моҳир ва ба таври ҷолиб эҷодкоронаанд, ки таҷрибаи васеъ, тасаввурот ва зеҳни тарроҳони худро тасдиқ мекунанд. Интизор меравад, ки Inspiring Formosa Саҳнаороии виртуалии генеративӣ ашёи хеле қадршуда, мавриди таҳсин ва маҳбуб бошад, ки ба таври назаррас касбӣ ва навоварона аст. Ин тарҳи ғолиби Ҷоизаи биринҷии A' Design Award беҳтарин амалияро дар санъат, илм, тарроҳӣ ва технология дар бар мегирад ва бо диққати худ ба тафсилот аъло аст. Inspiring Formosa Саҳнаороии виртуалии генеративӣ эҳтиёҷотро бо зебоӣ қонеъ мекунад, ба хостаҳо даст мерасонад, эҳсосотро мафтун месозад ва кунҷковиро ҷалб мекунад.

Behind the Design

Press Kit

Credits, team members and technical details provided by the designer.

Unique Properties: Inspiring Formosa is a generative scenography system for live pipe organ concerts. Unlike traditional physical stages, it utilizes an AI engine and 5G to translate live acoustics into dynamic architectural projections instantly. This zero-waste, scalable model solves the restriction of altering heritage venues. Its unique advantage lies in transforming invisible sound into immersive visual art, offering a highly marketable, sustainable touring framework for contemporary performing arts.
Dimensions & Packaging: As a zero-waste virtual scenography, the design possesses no physical dimensions. It utilizes a 5G low-latency multicam system for real-time capture of the organist's movements. The visual engine, powered by TouchDesigner and ITRI's generative AI, processes acoustic data and physical paintings via Gaussian Splash simulations. Outputs are projection-mapped directly onto the venue's architecture and synchronized seamlessly with stage lighting via DMX and ArtNet protocols.
Tags: virtual scenography, stage design, projection mapping, generative art, pipe organ concert, interactive stage, artificial intelligence, 5G technology, immersive environment, total artwork
Production Technology: Realized without physical sets, the virtual scenography uses TouchDesigner as the core engine, integrating generative AI, particle systems, and live video capture. A 5G low-latency multicam setup captures the organist’s hand and pedal movements, feeding data into the engine. AI models analyze live acoustics and process physical paintings via Gaussian Splash simulations. Visuals are projection-mapped onto the venue's architecture, synchronized with stage lighting via DMX and ArtNet protocols.
Design Challenge: Culturally, the challenge was modernizing the pipe organ without compromising its heritage. Technically, national concert halls strictly prohibit physical stage constructions. We overcame this by replacing traditional props with non-invasive projection mapping to create a virtual scenography. Furthermore, synchronizing live acoustics with AI visuals required solving severe latency issues. Integrating a 5G network ensured zero-delay rendering, unifying heritage with dynamic digital scenery.
Research: This applied research aims to sustainably modernize classical performances.
The methodology translates real-time acoustics into visual syntax using an AI engine, 5G networks, and Gaussian Splash simulations.
We tested this with a live organist and audiences at two national venues.
The result is a zero-waste, scalable virtual scenography.
Insights prove this digital model revitalizes cultural heritage, eliminates physical touring waste, and offers a highly marketable theatrical experience.
Inspiration: Inspired by the concept of "Gesamtkunstwerk" (total artwork), we sought to modernize the millennium-old pipe organ. The motivation was to decode classical heritage visually without damaging historical venues. Supported by ITRI's 5G low-latency network and Gaussian Splash AI simulations processing physical paintings, we treated the venue as a breathing instrument. This interdisciplinary research merges sound physics with algorithmic beauty, amplifying human emotion through smart technology.
Project Duration: The project development started in 2021 in Taipei, Taiwan. The first iteration premiered at the National Theater and Concert Hall in Taipei on August 9, 2024. The project was subsequently expanded and exhibited at the Weiwuying National Kaohsiung Center for the Arts in Kaohsiung on October 24, 2025, completing the twin-city curatorial framework.
Operation Flow: Instead of using traditional wooden sets, the stage operates as a living, interactive canvas. As the organist performs, an intelligent system listens to the live melodies and captures her movements. It instantly translates this acoustic energy into fluid, breathing light projections mapped directly onto the venue's walls and organ pipes. This real-time interaction creates a deeply immersive visual journey, offering a breathtaking, zero-waste theatrical experience that static props cannot achieve.
Patents: Copyrights belong to Formosa Pipe Organ Society, 2025.
Image Credits: Image #1: Formosa Pipe Organ Society, Inspiring Formosa, 2025.
Image #2: Formosa Pipe Organ Society, Inspiring Formosa, 2025.
Image #3: Formosa Pipe Organ Society, Inspiring Formosa, 2025.
Image #4: Formosa Pipe Organ Society, Inspiring Formosa, 2025.
Image #5: Formosa Pipe Organ Society, Inspiring Formosa, 2025.