Designing Interactive AR for Cultural Sharing

This project explored how augmented reality and multimodal interaction can enhance cultural learning experiences. Together with a multidisciplinary team, we designed and evaluated an interactive AR bulletin board that combined visual, audio, haptic, and touch interactions. By comparing the AR experience with traditional printed posters, we investigated how multimodal interfaces influence usability, engagement, and user preferences.

1. 1Reviewed previous research on AR, multimodal interaction, and cultural learning.
2. 2Designed interactive cultural posters representing four countries.
3. 3Developed multimodal AR experiences using Unity, Vuforia, and custom 3D assets.
4. 4Planned and conducted a controlled user study comparing traditional posters with AR posters.
5. 5Evaluated usability using SUS, measured user experience using MMGS, and collected qualitative feedback.
6. 6Synthesized findings to understand the strengths and limitations of multimodal AR for educational experiences.

• Multimodal AR achieved usability comparable to traditional printed posters.
• Interactive elements increased engagement but did not automatically improve users' overall preference.
• Novel technologies require careful onboarding to avoid cognitive overload.
• Combining traditional media with AR can enrich learning by providing multiple complementary modalities.
• Accessibility and discoverability remain essential considerations when designing multimodal interfaces.

The project resulted in a fully functional interactive AR bulletin board integrating visual, audio, touch, and haptic feedback. Through user evaluations, we demonstrated that while participants found the AR experience engaging, usability alone was not enough to guarantee preference. The project highlighted the importance of balancing innovation with intuitive interaction design.

This project was my first opportunity to design and evaluate a multimodal interactive system from concept to user testing. It strengthened my understanding of how different interaction modalities influence user experience and reinforced the importance of validating design decisions through user evaluation. Working across both design and development also taught me how collaboration between technical and design disciplines can create richer interactive experiences.