Overview
Problem
Static menus, even when they include photos, fail to convey the full reality of a dish. This gap leaves diners guessing, creating uncertainty that leads to safe but unsatisfying choices.
Project Vision
The goal of this project is to enhance the dining experience through AR technology, replacing menu uncertainty with visual clarity and nutritional transparency. This
Eliminates guesswork
Fostering trust between customers and restaurants
Enabling more confident ordering decisions and stronger business relationships.
Project Video
Core Features
Interactive Spatial Menus
Diners can Interact with AR menu naturally through intuitive hand gestures and spatial controls with the help of visual guided navigation, creating a seamless AR dining experience.
Visual & Nutritional Transparency
Enable diners to preview dishes in 3D while accessing essential dietary and nutritional information.
Research
Customer Research
We conducted interviews with 7 participants who had previous experience with traditional paper menus. These conversations revealed more than just the struggle of no visuals—they uncovered key pain points throughout the ordering process, from initial decision-making challenges to post-meal disappointment.
These insights revealed 3 key patterns:
#1 Decision Paralysis & Disappointment
I spend too much time deciding because I'm afraid the food won't match my expectations —then I feel like I wasted money when it doesn't.
#2 Cultural Cuisine Barriers
I want to try ethnic dishes like 'Char Siu Bao,' but when descriptions don't explain or show what it is, I have no idea what I'm ordering.
#3 Awkward Information Seeking
I hate to ask the server a million questions about menu items—I worry they're getting annoyed, and I feel like I'm being high-maintenance.
Desk Research — Why AR over static menus?
To address the dining challenges revealed in our customer research, we explored how AR technology could overcome paper menus' limitations and deliver benefits for both customer experience and business growth.
Research
User Journey
We mapped our persona's dining experience with traditional menus, tracking their actions and thoughts at each stage—from initial excitement to final disappointment. This journey revealed critical friction points where AR intervention could transform the experience.
Synthesis
User Persona
Taking research insights into design, we developed a user persona to identify the ideal user who would gain the most value from the Augmented Reality menu. This persona ensured real-world relevance and guided development by keeping us focused on users’ needs.
How might we create informed dining experiences that help diners make confident ordering decisions through spatial menu exploration?
Ideation
User Flow + Information Architecture
We translated journey insights into a structured user flow and information architecture. This blueprint mapped the optimal user path through each dining stage, ensuring every pain point had a corresponding solution.
Ideation
Developing a Solution
Guided by the User Flow, this application is designed for use with AR glasses. Diners can preview dishes in realistic 3D, customize orders independently, and instantly access dietary information — all through natural spatial interactions. Key features include:
Iteration
Design Decision
After visualizing the concept and gathering feedback, I identified three critical iterations that shaped the final experience. Each iteration prompted me to redefine Augmented Interaction, moving beyond 2D constraints and exploring truly spatial possibilities.
Final Design
High-Fidelity Concept
We translated MenuMagic's technical capabilities into a polished interaction design that demonstrates the complete dining journey, this high-fidelity concept clearly reveals how our spatial interface operates in practice.
LensStudio Prototypes [Proof of Concept]
Moving from concept to reality, We developed a functional prototype using Lens Studio. Despite limited coding experience, I leveraged platform resources and AI assistance to bring core spatial interactions to life, including hand gesture controls and placemat navigation—validating the technical feasibility of our design vision.
Hand gesture menu controls
Hand gesture button controls
Placemat Navigation