type
Self-Initiated
timeframe
3 months during Spring, 2024
role
User Research, Concept Development, UI/UX Design
category
EdTech / Immersive Learning
Problem
The Work
The Design Thinking process provides a structured yet flexible approach to solving user-centered problems. It begins with empathizing with learners through research techniques like interviews and persona creation to understand their challenges. In the define stage, insights are synthesized to pinpoint core issues, ensuring the solution addresses real needs. The ideation phase encourages creative brainstorming, using techniques like Crazy 8’s and participatory design to explore diverse possibilities. Through prototyping and testing, designs are refined iteratively based on user feedback, ensuring an intuitive and effective learning experience.
01
Design Process
Stanford Design Thinking
The Design Thinking process provides a structured yet flexible approach to solving user-centered problems. It begins with empathizing with learners through research techniques like interviews and persona creation to understand their challenges. In the define stage, insights are synthesized to pinpoint core issues, ensuring the solution addresses real needs. The ideation phase encourages creative brainstorming, using techniques like Crazy 8’s and participatory design to explore diverse possibilities. Through prototyping and testing, designs are refined iteratively based on user feedback, ensuring an intuitive and effective learning experience.
02
Empathise
Understand the User
To build a strong foundation for VRFluent, conducted in-depth user research to understand learners’ needs, challenges, and preferences. Through five interviews and one focus group, we gathered insights directly from users.
Key Findings
Learners want a judgment-free practice environment to build confidence.
Many struggle to find a consistent language partner for real conversations.
A fun and engaging experience keeps motivation high.
Personalized learning that adapts to skill levels is essential for fluency.
Understand the Market
Various language learning apps like Duolingo, Babbel, and Rosetta Stone were analyzed to understand the existing market. While these platforms excel in vocabulary and grammar, they fall short in offering real-world conversational practice and personalized, adaptive learning.
An opportunity was identified here - to create an immersive, AI-powered platform that focuses on interactive conversations, helping users achieve conversational fluency through meaningful, real-life dialogue practice.
Desk Research
03
Define
Persona
Based on the language learning system, a single user persona was defined – the learner, focused on improving conversational skills and achieving greater fluency in the language.
By understanding their needs and challenges, the platform was designed to offer personalized, immersive, and engaging experience. This ensures learners benefit from real-world practice, while receiving adaptive learning tailored to their specific proficiency level, helping them gain confidence in practical language use.
User Journey
Based on a user scenario specifically focused on language learning, the user journey map identified opportunities to resolve the frustrations and challenges faced by learners when practicing speaking skills.
Some of the opportunities uncovered:
- Encourage users to engage in AI-driven, real-time conversations and share their progress to build confidence and create a supportive learning environment.
- Provide personalized learning paths and adaptive AI feedback to tailor the experience to individual goals, interests, and proficiency levels.
- Incorporate gamification, real-world conversation scenarios to maintain motivation and engagement throughout the learning journey.
Ideate
Design Challenges &
Design Decisions
In designing a language learning app with AI avatars, several key challenges emerged that needed to be addressed to create a seamless, engaging, and effective user experience. These challenges included ensuring context-dependent learning, managing cognitive load, maintaining motivation, and reducing the fear of judgment when speaking. Each challenge was met with thoughtful design decisions, using immersive technologies like virtual reality, adaptive learning paths, and supportive AI interactions to enhance the learning experience.
Design System
Testing
A 5-act semi-structured interview approach evaluated the prototype. The process covered study introduction and participant background information, introduced the hi-fi prototype with think-aloud instructions, guided users through key tasks including sign-up, scenario selection, avatar calling, skill testing, and activity tracking, and finally collected overall impressions and improvement suggestions.
Testing revealed several key insights about the prototype:
Users wanted the conversation calling feature positioned more prominently on the home page for easier access.
Needed clearer options to switch between avatar video and audio modes during interactions
Found the skill assessment disconnected from the main learning experience
Expressed uncertainty about next steps after receiving AI feedback
Preferred action buttons positioned before descriptions in the avatar interface.
Iterations
Based on user feedback, targeted changes were implemented to improve the experience. Repositioned the calling feature to the top of the homepage, added clear button for switching between video and audio modes, integrated the skill assessment directly into the main learning flow, implemented clear action prompts following AI feedback screens, and restructured the avatar interface to place action buttons before descriptive text, effectively addressing core usability challenges while enhancing the platform's value proposition.
Final Decisions
Key Features
01
Call with AI Avatars
Practice speaking with lifelike 3D avatars that respond to voice in real time. These intelligent partners help build fluency, improve pronunciation, and gain confidence, just like talking to a native speaker, but without the pressure or embarrassment.
02
Learn section To build Skills
Strengthen targeted language foundation with exercises tailored to vocabulary, grammar, or sentence structure. Choose what to work on and track progress unlocking new levels of language mastery.
03
Scenario Based Learning
Step into everyday situations like ordering food, booking a hotel or job interview through dynamic roleplaying. Respond to prompts in the target language and experience how conversations naturally unfold.
04
Adaptive Lessons & Real-Time Feedback
Lessons adapt to users level, pace, and interests. Get instant AI-feedback on the performance, with corrections, encouragement, and actionable suggestions. Earn rewards and badges while progressing to achieve your goals.
05
Conclusions
Key Takeaways
This project highlighted the importance of personalized learning in creating engaging and effective experiences. By incorporating VR and AI avatars, we provided users with an immersive environment that adapts to their needs. Research on flow theory and immersive learning played a vital role in enhancing user engagement. Continuous feedback from users was crucial in refining the app’s design. The key challenge was balancing innovative technologies like AI avatars and VR with accessibility for all users.
Reflection
As the sole driver of the project, I’ve gained valuable insights into the iterative nature of design. I learned that initial ideas are just a starting point, and user feedback played a crucial role in shaping the app's development. This project deepened my understanding of blending technology with user needs, particularly in language learning. Moving forward, I’m excited to continue refining the app through valuable feedback.
.also see