Increased Engagement With Students
Live Quiz 🧐 Multiplayer
🥳 38% Increase in user retention
Sharpen Up - Live Quiz
Bhanzu
JAN 2024
As a prominent EdTech company focused on math education, we understand the importance of consistently enhancing our platform to enrich student learning experiences. To address the need for heightened engagement and performance tracking, we initiated the development of a customized quiz module for students aged 6-16. This case study details the UX methodologies we utilized, from user research to design iterations, leading to a solution centered around user needs.
Presently, to keep students engaged during sessions, we conduct quizzes on a third-party platform. However, this platform doesn't allow us to track their performance or keep their data within our system. As a result, we lack visibility into user performance and insights on how to motivate students to stay consistent and enhance their performance.
Problem Statement 😥
Bring more consistency in attendance of the students
Get students involved in session activities and keep them hooked via results of those activities and motivate them to perform better
Introducing a habit loop of Learn>read>practice>get feedback>repeat
What we have to achieve? 🏆
Key metrics
Role
Product designer
Responsibilities
System design
User interface design
Research
Team
Designer (Myself)
Engineering manager
Product manager
Curriculum team
3 Months duration
1000+ Sessions
Adaption with the platform within 1 month (Usability)
Increase in performance
Improved accuracy, speed and proficiency
Reduction in refunds
Due to increased class attendance and satisfaction
83%
Increase in student engagement with Bhanzu
Implementing in-house quizzes as an in-class activity to enhance student engagement and facilitate a cyclical learning process during sessions. This approach enables trainers to assess students' comprehension of topics, motivate them with personalized results, and promote consistency in attendance
Underlying problems 🧐
Advantages of Having Our Own Quizzes Platform 🧩
Attendance and Refund Management
Directly correlates student attendance with refund requests. We have observed that regular attendance reduces the likelihood of refund requests
Enhanced Adoption of Pre & Post Assessments and Student Dashboard
Facilitates increased usage of pre and post assessments as well as the student dashboard.
Effective Performance Tracking
Establishes a foundation for accurately demonstrating improvements in student performance.
Will this project yield results? 🤔
Qualitative research, field research, competitor research
Let’s ask the users 🕵🏻
This research aims to determine if an engaging feature like live quizzes can retain students on our platform and encourage them to attend classes consistently. Additionally, it will explore how providing reports can enhance student performance and encourage regular class attendance.
Questions❓
Questions related to students were prepared and given to educators for better response
Can you recall a memorable experience with quizzes or educational games? (Students)
What do you enjoy most about quizzes in your learning process? (Students)
How do you prefer to receive feedback on your quiz performance? (Parents)
What challenges do you face when engaging with quizzes? (Educators)
How do you think quizzes could help you improve your math skills? (Educators)
Target audience
Educators
Students
Parents
#Engagement
#Learning process
#Skill Improvement
#Challenges
Memory recalls
Competing against each other in team was fun
Playing math quiz games with my child. It was a great bonding experience, and it helped reinforce their learning
Using quizzes as formative assessments in classroom. It helped to gauge student understanding and adjust teaching accordingly
Advantages
Helps practice solving math problems, which improves understanding concepts and gain speed in solving problem
Student progress
Quizzes that provide insights into my child's progress and areas where they need extra help
User desires
Would like to see a variety of question types, like multiple choice and problem-solving. Also, it would be helpful to have explanations for the answers
Would like to see features such as adaptive questioning, progress tracking, and the ability to customise quizzes based on student needs and learning objectives
Disappointments
Prefer feedback that tells where It went wrong and how it can improved. Specific feedback helps learn from mistakes
Sometimes, quizzes can be too difficult, and it's discouraging when it can't be answered correctly.
Prefer feedback that is clear and actionable. It helps to understand how to support my child's learning at home
It's challenging to find quizzes that align with my child's learning level and curriculum
Would like to see progress tracking features, customisable quizzes based on skill level, and explanations for incorrect answers
Opportunities
Quizzes provide students with opportunities to practice and apply math concepts, reinforcing their learning and identifying areas for growth
We found out 👁️🗨️
Major findings from all forms of survey
A glance at our competitors 🥇🥈🥉
Understanding the common practices utilised in designing quiz management platforms
Quizlet
Quizlet makes AI-powered learning tools that let you study anything. Start learning today with our online flashcards, games and expert-written solutions
Vast library of pre-made quizzes covering various subjects and topics
Interactive study tools such as flashcards and games
Community features allowing users to collaborate and share study materials
Limited customisation options for creating quizzes
Free version has restricted access to some features
Feedback on performance may not be as detailed or personalised
Kahoot
Kahoot! is a game-based learning platform that brings engagement and fun to players every year at school, at work, and at home.
Highly engaging platform with multiplayer quiz games
Easy-to-use interface suitable for both educators and students
Gamification elements such as points and leaderboards to motivate learners
Primarily focused on live, synchronous quizzes, which may not suit all learning environments
Limited question types, primarily multiple choice
Free version has limitations on customization and access to premium features
Edmodo
Edmodo is a global education network that provides communication, collaboration, and training tools to enable all learners to reach their full potential.
Integrated learning management system (LMS) with quiz functionality
Collaboration features for teachers, students, and parents
Ability to track student progress and performance over time
Interface can be overwhelming for new users
Customization options for quizzes may be limited compared to specialized quiz platforms
More geared towards classroom management rather than just quiz creation and delivery
Tool name
Pros
Cons
Concerns we have to address 🫡
We heard the users👂🏻
Lack of customisation : Many of the competitors offer limited customization options for quiz creation, which may not meet the diverse needs of educators and students
Limited reports : Some platforms provide limited feedback and analytics capabilities, making it difficult for educators to track student progress effectively.
Complex user interface : The complexity of interfaces, particularly in platforms like Edmodo, may hinder user adoption and lead to frustration among users, especially those new to the platform.
Complex Information architecture : Consolidating diverse communication channels into one interface without overwhelming users required careful consideration of information architecture and UI design
Enhanced Customization Features: Introducing a wide range of customization options for quiz creation (Including pre made curriculum quizzes), allowing educators to tailor quizzes to their specific curriculum, difficulty and teaching style. This could include options for different question types, customizable scoring, and the ability to add multimedia elements.
Comprehensive Feedback and Analytics: Implementing robust live feedback and analytics features (Accuracy, Speed and Proficiency) that provide educators with detailed insights into student performance. This could include analytics on question difficulty, student engagement metrics, and personalized feedback on incorrect answers to aid in remediation. Providing actionable insights from data was essential for operations teams to assess performance and optimize strategies for curriculum improvements
Streamlined User Interface: Simplifying the user interface to improve usability and accessibility, particularly for new users. This could involve conducting usability testing to identify pain points and streamline workflows, as well as providing clear onboarding and support resources for users
Create custom quizzes
Create and customise the quiz experience for students
Edit / replace questions
Choose a question from existing curriculum or create your own
Waiting lobby
Gathering the students in a room before proceeding to live session
Real-time results
See students progressing through every question
Live detailed reports
Live details of every questions answered by the students
Integrating with 100MS
Integrating sharpen up with 100MS for live engagement
Set question difficulty
Generate questions across 3 different difficulty levels
Version 1.0
Final design UI
UI-Design
1000+
Total no. of quizzes created by educators within a month
20+
Average no. of quizzes taken per student
Increased platform engagement
32%
Percentage increase in average quiz scores compared to previous methods
430+
No. of students showing significant improvement in quiz scores
Improved student performance
46%
Increase in student participation rate in quiz compared to previous methods
83%
Percentage of students regularly engaging with our platform
Enhanced student participation
95%
Percentage of educators regularly accessing feedback and analytics
1200+
No. of personalized feedback messages sent to students
Feedback and analytics utilization
52%
Decrease in dropout rates among students enrolled in math course
39%
Percentage decrease in course refunds due to dissatisfaction
Reduction in dropout rates
90%
Percentage of students reporting higher satisfaction with math course
38%
Increase in student retention rate within upgraded math course
Student satisfaction and retention
Overall, the implementation of the user-centric quiz platform has had a profound and positive impact on students engagement, understanding, and achievement in the math course, paving the way for continued success in the future
At last 😇
Increased Engagement: The implementation of the user-centric quiz platform has led to a significant increase in student engagement with math course materials. With interactive quizzes tailored to their learning preferences, students are more motivated to actively participate in learning activities
Improved Understanding: The platform's personalised feedback and analytics have helped students identify areas for improvement and track their progress over time. This has resulted in a deeper understanding of math concepts and improved performance on assessments
Enhanced Learning Experience: By providing students with access to interactive quizzes and timely feedback, the platform has enhanced the overall learning experience. Students report feeling more supported and empowered in their learning journey, leading to higher levels of satisfaction and retention within the math course.
Positive Impact on Achievement: The statistical data indicates a clear positive impact on student achievement, with higher quiz scores and reduced dropout rates among students enrolled in the math course. This demonstrates the effectiveness of the user-centric quiz platform in facilitating student success in math education.
3 weeks after product release, a message from our CEO 🧑🏻💼
What did we achieve? 🤔
3 months after implementation
The company highly values innovative ideas that enhance accuracy, speed, or proficiency. Witnessing firsthand how this product positively impacted the business over six months, I felt immense satisfaction as a designer.
Reflecting on childhood memories of reality shows where teams compete for prizes, I recognized potential in this format. The high-energy engagement, especially as questions become more challenging and contestants race to press a buzzer to answer first, inspired me.
What’s next? 🔮
Introducing Quiz Bowl
A super bowl for quiz with interactive engagements
Coming soon
How user engagement directly affects a business
To collaborate with different stakeholders
To make balanced decisions between user needs and tech-feasibility
To validate design through A/B testing
This project taught me
Personal take aways from this project 🤠
