Otto

︎Internship: Oterman’s Institute London
︎User Testing and Study of 5000 students across Indian States
︎Duration: April - August 2022

 

 
The Oterman’s team has developed an AI-based bot that can generate questions based on the content, partially grade answers, and generate learning summaries. This will primarily consist of NCERT-based content for classes X, XI, and XII.

‘Otto’ is a study tool built primarily to support the learning of students who cannot otherwise access additional learning support or tutors because of financial or other constraints.

It can help generate learning questions for students and validate answers as right or wrong to help students prepare better for exams and personal revision. It also allows students to create short summaries as revision notes from chapters they have learned.

This tool was designed primarily for students who are from underserved communities, currently residing in an India State or Union Territory, and primarily studying NCERT in classes X, XI, and XII, and who would not otherwise have access to regular tutors or complex digital learning tools.

                                                                 

Tags:
--
Design Research
UX Rsearch
Userbility Testing
Ethnography 
Education Service

Team:
--
Oterman’s Institute

Mentors:
--
Pauldy
Dev Aditya
                            
Project Website︎︎︎

        

---

USER RESEARCH AND TESTING

Because the team used an Agile workflow, many iterations of the User Interface were tested by a large number of participants. We held two focus groups with students in grades 10 and 11 from two North Indian states, New Delhi and Bihar.

Understanding Mental Models of the Participants
We held focus groups in two batches of five participants each. They were first asked to find OTTO on their own for ten minutes with no instructions. This was done to learn how they form mental models for every interaction they have with the product. Mental models help people understand what a product can and cannot do, as well as what kind of value they can expect from it.

Surveys
Questionnaires and surveys are a quick and easy way to learn a lot about a group. We used a Google form to collect quantitative information from the user, as well as a System Usability Scale (SUS). After a ten-minute round, we held an informal discussion with the participants to better understand their needs and how to improve the product.

Directed Questions 
We conducted standard question-and-answer interviews with students, teachers, and principals from the interested schools to learn about their perspectives on the application.

Tree Test
Participants were instructed to navigate the website. Then, similar to a usability test, they are asked to describe where they would go to complete the task. Many of them did not find the Summarizing option and instead focused on the multiple choice questions. This gave us a lot of ideas for changing the UI.