Development of an Augmented Reality Application for Intuitive Infant English Learning

Abstract

In this study, we developed an “English learning AR application for infants” that combines augmented
reality (AR) and deep learning by linking visually familiar objects with English words. Infants,
who are the target users of this study, can visually learn the English words of an object as AR
information by holding a smartphone over an arbitrary object. We constructed 57 types of self-made
datasets, prepared 200 images for each English word, and learned them 300 times. Additionally,
we conducted a system evaluation questionnaire survey for 44 subjects to evaluate this AR application.
After experiencing this application, the subjects evaluated the operability, relevance, readability,
functionality, applicability, and learning effect. Because of the system evaluation questionnaire survey,
although we could obtain high evaluations for many items, the result was that issues remained
in functionality.