AI tutors found as effective as human tutors for newcomers

A research project conducted in Toronto suggests that artificial intelligence (AI) tutors can be as effective as human tutors in supporting English language learning for newcomers and refugees in Canada, while also providing additional support in other aspects of life.

Liz Coulson, Associate Professor in the Department of Language Studies at University of Toronto Mississauga (UTM), said, "With an AI tutor, newcomers don't just learn language skills, they also get exposed to cutting-edge technology that helps them adjust to their new life here in several meaningful ways, and sometimes that's a much richer experience than the communication that takes place in a regular English instruction classroom."

The study's findings will be presented by Coulson and co-project lead Ji-young Shin, UTM Assistant Professor, at Congress 2025. Their research is focused on the role of generative AI (GenAI) in eliminating language barriers and enhancing digital literacy among newly resettled refugees.

The project received funding from Immigration, Refugees and Citizenship Canada (IRCC) and was conducted in partnership with the Syrian Canadian Foundation (SCF). During the research period from April to November 2023, 87 newcomers to Canada, representing 11 nationalities and a number of highly skilled professions, including a judge, a lawyer, and an obstetrician, participated in the SCF English programme.

The study randomly assigned participants to either a control group or an experimental group. Both cohorts attended classroom sessions led by native English-speaking university students, with weekly half-day lessons over an eight-week period. The key variable was in the post-classroom activities: one group received follow-up support from human tutors, while the other worked with GenAI tutors.

Curriculum content was standardised, following consultation with certified educators to ensure a consistent learning sequence regardless of tutor type. Rather than focusing entirely on grammar and vocabulary, the programme prioritised real-life, task-based activities. These included preparing for job interviews and planning a trip within Canada, aiming to closely mirror daily experiences newcomers might encounter.

Improvements in English language proficiency were evaluated using a curriculum-embedded elicited imitation test (EIT) administered before and after the programme. This measured advances in both functional language skills and grammar, allowing for statistical analysis of progress in the two groups.

Shin, who specialises in language education and educational technology, commented, "Our most important finding is that GenAI-enhanced language teaching is just as effective as human tutoring. But when we asked participants to share their experiences through one-on-one interviews, we also discovered that they felt less intimidated by GenAI tutors and freer to ask frequent questions without feeling apologetic."

Further participant feedback revealed that, once familiar with GenAI, newcomers began to rely on it for various everyday tasks, such as searching for housing, creating social media accounts, and practising job-specific conversations. One individual even described GenAI as a friend.

The study's results suggest GenAI technologies like ChatGPT can extend real-life language learning beyond the classroom, especially in contexts where traditional instructor-led resources are limited. Coulson noted being particularly encouraged by the case of a participant from Afghanistan who, following the programme, improved her English proficiency sufficiently to begin applying to university.

Coulson stated, "For the most part, these are highly skilled people who need support in advancing their professions now that they're in Canada. GenAI has the capacity to help them level up their skills, and they appreciate that."

Shin added, "An important implication of this research is that it shows how incorporating innovative technology into language learning, especially for newcomers and refugees, actually helps to break down barriers, enabling them to live a more comfortable life here."