Jun Zhao, Senior Researcher, Department of Computer Science, University of Oxford
Women in AI at Oxford · Profile Series

Jun Zhao

Working to make AI safer and more ethical for children.

Read

The data being collected from children learning to count and read their first words was being sent to third parties without anyone’s knowledge. For Dr Jun Zhao, the moment she found out was the moment everything changed. Her own children were among them.

Jun came to computing relatively late. While many of her classmates arrived at university already fluent in programming, she was starting from scratch. An early lecturer offered advice she still remembers: ‘Nobody can know everything about computing.’

Her early academic work did not focus on children or digital technology. During her PhD and the first decade of her research career, she worked in computational biology. Advances in genetic sequencing were generating enormous volumes of data, and Jun applied computational methods and AI algorithms to help biologists analyse and interpret those datasets.

‘I was working with biologists…applying AI algorithms to help them process the data and make sense of the data.’

Watch: Jun Zhao in conversation

Jun Zhao in conversation, filmed at the Department of Computer Science, University of Oxford · Watch on YouTube ↗

As a parent, I was outraged

Jun’s research direction shifted unexpectedly after she became a parent in 2015. Around that time, she and her colleagues began investigating how mobile applications collect and transmit data. Their initial work focused broadly on data traffic in freely available apps. What they discovered raised serious concerns. Even apps designed for toddlers learning the alphabet or practising counting were transmitting huge amounts of data to third parties without users’ knowledge or consent.

For Jun, the discovery was personal. ‘As a parent, I was outraged by what was happening to my children’s data.’ That moment marked the beginning of a new research direction that would shape the next decade of her work.

Ten years ago, very few people were talking about the impact of AI on children. Today, Jun leads research at the centre of those debates.

“My research is about trying to work out how to make AI systems and algorithms more ethical for children. It sounds really simple and straightforward, but it’s a very, very complex task.”

Young person scrolling through their social feed

Scrolling through pictures, and data, in a single feed.

A decade of childhood, uploaded

Understanding how algorithms shape children’s lives requires more than theoretical analysis. Jun works directly with children and families, and one study, launched the previous summer, brought that work to life in an unexpected way.

Teenagers from across the world were invited to request their social media data from major platforms and upload it to her team’s server. Using large language models to process the data, the team created interactive visualisations allowing each teenager to see their entire social media history (in some cases spanning ten years of their childhood) and to understand how that data had been used to make inferences about them.

‘We found it really, really encouraging to see how this experience enabled all the teenagers to think a lot more deeply about how they're being perceived by algorithmic systems.’

Nearly a hundred teenagers from Europe, Australia, North America and Japan took part. The volume of data was staggering. ‘I broke our server constantly,’ she says.

Also watch Dr Jun Zhao: Care, Autonomy and Technology
Jun Zhao at the Royal Society
YouTube
“There are no boundaries on the internet.” — Dr Jun Zhao, Senior Researcher, Department of Computer Science, University of Oxford
~100
Teenagers from four continents who contributed their social media data to Jun’s study
10
Years of childhood social media history captured in a single participant’s data upload
7-12
Age range at the centre of Jun’s research into children’s algorithmic experiences
Behind the scenes of filming the Women in AI at Oxford profile series

Behind the camera: filming the Women in AI at Oxford profile series

Choices, literacy and a more diverse field

One thing has consistently surprised her throughout that work. ‘People always think children of this age group have very little understanding about technologies,’ she says of the seven-to-twelves at the centre of her research. ‘But I’m always amazed by how much they actually know.’ Watching children become more conscious of how technology affects their lives through her research interactions, she says, is the most rewarding part of the work.

The implications of that research reach well beyond academic publications. Digital platforms operate across borders while regulation develops at national levels: ‘there are no boundaries on the internet,’ as Jun puts it, and she has become increasingly involved in policy discussions as a result, working with international organisations to translate scientific evidence into practical guidance. ‘A lot of the policies are being launched in the global north,’ she notes, while many countries in the global south face different risks and challenges.

Looking ahead, she wants families to have real choices about the technologies they use and the alternatives available to them. Teachers and parents, she observes, often feel uncertain because technologies are evolving so quickly. ‘They are extremely anxious about not knowing what the harms or impacts are and how to support their children.’ Building stronger AI literacy, for children, parents and teachers alike, is central to what she hopes her research can achieve.

On diversity, she is equally direct and precise. It is not simply a matter of gender balance, she argues, but of the range of perspectives brought to the work itself. Within her own lab, where gender balance is close to equal and the demographics of students and researchers are deliberately varied, she has seen first-hand how different backgrounds surface questions that would otherwise go unasked. A colleague once pointed out that ‘agency,’ a concept central to her framework for ethical AI, is itself a Western idea, one that may not translate across cultures. ‘That is what makes diversity really critical in thinking about responsible innovation, to make sure that everything we are looking at is trying to be as inclusive as possible.’

“AI research doesn’t have to be based in computer science. We need the whole socio-technical infrastructure to make sure that AI is going in the right direction.”

“Never fear what is impossible for you, but always think about what is possible.” — Dr Jun Zhao, Senior Researcher, Department of Computer Science, University of Oxford