Neural Network Model Shows Why People with Autism Read Facial Expressions Differently

People with autism spectrum disorder interpret facial expressions differently. A group of Tohoku University researchers have revealed more about how this comes to be. They induced abnormalities into a neural network model to explore the effects on the brain’s learning development.

A Tohoku University Hospital pediatric counseling room.

People with autism spectrum disorder have difficulty interpreting facial expressions.

Using a neural network model that reproduces the brain on a computer, a group of researchers based at Tohoku University have unraveled how this comes to be.

The journal Scientific Reports published the results on July 26, 2021.

"Humans recognize different emotions, such as sadness and anger by looking at facial expressions. Yet little is known about how we come to recognize different emotions based on the visual information of facial expressions," said paper coauthor, Yuta Takahashi.

"It is also not clear what changes occur in this process that leads to people with autism spectrum disorder struggling to read facial expressions."

The research group employed predictive processing theory to help understand more. According to this theory, the brain constantly predicts the next sensory stimulus and adapts when its prediction is wrong. Sensory information, such as facial expressions, helps reduce prediction error.

The artificial neural network model incorporated the predictive processing theory and reproduced the developmental process by learning to predict how parts of the face would move in videos of facial expression. After this, the clusters of emotions were self-organized into the neural network model's higher level neuron space - without the model knowing which emotion the facial expression in the video corresponds to.

The model could generalize unknown facial expressions not given in the training, reproducing facial part movements and minimizing prediction errors.

Following this, the researchers conducted experiments and induced abnormalities in the neurons' activities to investigate the effects on learning development and cognitive characteristics. In the model where heterogeneity of activity in neural population was reduced, the generalization ability also decreased; thus, the formation of emotional clusters in higher-level neurons was inhibited. This led to a tendency to fail in identifying the emotion of unknown facial expressions, a similar symptom of autism spectrum disorder.

A Conceptual diagram of the current study

According to Takahashi, the study clarified that predictive processing theory can explain emotion recognition from facial expressions using a neural network model.

"We hope to further our understanding of the process by which humans learn to recognize emotions and the cognitive characteristics of people with autism spectrum disorder," added Takahashi. "The study will help advance developing appropriate intervention methods for people who find it difficult to identify emotions."

Yuta Takahashi
Department of Psychiatry, Tohoku University Hospital
Email:[email protected]

Published: 05 Aug 2021


Contact details:

Public Relations Division

Tohoku University Public Relations Division 2-1-1, Katahira, Aoba-ku, Sendai, 980-8577

News topics: 
Academic discipline: 
Content type: 

Title: Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework
Authors: Yuta Takahashi, Shingo Murata, Hayato Idei, Hiroaki Tomita & Yuichi Yamashita
Journal: Scientific Reports
DOI: 10.1038/s41598-021-94067-x

Funding information:

This work was partially supported by the Strategic Research Program for Brain Sciences of the Japan Agency for Medical Research and Development ( JP20dm0107076);
Tohoku University Advanced Research Center for Innovations in Next-Generation Medicine; JST CREST (JPMJCR16E2); JSPS KAKENHI (JP21K15723, JP18KT0021, JP19H04998, JP20H00001, JP20H00625); and a JSPS Grant-in-Aid for JSPS Research Fellows (JP19J20281).