Automatic Emotion and Attention Analysis of Young Children at Home: a ResearchKit Autism Feasibility Study
Journal Article - Open Access
Duke Durham United States
Pagination or Media Count:
Current tools for objectively measuring young childrens observed behaviors are expensive, time-consuming, and require extensive training and professional administration. The lack of scalable, reliable, and validated tools impacts access to evidence-based knowledge and limits our capacity to collect population-level data in non-clinical settings. To address this gap, we developed mobile technology to collect videos of young children while they watched movies designed to elicit autism-related behaviors and then used automatic behavioral coding of these videos to quantify childrens emotions and behaviors. We present results from our iPhone study Autism and Beyond, built on ResearchKits open-source platform. The entire studyfrom an e-Consent process to stimuli presentation and data collectionwas conducted within an iPhone-based app available in the Apple Store. Over 1 year,1756 families with children aged 1272 months old participated in the study, completing 5618 caregiver-reported surveys and uploading 4441 videos recorded in the childs natural settings. Usable data were collected on 87.6 percent of the uploaded videos. Automatic coding identified significant differences in emotion and attention by age, sex, and autism risk status. This study demonstrates the acceptability of an app-based tool to caregivers, their willingness to upload videos of their children, the feasibility of caregiver-collected data in the home, and the application of automatic behavioral encoding to quantify emotions and attention variables that are clinically meaningful and may be refined to screen children for autism and developmental disorders outside of clinical settings. This technology has the potential to transform how we screen and monitor childrens development.
- Medicine and Medical Research