Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/53465, first published .
Automated Detection of Neurodevelopmental Disorders Using Face-to-Face Mobile Technology Among Typically Developing Greek Children: Randomized Controlled Trial

Automated Detection of Neurodevelopmental Disorders Using Face-to-Face Mobile Technology Among Typically Developing Greek Children: Randomized Controlled Trial

Automated Detection of Neurodevelopmental Disorders Using Face-to-Face Mobile Technology Among Typically Developing Greek Children: Randomized Controlled Trial

Original Paper

1Department of Speech and Language Therapy, School of Health Sciences, University of Ioannina, Ioannina, Greece

2Laboratory of New Technologies and Distance Learning, Department of Early Childhood Education, University of Ioannina, Ioannina, Greece

Corresponding Author:

Eugenia I Toki, BSc, MSc, PhD

Department of Speech and Language Therapy

School of Health Sciences

University of Ioannina

Panepistimioupoli B, Rm 148

Ioannina, 45500

Greece

Phone: 30 2651050720

Email: toki@uoi.gr


Background: Neurodevelopmental disorders (NDs) are characterized by heterogeneity, complexity, and interactions among multiple domains with long-lasting effects in adulthood. Early and accurate identification of children at risk for NDs is crucial for timely intervention, yet many cases remain undiagnosed, leading to missed opportunities for effective interventions. Digital tools can help clinicians assist and identify NDs. The concept of using serious games to enhance health care has gained attention among a growing group of scientists, entrepreneurs, and clinicians.

Objective: This study aims to explore the core principles of automated mobile detection of NDs in typically developing Greek children, using a serious game developed within the SmartSpeech project, designed to evaluate multiple developmental domains through principal component analysis (PCA).

Methods: A total of 229 typically developing children aged 4 to 12 years participated in the study. The recruitment process involved open calls through public and private health and educational institutions across Greece. Parents were thoroughly informed about the study’s objectives and procedures, and written consent was obtained. Children engaged under the clinician’s face-to-face supervision with the serious game “Apsou,” which assesses 18 developmental domains, including speech, language, psychomotor, cognitive, psychoemotional, and hearing abilities. Data from the children’s interactions were analyzed using PCA to identify key components and underlying principles of ND detection.

Results: A sample of 229 typically developing preschoolers and early school-aged children played the Apsou mobile serious game for automated detection of NDs. Performing a PCA, the findings identified 5 main components accounting for about 80% of the data variability that potentially have significant prognostic implications for a safe diagnosis of NDs. Varimax rotation explained 61.44% of the total variance. The results underscore key theoretical principles crucial for the automated detection of NDs. These principles encompass communication skills, speech and language development, vocal processing, cognitive skills and sensory functions, and visual-spatial skills. These components align with the theoretical principles of child development and provide a robust framework for automated ND detection.

Conclusions: The study highlights the feasibility and effectiveness of using serious games for early ND detection in children. The identified principal components offer valuable insights into critical developmental domains, paving the way for the development of advanced machine learning applications to support highly accurate predictions and classifications for automated screening, diagnosis, prognosis, or intervention planning in ND clinical decision-making. Future research should focus on validating these findings across diverse populations integrating additional features such as biometric data and longitudinal tracking to enhance the accuracy and reliability of automated detection systems.

Trial Registration: ClinicalTrials.gov NCT06633874; https://clinicaltrials.gov/study/NCT06633874

International Registered Report Identifier (IRRID): RR2-https://doi.org/10.3390/signals4020021

JMIR Form Res 2024;8:e53465

doi:10.2196/53465

Keywords



Child development refers to a child’s growth, in speech, language, hearing, psychomotor, cognitive, and psychoemotional domains [1].

Speech and language development involves verbal and nonverbal communication skills [1]. Speech development refers to a child’s capacity to speak and communicate, starting from infancy with cooing and babbling and leading to single words, phrases, and sentences as the infant matures. It includes voice, articulation, and fluency [1,2]. Language development involves receptive and expressive language processes and includes vocabulary, grammar, syntax, interpreting complicated sentences, and social language use for communication [3,4].

Infancy begins with primary gestures and sounds and progresses to complicated language skills. Hearing underpins speech and language. Early hearing detection with regular hearing screenings [5] contributes toward the early identification and treatment of hearing abnormalities supporting children to communicate with others [6,7].

Psychomotor development refers to gross motor skills, fine motor skills, and visual-motor integration [1]. Thoroughly, gross motor skills involve using and coordinating vast muscle groups to crawl, walk, jump, run, and climb stairs and help children move and play [8]. Fine motor skills involve the coordination of small muscle groups, particularly those in the hands and fingers. Tasks such as picking up small objects, holding a pencil, cutting with scissors, and tying shoelaces require fine motor abilities. Visual-motor integration refers to vision and movement coordination, enabling children to replicate shapes, write, and accomplish various hand-eye coordination activities [1].

Cognitive development is a child’s capacity to problem-solve, think, reason, and understand the environment [9,10]. Genetics, environment, education, and explorative experiences impact cognitive development. Critical thinking includes memory (recalling information), attention (focusing and ignoring distractions), problem-solving, and abstract thinking (the ability to think beyond tangible experiences and grasp abstract notions).

Socioemotional development involves emotional development, social development, self-concept, self-esteem, and emotional intelligence [11]. Emotional development entails not only the awareness and expression of one’s feelings but also the ability to regulate those feelings in an appropriate manner. Emotional development is an important factor affecting children’s well-being and interpersonal relationships [12]. Social development is an aspect of a child’s development focusing on the ability to interact with other people and the capacity to create and sustain connections. Empathy, sharing, taking turns, and a grasp of social standards are all important components of a social life [13]. Self-concept and self-esteem refer to how children think about themselves, their capabilities, and their overall value [11].

Overall, the many aspects of a child’s development are intertwined, and advancement in one area often facilitates development in others. Both the importance of developing gross motor skills as well as cognitive development for school readiness and long-term academic success has been recognized [14], and motor and cognitive developments, along with social and emotional developments, form the 3 main interrelated developmental areas in the early years of learning and development [8]. In an Australian toddler sample, levels of gross motor skills are positively associated with cognitive development [8]. Additional evidence of a close relationship between fine motor abilities and intelligence in children, both with and without a diagnosis of attention-deficit/hyperactivity disorder (ADHD), has been reported. Nevertheless, children diagnosed with ADHD exhibit stronger relationships [15]. Essentially, it is crucial to a child’s healthy growth, learning, and overall well-being to have a comprehensive understanding of their development and to provide help in these areas. Genetics, environment, and individual strengths and obstacles also impact a child’s domain advancement. Tracking and encouraging development in all domains promotes holistic growth and success in school, relationships, and well-being.

The clinical manifestation of abnormal development exhibits notable variations among newborns, toddlers, and teenagers and the impact on young children can be significant, leading to a range of health conditions with detrimental effects on their personal, academic, social, and occupational functioning [16].

Children and adolescents exhibiting deficits in the developmental domains and significantly impacting their quality of life commonly face a disorder [17]. Indeed, neurodevelopmental disorders (NDs) are a set of conditions that often manifest in childhood characterized by deficits in brain development that impact numerous facets of an individual’s capacity to function, including communication, learning, social interaction, behavior, cognitive processes, and emotional well-being [18-20]. The clinical features of various NDs are used to describe the disorders presented in the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders [Fifth Edition]) [21]. DSM-5 defines NDs including intellectual disability, autism spectrum disorders (ASDs), ADHD, specific learning disorder (SLD), and communication disorders [21]. The DSM-5 assigns certain features to the profiles of these disorders, including exaggerations, weaknesses, and delays in reaching developmental milestones [21,22]. A summary of the profile features of included NDs in DSM-5 is shown in Figure 1, which visualizes their patterns.

Figure 1. DSM-5 visualization of included NDs profile patterns. ADHD: attention-deficit/hyperactivity disorder; ASD: autism spectrum disorder; CD: communication disorder; DSM-5: Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition); ID: intellectual disability; ND: neurodevelopmental disorder; SLD: specific learning disorder.

It is essential to distinguish between normal development and disorders that emerge in the early stages of development to understand NDs. This statement refers to the different aspects of human development, including genetic, neural, cognitive, and socioemotional domains [23]. As NDs form a considerable heterogeneous group with a broad spectrum of clinical features characterized by convergent boundaries and common co-occurrence [24], differentiation among NDS is also required. In addition, the early emerging and continuing course of NDs emphasizes the need for early diagnosis and intervention [25].

Developmental tests are required to predict the phenotype of children’s delays in achieving developmental milestones, as well as to monitor their later progress [21]. They obtain information from observation in multiple domains [20], clinical history, and standardized assessments [26-29].

Moreover, assessment processing can be advantageous in distinguishing between these disorders due to their high prevalence and significant interindividual variability [30]. It is crucial to thoroughly test chosen measures for their construct reliability and validity [31]. Besides, new and flexible diagnostic procedures would lead the clinician to consider the type of ND to design proper policies and educational practices, thus facilitating the implementation of well-specialized and individualized comprehensive interventions [23,32].

It is well documented that games play an important role in child development [33-36]. Serious games (SGs) are games created with a primary goal other than pure entertainment [37]. SGs are used in many sectors such as education, training, health care, sustainability projects, marketing purposes, scientific investigation, crisis management, environmental planning, engineering, politics, arts, and more.

SGs have been used in various health issues, encompassing chronic diseases, mental health disorders, rehabilitation with physical activity, substance abuse/management, obesity and eating disorders, geriatric care and cognitive impairment, chronic pain management, and asthma management [38]. In the present era, there has been a notable increase in the use of artificial intelligence (AI) [39-41]. Consequently, integrating AI with SG aims to provide a personalized and engaging health care experience. Diverse AI algorithms have been used to address a range of health concerns through the use of SG, with motor impairment as the most targeted one [42]. Furthermore, SG commonly uses AI for various purposes including rehabilitation, diagnosis, personalized screening, performance assessment, monitoring, risk modeling, drug discovery, and therapy response prediction. The main purposes of AI in an SG have been noted to be (1) disease or disorder detection and (2) user-performance evaluation [42].

Neurodevelopmental difficulties can be monitored through SG, which can be used for screening, early detection, diagnostic assessment, objective measurements, engagement, motivation, and personalized therapy [22,42-44]. Empowered Brain (Brain Power), a wearable technology combining smart glasses with AI-powered software and an augmented reality game, was found to improve social communication and attention in teenagers with ASD and ADHD [45]. A new iPad tool using the TrueDepth camera (Apple, Inc) tracks emotions and attention to diagnose ASD and ADHD, showing 78% and 45% accuracies in tests on adults and children. However, additional research is needed to enhance accuracy [46]. The ADHD360 project aims to create a platform for the early detection and management of ADHD in children interacting with a serious game, “Pizza on Time” using advanced machine learning algorithms. Preliminary results indicate that the system can predict ADHD in participants aged 7-16 years with up to 85% accuracy [47]. Galexia (Pambú! Developers) is a game-based tool designed to diagnose dyslexia in children aged 6-12 years. It is a cost-effective and nonintrusive alternative for large-scale screening, with future work aiming to develop a comprehensive tool for specific learning difficulties [48]. Kim et al [49] used convolutional neural network analysis to explore the correlation between developmental disabilities and motor skills in DoBrain mobile games, revealing significant differences [49].

Diagnostic tests and objective measurements are standardized and repeatable [50] and digital health tools can improve diagnosis time [51]. Additionally, SG can motivate children with neurodevelopmental problems to engage in pleasant upgraded and anxiety-free procedures. These studies collectively highlight the significant advancements and the growing potential of SG and digital diagnostics in ND detection. They underscore the need for continued research to improve accuracy, expand diagnostic capabilities, and ensure these tools are accessible and effective across diverse populations and settings toward individualized, efficient, and effective clinical experiences in communication, cognition, emotion, and behavior.

In this study, we are exploring the key elements of automated detection based on the earlier theoretical developmental domains using a new SG. We conducted a principal component analysis (PCA) on typically developed Greek children as part of this process.


Overview

This section describes the study’s ethical considerations, the study design, the study sample, the SG and activities, data collection sources and formulation, and the analytical procedure.

This study is part of an ongoing research project titled “Smart Computing Models, Sensors, and Early Diagnostic Speech and Language Deficiencies Indicators in Child Communication,” with the acronym “SmartSpeech” funded by the Region of Epirus and supported by European Regional Development Fund.

Ethical Considerations

The study was conducted in accordance with the Declaration of Helsinki and approved by the Research Ethics Committee of the University of Ioannina, Greece (protocol code 18435, approved on May 15, 2020). The project’s nature, purpose, and procedures were thoroughly explained to parents during an informative meeting, ensuring compliance with the General Data Protection Regulation (GDPR). All participating parents gave informed written consent after being provided with detailed information regarding the study’s objectives, procedures, and ethical guidelines. The informed consent process ensured that parents understood the study’s compliance with GDPR. To protect participants’ privacy, the data collected in this study were deidentified. All necessary measures were taken to ensure the confidentiality of participant information throughout the study. No compensation was provided to participants. Care was taken to ensure that no individual participants or users could be identified in any images included in the paper (or its supplementary materials).

Study Design

The research was conducted in educational and health care settings across Greece. As this is a randomized trial, the CONSORT (Consolidated Standards of Reporting Trials) 2010 checklist was used to report information included in this study. Participants were recruited through an open call distributed via private and public health and educational establishments across the country. The recruitment focused on parents of typically developing children aged 4 to 12 years. Parents were invited to informational meetings where the study’s objectives, procedures, and ethical guidelines were explained. This session covered the study’s purpose, the nature of the SG “Apsou” by SmartSpeech Project, and the expected involvement of their children. Parents received comprehensive information about the study during these sessions and were asked to provide informed written consent for their children’s participation to ensure compliance with GDPR and ethical considerations. The study included typically developing preschool and school-aged children without NDs, other medical conditions, or medications that could affect the results. Under clinicians’ face-to-face supervision (2021-2022), children played the SG “Apsou,” designed to measure various developmental domains, including speech, language, psychomotor, cognitive, psychoemotional, and hearing abilities [43]. This structured approach ensured comprehensive and ethical recruitment, engaging parents and children while adhering to ethical guidelines and data protection standards.

The study included 229 preschool and school-age children, 118 (51.5%) of whom were boys, and 111 (48.5%) were girls. The mean age of the children was 6.88 (SD 1.94) years. All the children in the sample were attending typical educational settings. We state that all participants included in the sample completed the whole SG.

The SG Apsou, version 1.0.1, developed within the SmartSpeech project, is designed to detect children at risk of NDs. It offers a web-based platform with various activities targeting different developmental skills, making the assessment process engaging and effective. The game is designed around a narrative plot, allowing players to use existing skills or acquire new ones in a scenario focusing on motivation, narrative, and fun [52]. The digital gamified environment uses video game mechanics to turn evaluation into a game, leveraging the capabilities of Unity (Unity Technologies), a cross-platform game engine, for smooth gameplay with high-quality graphics and animations (Multimedia Appendix 1) [53,54]. The game is designed for mobile devices (Android, iOS, Windows) and collects data from parents, clinicians, and the child’s gameplay, providing a comprehensive data set for analysis [53,54]. The validation process for the Apsou game involves several steps to ensure its effectiveness in assessing NDs, including data analysis using various AI algorithms. The game’s effectiveness is evaluated by comparing the performance of typically developing children and children diagnosed with NDs. The integer-bound neural network outperforms other methods, paving the way for future research to improve the game’s detection effectiveness [22,43].

To assess neurodevelopmental skills, an interdisciplinary team designed this SG based on theories that measure speech and language, psychomotor, cognitive, psychoemotional, and hearing skills. There are 18 main variables in total, and each domain is measured by the child’s performance on specific tasks within the SG activities. The SG software assesses NDs in various domains, and Table 1 (“Apsou” SG variables used to assess NDs Domains) describes the variables used to assess NDs domains.

Table 1. “Apsou” SGa variables used to assess NDb domains.
Domains of assessmentSG ND variables of assessment
Speech and language development
  • Verbal and intellectual ability
  • Verbalization after instruction
  • Targeted voicing activities
  • Articulation
  • Phonology
  • Syntax
  • Pragmatic perception
Psychomotor development
  • Fine motor skills
  • Prewriting skills
  • Spatial orientation
  • Sequencing
Cognitive development
  • Memory
  • Recognition
  • Perception or discrimination
  • Sustained attention
  • Cognitive flexibility
Psychoemotional development
  • Empathy
Hearing
  • Conditioned play audiometry

aSG: serious game.

bND: neurodevelopmental disorder.

Upon completion, the child’s responses are processed and evaluated using a scoring system [43]. The system collects and examines the scores in the 18 variables of the game assessment to create a developmental individualized profile for the child. All variable scores are computed on a scale of 0 to 100.

The SG was developed to collect children’s responses during playtime [53,55], represented as variables that fall into one of these input sources categories: (1) hand moving on the touch screen (ie, forming sequencing procedures, sentence formation, or reordering objects); (2) verbal responding to questions or executing instructions (ie, verbalization after initiation, word recognition [speech to text], used in articulation, pragmatics perception); and (3) clicking buttons and objects or drag and dropping on screen (ie, pictures with animals and shapes)

The SG automatically generated scoring performance for touch screen hand movement responses according to accuracy. The rest of the variables were analyzed as follows.

SmartSpeech uses speech-to-text (STT) to recognize a child’s verbal responses during the SG. Participants were asked to pronounce characters’ names and objects, with predetermined correct answers. CMUSphinx (Carnegie Mellon University), a free, fast, and offline speech-to-text program, was used [56]. A Greek recognition model was constructed and trained in the software [57], detecting the best word to match the child’s input, to determine a correct answer. The software detected the word best matches what the child had said and, consequently, whether the child gave a correct answer or not. The recognized speech responses by the STT software are evaluated to the predetermined set of words that constitute a correct answer and thus turning into scores by assigning 0 to false and 1 to true.

The system is also designed to connect and collect biometric data from the child, such as heart rate and eye-tracking metrics, but these are outside the scope of this study [22,43].

Descriptive statistics were used to analyze typically developing children’s gaming performance. z scores as standardized scores were calculated to provide information about the distance and direction of each observation from the mean value for that specific variable. We examine our variables with a reliability test analysis via the Cronbach α coefficient, which is used to evaluate the internal consistency of our measurements. To reduce the number of original features present in the data set while retaining crucial information, the widely recognized PCA method for dimensionality reduction was used [58]. PCA was used to examine the data structure and determine the main principles for automated detecting NDs. For the analysis following, we used the IBM SPSS Statistics (version 28).


In this study, 229 children (males: n=118, 51.5%; females: n=111, 48.5%) with a mean age of 6.88 (SD 1.94) years (2021-2022) completed the SG different activities and tasks that are meant to assess specific neurodevelopmental issues as described in Figure 2, presenting the study’s CONSORT flow diagram. These tasks are grouped into 18 variables, each related to a different skill. The mean scores and SD of the children’s performance in the 18 variables are listed in Table 2.

Figure 2. The study’s CONSORT flow diagram.
Table 2. Mean scores and SD of the 229 typically developing Greek children’s performance in the 18 variables of the “Apsou” game.
VariableValues, mean (SD)
Verbal and intellectual ability31.00 (10.46)
Verbalization after Instruction15.28 (36.06a)
Targeted voicing activities35.07 (25.19)
Articulation14.57 (16.08a)
Phonology81.12 (24.17)
Syntax37.69 (37.16)
Pragmatic perception83.29 (18.26)
Fine motor skills70.74 (28.54)
Prewriting skills31.27 (18.51)
Spatial orientation36.62 (11.38)
Sequencing60.61 (15.77)
Memory23.29 (21.28)
Recognition26.64 (9.21)
Perception or discrimination38.43 (14.10)
Sustained attention28.40 (8.83)
Cognitive flexibility63.39 (18.74)
Empathy38.25 (13.13)
Conditioned play audiometry26.64 (26.05)

aThe variables are not normally distributed, which can result in an SD greater than the mean due to skewness.

The data set was standardized, and z scores of all the above variables were computed to take values with a mean of 0 (SD 1). This coefficient takes values between 0 and 1, with the higher value resulting in a higher degree of reliability.

For our data set, the Cronbach α coefficient was 0.805, a relatively high value according to the literature [59]. The internal consistency of the data, calculated using the SPSS, was found to be satisfactory. As part of the procedure, the α coefficient was calculated iteratively by removing a variable from the set each time. The coefficients showed slight deviations, but the variable “prewriting skills” had the greatest impact. If this variable is removed from the data set, the α coefficient for the remaining 17 variables is calculated as 0.810. In order to identify the key components in our data, we used PCA to retain as much of the original information as possible. To ensure that PCA was suitable for analyzing the study’s data, we made the following assumptions: the Kaiser-Meyer-Olkin measure of sampling adequacy was calculated at 0.738, greater than 0.70, signifying that the current data was appropriate for applying PCA. Furthermore, the Bartlett test of sphericity (P<.001) was presented in Table 3, rejecting the null hypothesis that the correlations between the variables were all 0. Both tests indicated that this study’s data was suitable for applying PCA.

Table 3. Kaiser-Meyer-Olkin measure of sampling adequacy and Bartlett test for data set’s suitability for PCAa on 18 variables measured in the SGb “Apsou” among 229 typically developing Greek children.
PCAValues
Kaiser-Meyer-Olkin measure of sampling adequacy.738
Bartlett test of sphericity

Approximate chi-square (df)1637.912 (153)

P value<.001

aPCA: principal component analysis.

bSG: serious game.

We first examined the extraction process of the initial components and focused on the initial eigenvalues to understand the significant components. Table 4 shows the commonalities of the variables in our analysis and explains the proportion of each variable’s variance. The values closer to 1 are considered better. “Fine motor skills” (0.863) was the most crucial variable in our observation, while “verbalization after instruction” (0.235) was the least important one.

Table 4. Communalities of the variables in the PCAa.
VariableInitialExtraction
Verbal and intellectual ability1.0000.853
Verbalization after instruction1.0000.235
Targeted voicing activities1.0000.857
Articulation1.0000.786
Phonology1.0000.523
Syntax1.0000.618
Pragmatic perception1.0000.517
Fine motor skills1.0000.863
Prewriting skills1.0000.637
Spatial orientation1.0000.798
Sequencing1.0000.499
Memory1.0000.472
Recognition1.0000.340
Perception or discrimination1.0000.481
Sustained attention1.0000.850
Cognitive flexibility1.0000.731
Empathy1.0000.639
Conditioned play audiometry1.0000.361

aPCA: principal component analysis.

We used the eigenvalue-1 criterion to determine the number of “meaningful” components for this PCA. In Table 5, it is shown that the 5 principal components (PCs) account for a cumulative variance of 61.44% of the initial variance. The 5 PCs with eigenvalues being greater than 1, which was confirmed using the scree plot (Figure 3). Specifically, the PCA revealed new features represented by components PC1-PC5. PC1 accounts for the highest variance (24.914%), followed by PC2 (12.513%), PC3 (11.713%), PC4 (6.657%), and PC5 (5.643%). The first 3 principal components, PC1, PC2, and PC3, explain a total cumulative variance of 49.139% of the initial variance, whereas the other 2 (PC4 and PC5) with an eigenvalue greater than 1 explained a total cumulative variance of 12.301% of the initial variance. In other words, the components explained a total cumulative variance of 61.440% of the initial variance, and as Figure 3 shows, components PC1-PC5 cannot explain all the variability. Thus, we applied a varimax rotation.

Table 5. Total variance explained by principal components.
ComponentInitial eigenvaluesRotation sums of squared loadings

TotalPercentage of varianceCumulative percentageTotalPercentage of varianceCumulative percentage
14.48424.91424.9144.48424.91424.914
22.25212.51337.4272.25212.51337.427
32.10811.71349.1392.10811.71349.139
41.1986.65755.7971.1986.65755.797
51.0165.64361.4401.0165.64361.440
60.9755.41666.857N/AaN/AN/A
70.8314.61671.473N/AN/AN/A
80.8114.50475.977N/AN/AN/A
90.7364.08680.064N/AN/AN/A
100.6923.84283.906N/AN/AN/A
110.6203.44287.348N/AN/AN/A
120.5443.02090.368N/AN/AN/A
130.4852.69593.063N/AN/AN/A
140.4402.44795.510N/AN/AN/A
150.3622.01197.521N/AN/AN/A
160.1901.05498.575N/AN/AN/A
170.1760.97799.551N/AN/AN/A
180.0810.449100N/AN/AN/A

aN/A: data are not applicable or not available.

Figure 3. Eigenvalues of 5 main PCA in a scree plot of NDs measured by the SG “Apsou.” ND: neurodevelopmental disorder; PCA: principal component analysis; SG: serious game.

As such, we used a rotated component matrix using varimax with Kaiser normalization. By doing this, we determined the “loads” placed on the various original features for each of the 5 PCs. Table 6 illustrates the rotated component matrix that reports the stronger correlations between the PCs and the initial variables. The correlation coefficients with absolute values lower than 0.4 are hidden for better readability.

Table 6. Rotated component matrix using varimax rotation.
VariableComponent

12345
Pragmatic perception0.704a
Syntax0.669
Sequencing0.665
Phonology0.615
Memory0.609
Perception or discrimination0.518 0.458
Recognition0.494
Verbal and intellectual ability0.899
Articulation0.877
Empathy0.746
Targeted voicing activities0.925
Spatial orientation0.882
Cognitive flexibility0.806
Sustained attention0.893
Fine motor skills0.820
Conditioned play audiometry0.586
Prewriting skills0.784

aNot applicable.

For each PC, the most critical original features are as follows.

  • PC1: Pragmatic perception, syntax, sequencing, phonology, memory, perception or discrimination, and recognition
  • PC2: Verbal and intellectual ability, articulation, and empathy
  • PC3: Targeted voicing activities, spatial orientation, and cognitive flexibility
  • PC4: Sustained attention, fine motor skills, conditioned play audiometry
  • PC5: Prewriting skills and perception or discrimination

All original variables exhibit correlations with their respective PCs, indicating a strong association among them.

The current PCA indicates the main PCs, PC1-PC5, suggesting accordingly communication skills, speech and language development, vocal processing, cognitive skills and sensory functions, and visual spatial skills.


Principal Findings

This study conducted data analysis on typically developed preschoolers and first school-aged children, exploring the main principles toward automated detection of NDs and the underlying theoretical principles. The age range of 4-12 years was selected for this study because NDs often become apparent during the early school years and persist into adulthood. It is important to identify these disorders early for timely intervention. During this age range, children reach important developmental milestones in speech, language, cognition, and motor skills. By examining this age group, we can gain insight into standard developmental paths and the natural variations within them, and we can carry out a thorough assessment during a crucial stage of growth. This ensures that the “Apsou” serious game can efficiently recognize and assist children at a pivotal moment. This strengthens the significance and influence of the study on early childhood and primary education.

The PCA resulted in 5 PCs, as per the Kaiser rule. Only the PCs having eigenvalues greater than 1 were retained. These components describe a cumulative variance of 61.44%, which is due to the intraindividual differences in children’s performance across some domains [60].

As noted by Van Geert and Van Dijk [61], “intraindividual variability can be defined as differences in the level of a developmental variable within individuals and between repeated measurements.” Developmental change is often preceded by variability, which plays a crucial role in exploration and selection processes.

It has been observed that individuals exhibit a wide range of performances in different tasks, such as verbalization after instruction as shown in Table 2. These variations in performance can be attributed to individual skillfulness, level of readiness, and the acquisition of different skills and milestones. These findings emphasize the complexity of typical development, which is characterized by variations in child developmental rhythm, abilities, and performances at each stage. These results are consistent with other research findings [1,62,63].

It is widely acknowledged that the distinctions observed in child development indicate various developmental phases. Although children may attain developmental milestones at varying ages, the sequence in which they achieve these milestones can differ among children [60,64].

Besides, these results pinpoint findings on preschoolers and first school-aged children as this study establishes the fundamental developmental skills that support the automated digital system’s ability to classify the child’s performance per developmental stage. Relevant findings regarding developmental age have been reported [54]. Further, children may temporarily sample advanced milestones but may not fully master them until later and can jump between stages [60,64]. Thus, individuals’ actions are inherently unique, contributing to the observed variability in human behavior. Diversity is crucial for children's development as it manifests unique problem-solving approaches, highlighting interindividual diversity. The recorded total variation is expected to underline typical multifaceted heterogeneous profiles of children with NDs.

Furthermore, researchers from various scientific fields have shown a growing interest in early human development [65]. This growth in interest can be attributed to the recognition of the wide range of NDs, which are characterized by significant genetic and phenotypic differences. Additionally, there is a critical need to enhance our understanding of the similarities and differences among various syndromes, disorders, and disease processes. The primary focus of studying early human development and predicting neurodevelopmental outcomes is to examine critical aspects such as the presence and progression of distinct physical and neurological characteristics, as well as potential abnormalities in neurobehavioral and psychopathological patterns.

The results of the current study revealed 5 main new features (PC1-PC5). These PCs are logically aligned with the original features to establish their compatibility with the domains examined in the traditional manner of assessing NDs. According to the results of the PCA, the first 3 PCs explain about 50% of the total cumulative variance. Further, this study’s findings agree with the globally accepted theoretical principles [21] and are also in line with other research work as follows.

The first new feature (PC1) explaining the most variance in the PCA, includes original features (1) pragmatic perception, (2) syntax, (3) sequencing, (4) phonology, (5) memory, (6) perception or discrimination, and (7) recognition with the most important loads. These skills are pointing toward communication skills and are in line with the theoretical principles of NDs (intellectual disability, global developmental delay, communication disorders, ASD, ADHD, SLD, motor disorders, and other NDs) [1,3,21] that demonstrate deficiencies in “… mental functions in conceptual (language, reading, writing, mathematics, memory, insight, knowledge, interpretation), social (empathy, compassion, social judgment, communication and interaction skills, amicability, harmony) and practical (personal care, school and/or occupational responsibilities and organization, financial management, entertainment, hobby) aspects …” [66].

It has been found that the second new feature (PC2) is responsible for explaining the second highest variance in the PCA, which includes the original features of verbal and intellectual ability, articulation, and empathy, with the second most significant loads. PC2 indicates speech and language development and is in accordance with recent research underlying that observing a child’s speech and language development is crucial for their emotional well-being, especially in the early years [1,66]. Additionally, as children grow, their speech intelligibility improves over time. Typically, it starts at around 25% by the age of 2 and gradually gets better until they reach complete intelligibility by the age of 4. However, if a child is constantly struggling with their speech and language, such as using infantile language, mispronouncing words, or lacking spontaneous speech, it may indicate a delay in their speech and language development [67,68].

The third new feature (PC3) explains the third most variance in the PCA, including original features (1) targeted voicing activities, (2) spatial orientation, and (3) cognitive flexibility, with the subsequent most necessary loads. The interaction of these 3 original features indicates vocal processing, which is also described in accordance with another research. It is also considered a fundamental predictor of cognitive development along with language development [69]. For example, the observed modulation in pleasure vocalizations underscores an increasing association between the act of looking toward the caregiver (spatial-orientated emotional communication), while a gradual evolution undergoes because of the simultaneous presence of early spontaneous behaviors (vocal activities) and intentionally driven behaviors (cognitive flexibility) [70].

The fourth new feature (PC4) points to cognitive skills and sensory functions and explains the following most variance in the PCA, including original features: (1) sustained attention, (2) fine motor skills, and (3) conditioned play audiometry, with subsequent most important loads. In the same direction, current NDs commonly result in cognitive deficits such as attention and executive function problems [71]. For instance, measurements of visual or auditory sustained attention, vigilance, and impulsivity in children with ADHD often exhibit executive dysfunction-like behavior, which impairs their development. ADHD children have long-term neuropsychological deficits, including poor performance on visual or auditory vigilance tasks, response inhibition, attention, and goal-directed behavior [72]. In addition, children with developmental language impairments often display minor motor impairments [73] and reduced coding of spoken syllables and phonemes [74], which are frequently overlooked. However, identifying and treating nonlanguage impairments is advantageous to aid the children’s language development (ie, phonological processing) [75] preventing in the long run the development of cognitive deficits [76].

Lastly, the fifth new feature (PC5) suggesting visual-spatial skills, explains the next most variance in the PCA, including original features: (1) prewriting skills and (2) perception or discrimination with the later most important loads. In the same direction, it is well established that deficiencies in visual-spatial and visual-perceptual abilities, and difficulties solving problems early, associated with reading and attention problems, while language-based skills and IQ remain normal, are the hallmarks of nonverbal SLD [1]. Further, consistent with previous research, weaknesses in visual-spatial abilities, including prewriting skills, are reported in children at risk of SLD [77]. Moreover, consistent with other studies, a spectrum of visuospatial abilities (or visuospatial dimension), ranging from gifted to impaired abilities, exhibit early impairments in various areas, including visual-spatial attention [78], visual-constructive, spatial working memory and fine motor skills, and poor performances in educational subjects such as mathematics, as well as emotional and social problems [79].

Using a sample of typically developing children is fundamental to establishing a robust normative baseline against which deviations can be measured. By understanding the typical developmental trajectories and their inherent variability, atypical patterns that signify NDs can be more accurately pinpointed. This differentiation between normal developmental variations and clinically significant deviations ensures that automated detection methods are both sensitive and specific. It is interesting to note that the 5 PCA factors identified in this study were also found in a parallel relevant study [80] involving typically developing and ND children. Apsou SG, factor analysis, and machine learning with logistic regression were used to create a strong predictive model. The model achieved an area under curve of 0.730, accuracy of 0.815, F1-score of 0.776, precision of 0.823, and recall of 0.815, clearly indicating the predictive potential of these factors.

A shortcoming of this study is the absence of implementation of a diagnostic test of intelligence. To complement this limitation though, we took into consideration that (1) all the participants were attending the typical educational settings and (2) the Apsou clinical administrators confirmed the nonexistence of NDs in participants using the child's developmental and communicative background provided by the parent, and the observation approach applied during their interaction with the child during the game.

The accuracy of the transcription provided by STT software is a limiting factor in this research. We used the highly accurate CMUSphinx STT program [57], trained to convert adult verbal responses to text, but as the software improves over time, also the accuracy of models relying on these transcripts will improve as well. Further research may also use innovative other open sources for this purpose.

Although PCA is a justified method to reveal the most important features of NDs representing 61.44% of the variance, additional methods can be used to explore features validity like deep learning approaches, genetic and molecular data analysis, machine learning and statistical analysis, biological markers, neurophysiological and electrophysiological measures, nonlinear dimensionality reduction techniques, manifold learning, and more.

These findings have the potential to guide future research toward improving automated classification and prediction. This progress can play a crucial role in the timely and precise identification and treatment of NDs in clinical and educational settings. Understanding typical and atypical developmental patterns, including NDs, can significantly enhance clinical practice with advanced AI tools. Future research should combine these findings with cutting-edge AI and machine learning techniques to explore additional features such as biometric data and longitudinal tracking. This combined effort will not only enhance the accuracy and reliability of automated detection systems but also lead to more effective and personalized interventions. These developments will enable more tailored and holistic approaches to supporting individuals with NDs, ultimately improving their long-term outcomes and quality of life. Furthermore, future studies may strive to validate these findings across diverse populations, ensuring broader applicability and generalizability.

Conclusions

In this study, the main principles for the automated detection of NDs were explored. A sample of 229 typical developed preschoolers and early school-aged children played a unique SG,” Apsou,” developed to measure developmental domains.

Using principal components analysis, we unveiled five core principles, signifying (1) communication skills, (2) speech and language development, (3) vocal processing, (4) cognitive skills and sensory functions, and (5) visual-spatial skills, thus corroborating the theoretical principles regarding typically developmental domains. These findings open the door for future research to harness them for further analysis in refining automated screening, diagnosis, prognosis, and treatment planning to support clinical decision-making on NDs.

Acknowledgments

We would like to express our gratitude to all the participants for their valuable contributions to this study. This study was made possible thanks to the Region of Epirus (Regional Operational Programme “Epirus 2014-2020”) supported by the European Regional Development Fund, which provided funding for the project titled “Smart Computing Models, Sensors, and Early Diagnostic Speech and Language Deficiencies Indicators in Child Communication.” The project’s code was HP1AB-28185 (MIS: 5033088).

Data Availability

The data sets generated and analyzed during this study are not publicly available, as participants did not give written consent for their data to be shared publicly, but they are available from the corresponding author upon reasonable request.

Conflicts of Interest

None declared.

Editorial Notice

This randomized study is registered retrospectively due to limited awareness of trial registration policies at the time of study initiation. The research team obtained all necessary approvals from the Research Ethics Committee of the University of Ioannina, Greece (protocol code 18435, approved on May 15, 2020) but did not recognize the requirement to register for the trial before enrolling participants. The authors confirm that no changes were made to the study design, methods, or outcomes after the trial began.

Multimedia Appendix 1

Apsou version 1.0.1 screenshots.

PDF File (Adobe PDF File), 3738 KB

Multimedia Appendix 2

CONSORT 2010 checklist.

PDF File (Adobe PDF File), 163 KB

  1. Brown KA, Parikh S, Patel DR. Understanding basic concepts of developmental diagnosis in children. Transl Pediatr. Feb 2020;9(Suppl 1):S9-S22. [FREE Full text] [CrossRef] [Medline]
  2. Merino Elia A, Coghill J. A practical guide to assessing and investigating developmental delay. Paediatr Child Health. 2021;31(9):335-339. [CrossRef]
  3. Doghadze I, Gagoshidze T. Language phenotypes in children with autism spectrum disorder, expressive language disorder, and typical language development. Appl Neuropsychol Child. 2023:1-11. [CrossRef] [Medline]
  4. Owens R. Language Development: An Introduction. Hoboken, NJ. Pearson Education, Inc; 2019.
  5. Skarżyński PH, Świerniak W, Gos E, Gocel M, Skarżyński H. Organizational aspects and outcomes of a hearing screening program among first-grade children in the Mazovian region of Poland. Lang Speech Hear Serv Sch. 2021;52(3):856-867. [CrossRef] [Medline]
  6. Kushalnagar R. Deafness and hearing loss. In: Yesilada Y, Harper S, editors. Web Accessibility: A Foundation for Research. London, United Kingdom. Springer; 2019:35.
  7. Olusanya BO, Newton VE. Global burden of childhood hearing impairment and disease control priorities for developing countries. Lancet. 2007;369(9569):1314-1317. [CrossRef] [Medline]
  8. Veldman SLC, Santos R, Jones RA, Sousa-Sá E, Okely AD. Associations between gross motor skills and cognitive development in toddlers. Early Hum Dev. 2019;132:39-44. [CrossRef] [Medline]
  9. Leng Chua B, Tan OS, Sock Wah Chng P. Mediated learning experience: questions to enhance cognitive development of young children. J Cogn Educ Psych. 2017;16(2):178-192. [CrossRef]
  10. Zhang J. Cognitive functions of the brain: perception, attention and memory. arXiv. Preprint posted online on May 30, 2019. 2019. [CrossRef]
  11. LaBelle B. Positive outcomes of a social-emotional learning program to promote student resiliency and address mental health. Contemp Sch Psychol. 2019;27:1-7. [CrossRef]
  12. Malik F, Marwaha R. Developmental stages of social emotional development in children. In: StatPearls. Treasure Island, FL. StatPearls Publishing; 2023.
  13. Perry MA, Creavey K, Arthur E, Chance Humer J, Lundgren PJ, Rivera I. Cultivating emotional intelligence in child welfare professionals: a systematic scoping review. Child Abuse Negl. 2020;110:104438. [CrossRef] [Medline]
  14. Horm D, Norris D, Perry D, Chazan-Cohen R, Halle T. Developmental foundations of school readiness for infants and toddlers: a research to practice report. OPRE Report 2016-07. Education Resources Information Center. 2016. URL: https://eric.ed.gov/?id=ED606689 [accessed 2023-07-30]
  15. Klupp S, Möhring W, Lemola S, Grob A. Relations between fine motor skills and intelligence in typically developing children and children with attention deficit hyperactivity disorder. Res Dev Disabil. 2021;110:103855. [FREE Full text] [CrossRef] [Medline]
  16. Ávila-Álvarez A, Alonso-Bidegain M, Ramos-Veiguela D, Iglesias-Jove E, De-Rosende-Celeiro I. Changes in social functioning and engagement during canine-assisted intervention for children with neurodevelopmental disorders in the context of an early intervention service. Res Dev Disabil. 2022;124:104216. [FREE Full text] [CrossRef] [Medline]
  17. Ansari AN, Rizvi NF. School‐based interventions promoting social capabilities among students: a scoping review of literature. Rev Educ. 2023;11(2):e3404. [CrossRef]
  18. Fletcher-Watson S, Bird G. Autism and empathy: What are the real links? Autism. 2020;24(1):3-6. [CrossRef] [Medline]
  19. Harris JC. New classification for neurodevelopmental disorders in DSM-5. Curr Opin Psychiatry. 2014;27(2):95-97. [CrossRef] [Medline]
  20. Thapar A, Cooper M, Rutter M. Neurodevelopmental disorders. Lancet Psychiatry. 2017;4(4):339-346. [CrossRef] [Medline]
  21. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th Edition. Washington, DC. American Psychiatric Association; 2013.
  22. Toki EI, Tatsis G, Tatsis VA, Plachouras K, Pange J, Tsoulos IG. Employing classification techniques on SmartSpeech biometric data towards identification of neurodevelopmental disorders. Signals. 2023;4(2):401-420. [CrossRef]
  23. D'Souza H, Karmiloff-Smith A. Neurodevelopmental disorders. Wiley Interdiscip Rev Cogn Sci. 2017;8:e1398. [FREE Full text] [CrossRef] [Medline]
  24. Bardoloi PS. Management of aggressive behaviors in neurodevelopmental disorders—role of α 2 agonists. Act Sci Neurol. 2023;6(2):20-25. [CrossRef]
  25. Hadders-Algra M. Early diagnostics and early intervention in neurodevelopmental disorders-age-dependent challenges and opportunities. J Clin Med. 2021;10(4):861. [FREE Full text] [CrossRef] [Medline]
  26. Bayley N. Bayley Scales of Infant and Toddler Development, 3rd Edition. New York, NY. Psychological Corporation; 2005.
  27. Green E, Stroud L, O'Connell R, Bloomfield S, Cronje J, Foxcroft C, et al. Griffiths III part II manual: administration and scoring. WPS. 2017. URL: https://www.wpspublish.com/griffiths-iii-part-ii-manual-administration-and-scoring.html [accessed 2024-08-09]
  28. Elliott CD, Salerno JD, Dumont R, Willis JO. Differential Ability Scales-II. San Antonio, TX. Pearson; 2007.
  29. Hadders-Algra M, Tacke U, Pietz J, Rupp A, Philippi H. Standardized Infant NeuroDevelopmental Assessment developmental and socio-emotional scales: reliability and predictive value in an at-risk population. Dev Med Child Neurol. 2020;62(7):845-853. [FREE Full text] [CrossRef] [Medline]
  30. Vitulano LA, Vitulano ML, King RA, Leckman JF. Neurodevelopmental disorders: motor disorders. In: Tasman A, Kay J, Lieberman JA, First MB, Riba MB, editors. Psychiatry, 4th Edition. Chichester, West Sussex. John Wiley & Sons, Inc; 2015:779-790.
  31. Farmer C, Golden C, Thurm A. Concurrent validity of the differential ability scales, second edition with the Mullen Scales of Early Learning in young children with and without neurodevelopmental disorders. Child Neuropsychol. 2016;22(5):556-569. [FREE Full text] [CrossRef] [Medline]
  32. Morris-Rosendahl DJ, Crocq MA. Neurodevelopmental disorders—the history and future of a diagnostic concept. Dialogues Clin Neurosci. 2020;22(1):65-72. [FREE Full text] [CrossRef] [Medline]
  33. Sulistyaningtyas RE, Fauziah PY. The implementation of traditional games for early childhood education. 2019. Presented at: Proceedings of the 3rd International Conference on Current Issues in Education (ICCIE 2018); July 01, 2019; Yogyakarta, Indonesia. [CrossRef]
  34. Boyan A, Sherry JL. The challenge in creating games for education: aligning mental models with game models: challenge and educational games. Child Dev Perspect. 2011;5(2):82-87. [CrossRef]
  35. Ornaghi V, Brockmeier J, Gavazzi IG. The role of language games in children's understanding of mental states: a training study. J Cogn Dev. 2011;12(2):239-259. [CrossRef]
  36. Gros B. Digital games in education: the design of games-based learning environments. J Res Technol Educ. 2007;40(1):23-38. [CrossRef]
  37. RE MV, Gasparini I, da S, Hounsell M. Serious game design for children: validating a set of guidelines. 2019. Presented at: 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT); July 15-18, 2019:110-112; Orem, UT. [CrossRef]
  38. Damaševičius R, Maskeliūnas R, Blažauskas T. Serious games and gamification in healthcare: a meta-review. Information. 2023;14(2):105. [CrossRef]
  39. Luongo M, Simeoli R, Marocco D, Milano N, Ponticorvo M. Enhancing early autism diagnosis through machine learning: exploring raw motion data for classification. PLoS One. 2024;19(4):e0302238. [FREE Full text] [CrossRef] [Medline]
  40. Lindhiem O, Goel M, Shaaban S, Mak KJ, Chikersal P, Feldman J, et al. Objective measurement of hyperactivity using mobile sensing and machine learning: pilot study. JMIR Form Res. 2022;6(4):e35803. [FREE Full text] [CrossRef] [Medline]
  41. Welch V, Wy TJ, Ligezka A, Hassett LC, Croarkin PE, Athreya AP, et al. Use of mobile and wearable artificial intelligence in child and adolescent psychiatry: scoping review. J Med Internet Res. 2022;24(3):e33560. [FREE Full text] [CrossRef] [Medline]
  42. Abd-Alrazaq A, Abuelezz I, Hassan A, AlSammarraie A, Alhuwail D, Irshaidat S, et al. Artificial intelligence-driven serious games in health care: scoping review. JMIR Serious Games. 2022;10(4):e39840. [FREE Full text] [CrossRef] [Medline]
  43. Toki EI, Tatsis G, Tatsis VA, Plachouras K, Pange J, Tsoulos IG. Applying neural networks on biometric datasets for screening speech and language deficiencies in child communication. Mathematics. 2023;11(7):1643. [CrossRef]
  44. Toma M, Turcu CE, Turcu CO, Vlad S, Tiliute DE, Pascu P. Extended reality-based mobile app solutions for the therapy of children with autism spectrum disorders: systematic literature review. JMIR Serious Games. 2024;12:e49906. [FREE Full text] [CrossRef] [Medline]
  45. Keshav NU, Vogt-Lowell K, Vahabzadeh A, Sahin NT. Digital attention-related augmented-reality game: significant correlation between student game performance and validated clinical measures of attention-deficit/hyperactivity disorder (ADHD). Children. 2019;6(6):72. [FREE Full text] [CrossRef] [Medline]
  46. Piazzalunga C, Molino P, Giangregorio C, Fontolan S, Termine C, Ferrante S. Development and validation of an iPad-based serious game for emotion recognition and attention tracking towards early identification of autism. 2023. Presented at: 2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW); Sept 10-13, 2023:1-8; Cambridge, MA. [CrossRef]
  47. Pandria N, Petronikolou V, Lazaridis A, Karapiperis C, Kouloumpris E, Spachos D, et al. Information system for symptom diagnosis and improvement of attention deficit hyperactivity disorder: protocol for a nonrandomized controlled pilot study. JMIR Res Protoc. 2022;11(9):e40189. [FREE Full text] [CrossRef] [Medline]
  48. Rextina G, Asghar S, Stockman T, Khan A. Serious game for dyslexia screening: design and verification. Int J Hum Comput Interact. 2024:1-17. [CrossRef]
  49. Kim HH, An JI, Park YR. A prediction model for detecting developmental disabilities in preschool-age children through digital biomarker-driven deep learning in serious games: development study. JMIR Serious Games. 2021;9(2):e23130. [FREE Full text] [CrossRef] [Medline]
  50. Wiley K, Robinson R, Mandryk RL. The making and evaluation of digital games used for the assessment of attention: systematic review. JMIR Serious Games. 2021;9(3):e26449. [FREE Full text] [CrossRef] [Medline]
  51. Ponzo S, May M, Tamayo-Elizalde M, Bailey K, Shand A, Bamford R, et al. App characteristics and accuracy metrics of available digital biomarkers for autism: scoping review. JMIR Mhealth Uhealth. 2023;11:e52377. [CrossRef] [Medline]
  52. Vacca RA, Augello A, Gallo L, Caggianese G, Malizia V, La Grutta S, et al. Serious games in the new era of digital-health interventions: a narrative review of their therapeutic applications to manage neurobehavior in neurodevelopmental disorders. Neurosci Biobehav Rev. 2023;149:105156. [FREE Full text] [CrossRef] [Medline]
  53. Toki EI, Zakopoulou V, Tatsis G, Plachouras K, Siafaka V, Kosma E, et al. A game-based smart system identifying developmental speech language disorders in child communication: a protocol towards digital clinical diagnostic procedures. In: Auer ME, Tsiatsos T, editors. New Realities, Mobile Systems and Applications: Proceedings of the 14th IMCL Conference. Cham, Switzerland. Springer; 2022:559-568.
  54. Toki EI, Zakopoulou V, Tatsis G, Plachouras K, Pange J. Markers for the support of clinical tele-assessment: the case of autism spectrum disorders. In: Auer ME, Langmann R, Tsiatsos T, editors. Open Science in Engineering: Proceedings of the 20th International Conference on Remote Engineering and Virtual Instrumentation. Cham, Switzerland. Springer; 2023:759-769.
  55. Toki EI, Tatsis G, Pange J, Plachouras K, Christodoulides P, Kosma EI, et al. Can eye tracking identify prognostic markers for learning disabilities? A preliminary study. In: Tsiatsos T, Auer ME, editors. New Realities, Mobile Systems and Applications: Proceedings of the 14th IMCL Conference. Cham, Switzerland. Springer; 2022:1032-1039.
  56. CMUSphinx. URL: https://cmusphinx.github.io/ [accessed 2024-08-09]
  57. Pantazoglou FK, Papadakis NK, Kladis GP. Implementation of the generic Greek model for CMU sphinx speech recognition toolkit. 2017. Presented at: eRA-12 International Scientific Conference; October 30, 2017; Athens, Greece.
  58. Van DML, Postma EO, van DHH. Dimensionality reduction: a comparative review. J Mach Learn Res. 2009;10:66-71. [FREE Full text]
  59. Gliem JA, Gliem RR. Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. 2003. Presented at: Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education; October 08-10, 2003; Columbus, OH. URL: http://pioneer.chula.ac.th/~ppongsa/2900600/LMRM08.pdf
  60. Vereijken B. The complexity of childhood development: variability in perspective. Phys Ther. 2010;90(12):1850-1859. [CrossRef] [Medline]
  61. van Geert P, van Dijk M. Focus on variability: new tools to study intra-individual variability in developmental data. Infant Behav Dev. 2002;25(4):340-374. [CrossRef]
  62. Jaffe J, Beebe B, Feldstein S, Crown C, Jasnow M. Rhythms of dialogue in infancy: coordinated timing in development. Monogr Soc Res Child Dev. 2001;66(2):1-132. [Medline]
  63. Lense MD, Ladányi E, Rabinowitch TC, Trainor L, Gordon R. Rhythm and timing as vulnerabilities in neurodevelopmental disorders. Philos Trans R Soc Lond B Biol Sci. 2021;376(1835):20200327. [FREE Full text] [CrossRef] [Medline]
  64. Mareva S, CALM Team, Holmes J. Mapping neurodevelopmental diversity in executive function. Cortex. 2024;172:204-221. [FREE Full text] [CrossRef] [Medline]
  65. Marschik PB, Pokorny FB, Peharz R, Zhang D, O'Muircheartaigh J, Roeyers H, et al. A novel way to measure and predict development: a heuristic approach to facilitate the early detection of neurodevelopmental disorders. Curr Neurol Neurosci Rep. 2017;17(5):43. [FREE Full text] [CrossRef] [Medline]
  66. Homberg JR, Kyzar EJ, Nguyen M, Norton WH, Pittman J, Poudel MK, et al. Understanding autism and other neurodevelopmental disorders through experimental translational neurobehavioral models. Neurosci Biobehav Rev. 2016;65:292-312. [CrossRef] [Medline]
  67. Jago LS, Alcock K, Meints K, Pine JM, Rowland CF. Language outcomes from the UK-CDI Project: Can risk factors, vocabulary skills and gesture scores in infancy predict later language disorders or concern for language development? Front Psychol. 2023;14:1167810. [FREE Full text] [CrossRef] [Medline]
  68. Eriksson M, Myrberg K. How the communicative development inventories can contribute to clinical assessments of children with speech and language disorders. Front Psychol. 2023;14:1176028. [FREE Full text] [CrossRef] [Medline]
  69. Alemu Y, Chen H, Duan C, Caulley D, Arriaga RI, Sezgin E. Detecting clinically relevant emotional distress and functional impairment in children and adolescents: protocol for an automated speech analysis algorithm development study. JMIR Res Protoc. 2023;12(1):e46970. [FREE Full text] [CrossRef] [Medline]
  70. Einspieler C, Marschik PB, Prechtl HF. Human motor behavior: prenatal origin and early postnatal development. J Psychol. 2008;216(3):147-153. [CrossRef]
  71. Oh MY. Psychological assessment in neurodevelopmental disorders. Hanyang Med Rev. 2016;36(1):72. [CrossRef]
  72. Haza B, Gosling CJ, Ciminaghi F, Conty L, Pinabiaux C. Research review: social cognition and everyday social skills in children and adolescents with attention-deficit/hyperactivity disorder: a meta-analysis of case-control studies. J Child Psychol Psychiatry. 2024:1245-1254. [CrossRef] [Medline]
  73. Barua PD, Vicnesh J, Gururajan R, Oh SL, Palmer E, Azizan MM, et al. Artificial intelligence enabled personalised assistive tools to enhance education of children with neurodevelopmental disorders—a review. Int J Environ Res Public Health. 2022;19(3):1192. [FREE Full text] [CrossRef] [Medline]
  74. Archer K, Pammer K, Vidyasagar TR. A temporal sampling basis for visual processing in developmental dyslexia. Front Hum Neurosci. 2020;14:213. [FREE Full text] [CrossRef] [Medline]
  75. Goswami U. A temporal sampling framework for developmental dyslexia. Trends Cogn Sci. 2011;15(1):3-10. [CrossRef] [Medline]
  76. Donnelly N, Cunningham A, Salas SM, Bracher-Smith M, Chawner S, Stochl J, et al. Identifying the neurodevelopmental and psychiatric signatures of genomic disorders associated with intellectual disability: a machine learning approach. Mol Autism. 2023;14(1):19. [FREE Full text] [CrossRef] [Medline]
  77. Zakopoulou V, Boukouvala M, Tziakis N, Vellis P, Christodoulides P, Dimakopoulos G, et al. Children ‘at risk‘ of specific learning disorder: individualized diagnostic profiles and interventions. Acta Sci Neurol. 2021;4(2):1-18. [FREE Full text]
  78. Zakopoulou V, Tzimourta KD, Ntritsos G, Tzallas AT, Tsipouras MG, Astrakas LG, et al. Towards correct and safe diagnosis of specific learning disorder in preschool age. The perspective of early multi-collector diagnostic approaches. A pilot study. Act Scie Neuro. 2021;4(6):1-18. [CrossRef]
  79. Poletti M. Definition of a visuospatial dimension as a step forward in the diagnostic puzzle of nonverbal learning disability. Appl Neuropsychol Child. 2017;6(2):106-109. [CrossRef] [Medline]
  80. Toki EI, Tsoulos IG, Santamato V, Pange J. Machine learning for predicting neurodevelopmental disorders in children. Appl Sci. 2024;14(2):837. [CrossRef]


ADHD: attention-deficit/hyperactivity disorder
AI: artificial intelligence
ASD: autism spectrum disorder
CONSORT: Consolidated Standards of Reporting Trials
DSM-5: Diagnostic and Statistical Manual of Mental Disorders (Fifth Edition)
GDPR: General Data Protection Regulation
ND: neurodevelopmental disorder
PC: principal component
PCA: principal component analysis
SG: serious game
SLD: specific learning disorder
STT: speech-to-text


Edited by A Mavragani; submitted 07.10.23; peer-reviewed by A Marengo, V Georgopoulos, S Mary; comments to author 06.06.24; revised version received 23.06.24; accepted 16.07.24; published 11.10.24.

Copyright

©Eugenia I Toki, Victoria Zakopoulou, Giorgos Tatsis, Jenny Pange. Originally published in JMIR Formative Research (https://formative.jmir.org), 11.10.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.