The impact of a computerised test of attention and activity (QbTest) on diagnostic decision-making in children and young people with suspected attention deficit hyperactivity disorder: single-blind randomised controlled trial

Practitioner Review: Clinical utility of the QbTest for the assessment and diagnosis of attention-deficit/hyperactivity disorder - a systematic review and meta-analysis

BACKGROUND

Several computerised cognitive tests (e.g. continuous performance test) have been developed to support the clinical assessment of attention-deficit/hyperactivity disorder (ADHD). Here, we appraised the evidence-base underpinning the use of one of these tests - the QbTest - in clinical practice, by conducting a systematic review and meta-analysis investigating its accuracy and clinical utility.

METHODS

Based on a preregistered protocol (CRD42022377671), we searched PubMed, Medline, Ovid Embase, APA PsycINFO and Web of Science on 15th August 2022, with no language/type of document restrictions. We included studies reporting accuracy measures (e.g. sensitivity, specificity, or Area under the Receiver Operating Characteristics Curve, AUC) for QbTest in discriminating between people with and without DSM/ICD ADHD diagnosis. Risk of bias was assessed with the Quality Assessment of Diagnostic Accuracy Studies tool (QUADAS-2). A generic inverse variance meta-analysis was conducted on AUC scores. Pooled sensitivity and specificity were calculated using a random-effects bivariate model in R.

RESULTS

We included 15 studies (2,058 participants; 48.6% with ADHD). QbTest Total scores showed acceptable, rather than good, sensitivity (0.78 [95% confidence interval: 0.69; 0.85]) and specificity (0.70 [0.57; 0.81]), while subscales showed low-to-moderate sensitivity (ranging from 0.48 [0.35; 0.61] to 0.65 [0.52; 0.75]) and moderate-to-good specificity (from 0.65 [0.48; 0.78] to 0.83 [0.60; 0.94]). Pooled AUC scores suggested moderate-to-acceptable discriminative ability (Q-Total: 0.72 [0.57; 0.87]; Q-Activity: 0.67 [0.58; 0.77); Q-Inattention: 0.66 [0.59; 0.72]; Q-Impulsivity: 0.59 [0.53; 0.64]).

CONCLUSIONS

When used on their own, QbTest scores available to clinicians are not sufficiently accurate in discriminating between ADHD and non-ADHD clinical cases. Therefore, the QbTest should not be used as stand-alone screening or diagnostic tool, or as a triage system for accepting individuals on the waiting-list for clinical services. However, when used as an adjunct to support a full clinical assessment, QbTest can produce efficiencies in the assessment pathway and reduce the time to diagnosis.

Inclusion of a computerized test in ADHD diagnosis process can improve trust in the specialists' decision and elevate adherence levels

Attention deficit and hyperactivity disorder (ADHD) affects many life aspects of children and adults. Accurate identification, diagnosis and treatment of ADHD can facilitate better care. However, ADHD diagnosis and treatment methods are subject of controversy. Objective measures can elevate trust in specialist's decision and treatment adherence. In this observational study we asked whether knowing that a computerized test was included in ADHD diagnosis process results in more trust and intention to adhere with treatment recommendations. Questionnaires were administered to 459 people, 196 men, average age = 40.57 (8.90). Questions regarding expected trust and adherence, trust trait, trust in physician and health-care-institutions, and ADHD scales followed a scenario about parents referred to a neurologist for sons' ADHD diagnosis. The scenario presented to the test group (n = 185) mentioned that a computerized test was part of the diagnostic process. The control group scenario didn't mention any computerized test in the diagnostic process. Test group participants expressed more trust in the diagnosis and greater levels of intention for treatment adherence. Group differences in intention for treatment adherence were mediated by trust in decision. Inclusion of a computerized test in ADHD diagnosis process can improve trust in the specialists' decision and elevate adherence levels.

Parent/Caregiver Experiences of a CAMHS ADHD Assessment Pathway: A Qualitative Service Evaluation

BACKGROUND

Attention deficit hyperactivity disorder (ADHD) is a neurodevelopmental condition characterized by impulsivity, inattention, and hyperactivity. Although the literature has explored the parental impact of living with a child diagnosed with ADHD, less is known about the ADHD assessment journey for children and the parental experiences of this. A recent service evaluation suggested that exploring parental perceptions of a child's ADHD assessment pathway could be beneficial in understanding experiences, gathering ideas for future service development, and collecting service user feedback.

AIMS AND OBJECTIVE

The aims were to (a) explore the broad experiences of parents/caregivers accessing the ADHD assessment pathway for their child and (b) explore experiences of remote appointments during the assessment process in consideration of the COVID-19 pandemic.

METHODS

Twelve parents of children who had experienced an ADHD assessment within a CAMHS pathway participated in a telephone-based semi-structured interview. This involved gathering experiences of the CAMHS ADHD pathway from a parental perspective. The evaluation implemented a qualitative design. Qualitative data was analyzed through thematic analysis.

RESULTS

Results revealed seven main themes. Regarding general experiences of the pathway, parent/caregiver interview responses indicated a sense of relief, feeling understood, and the service being child-focused during the assessment. Difficulties were highlighted within the themes, such as long waiting lists impacting on the child and parent as well as lengthy assessments. In reference to COVID-19 and remote/telephone appointments, interview responses indicated some positives of having remote appointments, such as comfort and convenience. Thus, the strengths of face-to-face communication were highlighted.

A social robot connected with chatGPT to improve cognitive functioning in ASD subjects

Neurodevelopmental Disorders (NDDs) represent a significant healthcare and economic burden for families and society. Technology, including AI and digital technologies, offers potential solutions for the assessment, monitoring, and treatment of NDDs. However, further research is needed to determine the effectiveness, feasibility, and acceptability of these technologies in NDDs, and to address the challenges associated with their implementation. In this work, we present the application of social robotics using a Pepper robot connected to the OpenAI system (Chat-GPT) for real-time dialogue initiation with the robot. After describing the general architecture of the system, we present two possible simulated interaction scenarios of a subject with Autism Spectrum Disorder in two different situations. Limitations and future implementations are also provided to provide an overview of the potential developments of interconnected systems that could greatly contribute to technological advancements for Neurodevelopmental Disorders (NDD).

The Structure and Diagnostic Accuracy of the QbTest in Pediatric ADHD: A Retrospective Clinical Study

OBJECTIVE

The QbTest that combines a continuous performance task (CPT) with a motion-tracking system may help identify attention deficit hyperactivity disorder (ADHD). This study examined the structure and diagnostic ability of the QbTest in children and adolescents.

METHOD

Retrospective data from 1,274 children and adolescents were analyzed. The study assessed data on a principal component analysis (PCA), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

RESULTS

The QbActivity component included the variables micro-events, distance, area, and time active; the QbImpulsivity included normalized commissions and commissions (anticipatory errors were added in a version for 6-12-year-olds only); and the QbInattention included omissions, reaction time, and reaction time variation. Sensitivity ranged between 22% and 50%, specificity 79% and 96%, PPVs 40% and 95%, and NPVs 24% and 66%.

CONCLUSION

The structure of the QbTest with three cardinal parameters and nine/ten CPT and motion analysis variables was supported. The diagnostic accuracy was found to be poor to moderate. Given that this is a retrospective study, the interpretation of diagnostic accuracy should be considered within this context.

A preliminary study of white matter correlates of a laboratory measure of attention and motor stability in attention-deficit/hyperactivity disorder

Attention-deficit/hyperactivity disorder (ADHD) is a complex behavioral disorder, often difficult and time consuming to diagnose. Laboratory assessment of ADHD-related constructs of attention and motor activity may be helpful in elucidating neurobiology; however, neuroimaging studies evaluating laboratory measures of ADHD are lacking. In this preliminary study, we assessed the association between fractional anisotropy (FA), a measure of white matter microstructure, and laboratory measures of attention and motor behavior using the QbTest, a widely used measure thought to improve clinician diagnostic confidence. This is the first look at neural correlates of this widely used measure. The sample included adolescents and young adults (ages 12-20, 35% female) with ADHD (n = 31) and without (n = 52). As expected, ADHD status was associated with motor activity, and cognitive inattention and impulsivity in the laboratory. With regard to MRI findings, laboratory observed motor activity and inattention were associated with greater FA in white matter regions of the primary motor cortex. All three laboratory observations were associated with lower FA in regions subserving fronto-striatal-thalamic and frontoparietal (i.e. superior longitudinal fasciculus) circuitry. Further, FA in white matter regions of the prefrontal cortex appeared to mediate the relationship between ADHD status and motor activity on the QbTest. These findings, while preliminary, suggest that performance on certain laboratory tasks is informative with regard to neurobiological correlates of subdomains of the complex ADHD phenotype. In particular, we provide novel evidence for a relationship between an objective measure of motor hyperactivity and white matter microstructure in motor and attentional networks.

Remote assessment of ADHD in children and adolescents: recommendations from the European ADHD Guidelines Group following the clinical experience during the COVID-19 pandemic

The COVID-19 pandemic led ADHD services to modify the clinical practice to reduce in-person contact as much as possible to minimise viral spread. This had far-reaching effects on day-to-day clinical practice as remote assessments were widely adopted. Despite the attenuation of the acute threat from COVID, many clinical services are retaining some remote practices. The lack of clear evidence-based guidance about the most appropriate way to conduct remote assessments meant that these changes were typically implemented in a localised, ad hoc, and un-coordinated way. Here, the European ADHD Guidelines Group (EAGG) discusses the strengths and weaknesses of remote assessment methods of children and adolescents with ADHD in a narrative review based on available data and expert opinions to highlight key recommendations for future studies and clinical practice. We conclude that going forward, despite remote working in clinical services functioning adequately during the pandemic, all required components of ADHD assessment should still be completed following national/international guidelines; however, the process may need adaptation. Social restrictions, including changes in education provision, can either mask or exacerbate features associated with ADHD and therefore assessment should carefully chart symptom profile and impairment prior to, as well as during an ongoing pandemic. While remote assessments are valuable in allowing clinical services to continue despite restrictions and may have benefits for routine care in the post-pandemic world, particular attention must be paid to those who may be at high risk but not be able to use/access remote technologies and prioritize these groups for conventional face-to-face assessments.

Candidate diagnostic biomarkers for neurodevelopmental disorders in children and adolescents: a systematic review

Neurodevelopmental disorders - including attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, communication disorders, intellectual disability, motor disorders, specific learning disorders, and tic disorders - manifest themselves early in development. Valid, reliable and broadly usable biomarkers supporting a timely diagnosis of these disorders would be highly relevant from a clinical and public health standpoint. We conducted the first systematic review of studies on candidate diagnostic biomarkers for these disorders in children and adolescents. We searched Medline and Embase + Embase Classic with terms relating to biomarkers until April 6, 2022, and conducted additional targeted searches for genome-wide association studies (GWAS) and neuroimaging or neurophysiological studies carried out by international consortia. We considered a candidate biomarker as promising if it was reported in at least two independent studies providing evidence of sensitivity and specificity of at least 80%. After screening 10,625 references, we retained 780 studies (374 biochemical, 203 neuroimaging, 133 neurophysiological and 65 neuropsychological studies, and five GWAS), including a total of approximately 120,000 cases and 176,000 controls. While the majority of the studies focused simply on associations, we could not find any biomarker for which there was evidence - from two or more studies from independent research groups, with results going into the same direction - of specificity and sensitivity of at least 80%. Other important metrics to assess the validity of a candidate biomarker, such as positive predictive value and negative predictive value, were infrequently reported. Limitations of the currently available studies include mostly small sample size, heterogeneous approaches and candidate biomarker targets, undue focus on single instead of joint biomarker signatures, and incomplete accounting for potential confounding factors. Future multivariable and multi-level approaches may be best suited to find valid candidate biomarkers, which will then need to be validated in external, independent samples and then, importantly, tested in terms of feasibility and cost-effectiveness, before they can be implemented in daily clinical practice.

Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review

In recent years, there has been a great interest in utilizing technology in mental health research. The rapid technological development has encouraged researchers to apply technology as a part of a diagnostic process or treatment of Neurodevelopmental Disorders (NDDs). With the large number of studies being published comes an urgent need to inform clinicians and researchers about the latest advances in this field. Here, we methodically explore and summarize findings from studies published between August 2019 and February 2022. A search strategy led to the identification of 4108 records from PubMed and APA PsycInfo databases. 221 quantitative studies were included, covering a wide range of technologies used for diagnosis and/or treatment of NDDs, with the biggest focus on Autism Spectrum Disorder (ASD). The most popular technologies included machine learning, functional magnetic resonance imaging, electroencephalogram, magnetic resonance imaging, and neurofeedback. The results of the review indicate that technology-based diagnosis and intervention for NDD population is promising. However, given a high risk of bias of many studies, more high-quality research is needed.

Using an objective computer task (QbTest) to aid the identification of attention deficit hyperactivity disorder (ADHD) in the Children and Young People Secure Estate (CYPSE): a feasibility randomised controlled trial

OBJECTIVES

QbTest has been shown to improve time to decision/diagnosis for young people with attention deficit hyperactivity disorder (ADHD). The aim was to assess the feasibility of QbTest for young people in prison.

DESIGN

Single-centre feasibility randomised controlled trial (RCT), with 1:1 allocation. Concealed random allocation using an online pseudorandom list with random permuted blocks of varying sizes.

SETTING

One Young Offenders Institution in England.

PARTICIPANTS

355 young people aged 15-18 years displaying possible symptoms of ADHD were assessed for eligibility, 69 were eligible to take part and 60 were randomised.

INTERVENTION

QbTest-a computer task measuring attention, activity and impulsivity.

MAIN OUTCOME MEASURES

Eligibility, recruitment and retention rates and acceptability of randomisation and trial participation.

RESULTS

Of the 355 young people assessed for eligibility, 69 were eligible and 60 were randomised (n=30 QbTest plus usual care; n=30 usual care alone). The study achieved the specified recruitment target. Trial participation and randomisation were deemed acceptable by the majority of participants. 78% of young people were followed up at 3 months, but only 32% at 6 months, although this was also affected by COVID-19 restrictions. Secondary outcomes were mixed. Participants including clinical staff were mostly supportive of the study and QbTest; however, some young people found QbTest hard and there were issues with implementation of the ADHD care pathway. There were no serious adverse events secondary to the study or intervention and no one was withdrawn from the study due to an adverse event.

CONCLUSIONS

With adaptations, a fully powered RCT may be achievable to evaluate the effectiveness of QbTest in the assessment of ADHD in the Children and Young People Secure Estate, with time to decision (days) as the primary outcome measure. However, further programme developmental work is required to address some of the challenges highlighted prior to a larger trial.

TRIAL REGISTRATION NUMBER

ISRCTN17402196.

Toward Precision Medicine in ADHD

Attention-Deficit Hyperactivity Disorder (ADHD) is a complex and heterogeneous neurodevelopmental condition for which curative treatments are lacking. Whilst pharmacological treatments are generally effective and safe, there is considerable inter-individual variability among patients regarding treatment response, required dose, and tolerability. Many of the non-pharmacological treatments, which are preferred to drug-treatment by some patients, either lack efficacy for core symptoms or are associated with small effect sizes. No evidence-based decision tools are currently available to allocate pharmacological or psychosocial treatments based on the patient's clinical, environmental, cognitive, genetic, or biological characteristics. We systematically reviewed potential biomarkers that may help in diagnosing ADHD and/or stratifying ADHD into more homogeneous subgroups and/or predict clinical course, treatment response, and long-term outcome across the lifespan. Most work involved exploratory studies with cognitive, actigraphic and EEG diagnostic markers to predict ADHD, along with relatively few studies exploring markers to subtype ADHD and predict response to treatment. There is a critical need for multisite prospective carefully designed experimentally controlled or observational studies to identify biomarkers that index inter-individual variability and/or predict treatment response.

ASD with ADHD vs. ASD and ADHD alone: a study of the QbTest performance and single-dose methylphenidate responding in children and adolescents

BACKGROUND

The continuous performance task (CPT) may help identify coexistent attention deficit hyperactivity disorder (ADHD) in autism spectrum disorder (ASD). The Quantified behavior Test (QbTest) combines a CPT and motion-tracking data to assess ADHD symptoms. This study aimed to evaluate the QbTest performance of children and adolescents with ASD plus ADHD, including estimating the effects of single-dose methylphenidate (MPH). To achieve these aims, (1) the QbTest performances were evaluated in ASD alone, ASD plus ADHD, and ADHD alone, and (2) the effects on the QbTest performance of single-dose MPH before and after intake were estimated across the groups. It was assumed that the ASD plus ADHD performance, including the MPH response, would preferably resemble the performance in ADHD alone, rather than ASD alone.

METHODS

Retrospective data were analyzed for 482 children and adolescents: 69 with ASD alone, 142 with ASD plus ADHD (ASD/ADHD), and 271 with ADHD alone. For 343 subjects, the QbTest was performed before and up to four hours after a single-dose MPH intake. A summary index of the CPT and motion-capture data was provided for QbTest cardinal parameters.

RESULTS

Of 12 QbTest parameters assessed before given MPH, the ASD/ADHD group had scores in line with the ASD group regarding four parameters and the ADHD group regarding nine parameters. Significant differences between groups were seen with respect to QbInattention (p > 0.05); the lowest scores in ASD and the highest in ADHD. Those with ASD/ADHD and ADHD had similar QbActivity and QbImpulsivity scores, but significantly higher than those with ASD. After MPH intake, scores for QbActivity decreased similarly in ASD/ADHD and ADHD, as well as scores for QbImpulsivity. QbImpulsivity increased in ASD. QbInattention scores decreased similarly in all groups after MPH intake.

CONCLUSIONS

Children and adolescents with ASD plus ADHD exhibited more atypical QbTest performances than those with ASD alone, while most of their performances were similar to those observed in ADHD alone. In addition, a single dose of MPH mitigated attention deficits and decreased hyperactivity while improved impulsivity in these children. Prospective studies should further clarify the role of the QbTest in the diagnostic and therapeutic interventions in ASD with ADHD.

Classification, prevalence and integrated care for neurodevelopmental and child mental health disorders: A brief overview for paediatricians

‘Neurodevelopmental disorders’ comprise a group of congenital or acquired long-term conditions that are attributed to disturbance of the brain and or neuromuscular system and create functional limitations, including autism spectrum disorder, attention deficit/ hyperactivity disorder, tic disorder/ Tourette’s syndrome, developmental language disorders and intellectual disability. Cerebral palsy and epilepsy are often associated with these conditions within the broader framework of paediatric neurodisability. Co-occurrence with each other and with other mental health disorders including anxiety and mood disorders and behavioural disturbance is often the norm. Together these are referred to as neurodevelopmental, emotional, behavioural, and intellectual disorders (NDEBIDs) in this paper. Varying prevalence rates for NDEBID have been reported in developed countries, up to 15%, based on varying methodologies and definitions. NDEBIDs are commonly managed by either child health paediatricians or child/ adolescent mental health (CAMH) professionals, working within multidisciplinary teams alongside social care, education, allied healthcare practitioners and voluntary sector. Fragmented services are common problems for children and young people with multi-morbidity, and often complicated by sub-threshold diagnoses. Despite repeated reviews, limited consensus among clinicians about classification of the various NDEBIDs may hamper service improvement based upon research. The recently developed “Mental, Behavioural and Neurodevelopmental disorder” chapter of the International Classification of Diseases-11 offers a way forward. In this narrative review we search the extant literature and discussed a brief overview of the aetiology and prevalence of NDEBID, enumerate common problems associated with current classification systems and provide recommendations for a more integrated approach to the nosology and clinical care of these related conditions.

Treatment with RehaCom computerized rehabilitation program improves response control, but not attention in children with attention-deficit/hyperactivity disorder (ADHD)

Attention-deficit/hyperactivity disorder (ADHD) is a common psychiatric disorder in children. ADHD impairs attention, response control, emotion regulation, and other cognitive functions. On the other hand, RehaCom is a cognitive rehabilitation software that has therapeutic effects on cognitive dysfunctions in many diseases such as stroke, multiple sclerosis, and schizophrenia. The goal of the present study was to investigate the effect of treatment with RehaCom on auditory and visual response control, and auditory and visual attention in children with ADHD. Forty patients were selected. The participants were assigned to control (n = 20) and experimental (n = 20) groups, while only the participants in the experimental group were trained by RehaCom for five weeks (ten 45-min sessions, two sessions per week). At weeks 0 and 5, performance of the participants of experimental group was compared with the participants of control group. The results showed that treatment with RehaCom significantly improved auditory and visual response control in children with ADHD, with no effect on auditory and visual attention. In conclusion, RehaCom may alter brain's structural and functional properties that are related to response control. We suggest that attention deficit in ADHD may be a result of more complicated dysfunctions in the brain, that are not affected by RehaCom.

ADHD in Children and Adults: Diagnosis and Prognosis

Attention-Deficit Hyperactivity Disorder (ADHD) is a prevalent neuropsychiatric disorder associated with significant impairment and distress throughout the lifespan. Recent investigations have shed light on different aspects regarding the trajectory of ADHD, including reports on risk factors in childhood, that are associated with remission or persistence in adulthood. Despite significant advances in our understanding of the pathophysiology of the disorder, the diagnosis of ADHD remains strictly clinical and is based on behavioral symptoms of inattention, impulsivity, and hyperactivity. In this chapter we review the diagnostic process of ADHD, discuss the clinical presentation of the disorder across the lifespan, and examine patterns of comorbidity and longitudinal predictor of outcomes.

Clinical Conundrums When Integrating the QbTest into a Standard ADHD Assessment of Children and Young People

The uptake of the QbTest in clinical practice is increasing and has recently been supported by research evidence proposing its effectiveness in relation to clinical decision-making. However, the exact underlying process leading to this clinical benefit is currently not well established and requires further clarification. For the clinician, certain challenges arise when adding the QbTest as a novel method to standard clinical practice, such as having the skills required to interpret neuropsychological test information and assess for diagnostically relevant neurocognitive domains that are related to attention-deficit hyperactivity disorder (ADHD), or how neurocognitive domains express themselves within the behavioral classifications of ADHD and how the quantitative measurement of activity in a laboratory setting compares with real-life (ecological validity) situations as well as the impact of comorbidity on test results. This article aims to address these clinical conundrums in aid of developing a consistent approach and future guidelines in clinical practice.

Movement Patterns in Students Diagnosed with ADHD, Objective Measurement in a Natural Learning Environment

Attention deficit hyperactivity disorder is the most common neuropsychological disorder in childhood and adolescence, affecting the basic psychological processes involved in learning, social adaptation and affective adjustment. From previous research, the disorder is linked to problems in different areas of development, with deficiencies in psychological processes leading to the development of the most common characteristics of the disorder such as inattention, excess of activity and lack of inhibitory control. As for the diagnosis, in spite of being a very frequent disorder, there are multiple controversies about which tools are the most suitable for evaluation. One of the most widespread tools in the professional field is behavior inventories such as the Strengths and Difficulties Questionnaires for Parents and Teachers or the ADHD Rating Scale-V. The main disadvantage of these assessment tools is that they do not provide an objective observation. For this reason, there are different studies focused on recording objective measures of the subjects' movement, since hyperkinesia is one of the most characteristic symptoms of this disorder. In this sense, we have developed an application that, using a Kinect device, is capable of measuring the movement of the different parts of the body of up to six subjects in the classroom, being a natural context for the student. The main objective of this work is twofold, on the one hand, to investigate whether there are correlations between excessive movement and high scores in the inventories for the diagnosis of ADHD, Rating Scale-V and Strengths and Difficulties Questionnaire (SDQ) and, on the other hand, to determine which sections of the body present the most significant mobility in subjects diagnosed with ADHD. Results show that the control group, composed of neurotypical subjects, presents less kinaesthetic activity than the clinical group diagnosed with ADHD. This indicates that the experimental group presents one of the main characteristics of the disorder. In addition, results also show that practically all the measured body parts present significant differences, being higher in the clinical group, highlighting the head as the joint with the highest effect size.

Economic evaluations of big data analytics for clinical decision-making: a scoping review

OBJECTIVE

Much has been invested in big data analytics to improve health and reduce costs. However, it is unknown whether these investments have achieved the desired goals. We performed a scoping review to determine the health and economic impact of big data analytics for clinical decision-making.

MATERIALS AND METHODS

We searched Medline, Embase, Web of Science and the National Health Services Economic Evaluations Database for relevant articles. We included peer-reviewed papers that report the health economic impact of analytics that assist clinical decision-making. We extracted the economic methods and estimated impact and also assessed the quality of the methods used. In addition, we estimated how many studies assessed "big data analytics" based on a broad definition of this term.

RESULTS

The search yielded 12 133 papers but only 71 studies fulfilled all eligibility criteria. Only a few papers were full economic evaluations; many were performed during development. Papers frequently reported savings for healthcare payers but only 20% also included costs of analytics. Twenty studies examined "big data analytics" and only 7 reported both cost-savings and better outcomes.

DISCUSSION

The promised potential of big data is not yet reflected in the literature, partly since only a few full and properly performed economic evaluations have been published. This and the lack of a clear definition of "big data" limit policy makers and healthcare professionals from determining which big data initiatives are worth implementing.

Optimising medication management in children and young people with ADHD using a computerised test (QbTest): a feasibility randomised controlled trial

BACKGROUND

Medication for attention deficit hyperactivity disorder (ADHD) should be closely monitored to ensure optimisation. There is growing interest in using computerised assessments of ADHD symptoms to support medication monitoring. The aim of this study was to assess the feasibility and acceptability of a randomised controlled trial (RCT) to evaluate the efficacy of one such computerised assessment, the Quantified Behavior (Qb) Test, as part of medication management for ADHD.

METHODS

This feasibility multi-site RCT conducted in child and adolescent mental health and community paediatric settings recruited participants aged 6-15 years diagnosed with ADHD starting stimulant medication. Participants were randomised into one of two arms: experimental (QbTest protocol) where participants completed a QbTest at baseline and two follow-up QbTests on medication (2-4 weeks and 8-10 weeks later) and control where participants received treatment as usual, including at least two follow-up consultations. Measures of parent, teacher, and clinician-rated symptoms and global functioning were completed at each time point. Clinicians recorded treatment decision-making and health economic measures were obtained. Data were analysed using multi-level modelling and participants (children and parents) and clinicians were interviewed about their experiences, resulting data were thematically analysed.

RESULTS

Forty-four children and young people were randomised. Completion of study outcome measures by care-givers and teachers ranged from 52 to 78% at baseline to 47-65% at follow-up. Participants reported the questionnaires to be useful to complete. SNAP-IV inattention scores showed greater reduction in the intervention than the control group (- 5.85, 95% CI - 10.33, - 1.36,). Engagement with the intervention ranged from 100% at baseline, to 78% follow-up 1 and 57% follow-up 2. However, only 37% of QbTests were conducted in the correct time period. Interview data highlighted that the objectivity of the QbTest was appreciated by clinicians and parents. Clinicians commented that the additional time and resources required meant that it is not feasible to use QbTest for all cases.

CONCLUSION

The trial design and protocol appear to be feasible and acceptable but could be improved by modifying QbTest time periods and the method of data collection. With these changes, the protocol may be appropriate for a full trial. Adding QbTest may improve symptom outcome as measured by SNAP-IV.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03368573 , prospectively registered, 11th December 2017, and ISRCTN, ISRCTN69461593 , retrospectively registered, 10th April 2018.

Predicting ADHD symptoms and diagnosis at age 14 from objective activity levels at age 7 in a large UK cohort

Hyperactivity is one of the three core symptoms in children with attention deficit hyperactivity disorder (ADHD). Diagnosing ADHD typically involves self-report, third party report and observations. Objective activity data can make a valuable contribution to the diagnostic process. Small actigraphy studies in clinical samples have shown that children with ADHD move more than children without ADHD. However, differences in physical activity between children with and without ADHD have not been assessed in large community samples or longitudinally. This study used data from the Millennium Cohort Study to test whether symptoms of ADHD (parent-rating Strengths and Difficulties Questionnaire) and ADHD diagnosis at age 14 (reported by parents) could be predicted from objective activity data (measured with actigraphs) at age 7 in N = 6675 children (final N = 5251). Regressions showed that less sedentary behavior at age 7 predicted more ADHD symptoms at age 14 (β =  - 0.002, CI  - 0.004 to  - 0.001). The result remained significant when controlled for ADHD symptoms at age 7, sex, BMI, month of birth, SES and ethnicity (β  =  - 0.001, CI  - 0.003 to  - 0.0003). ADHD diagnosis at age 14 was also significantly predicted by less sedentary behavior at age 7 (β  =  - 0.008). Our findings show that symptoms of ADHD can be predicted by objective activity data 5 years in advance and suggest that actigraphy could be a useful instrument aiding an ADHD diagnosis. Interestingly, the results indicate that the key difference between children with and without ADHD lies in reduced sedentary activity, i.e., times of rest.

The Impact of Methylphenidate on QbTest Performance of Children with ADHD: A Retrospective Clinical Study

INTRODUCTION

The Quantified behavior Test (QbTest), which combines a continuous performance task (CPT) and motion tracking, provides data for the core signs of attention-deficit/hyperactivity disorder (ADHD): attention, hyperactivity, and impulsivity. This study aimed to evaluate the performance of children and adolescents with ADHD on the QbTest before and after a single methylphenidate (MPH) dose.

SUBJECTS AND METHODS

This retrospective chart review study included data from 149 children and 215 adolescents who completed the QbTest. A summary index of the CPT and motion capture data on the QbTest is provided by three cardinal parameters: QbActivity, QbImpulsivity, and QbInattention. The test was performed twice on the same day, before and up to three hours after MPH intake. A decrease by ≥ 0.5 in a cardinal parameter score was considered an improvement, whereas an increase by ≥ 0.5 a deterioration.

RESULTS

QbActivity improvement after MPH intake was present in 71.7% and 76.2% of the children and adolescents, respectively. QbImpulsivity improvement was observed in 50.4% of the children and 44.7% of the adolescents, and QbInattention improvement in 85.1% and 91.1% of the children and adolescents, respectively. All three parameters improved simultaneously in 27.7% of the children and 28.7% of the adolescents. The likelihood that one parameter deteriorated after MPH use was greater if that parameter was within the normal range before medication. This was most pronounced for QbImpulsivity. Among male adolescents, QbInattention improvement was often accompanied by QbImpulsivity deterioration.

CONCLUSION

The QbTest inattention and motor activity parameters improved markedly after a single MPH dose in children and adolescents with ADHD, while less so for impulsivity. Improvement of one parameter is not necessarily associated with improvement of the other two, and deterioration, especially regarding impulsivity, may occur. If confirmed, these results highlight the need for optimization and individualization of MPH treatment, while monitoring all aspects of the ADHD symptomatology based on the QbTest performance.

A Machine-Based Prediction Model of ADHD Using CPT Data

Despite the popularity of the continuous performance test (CPT) in the diagnosis of attention-deficit/hyperactivity disorder (ADHD), its specificity, sensitivity, and ecological validity are still debated. To address some of the known shortcomings of traditional analysis and interpretation of CPT data, the present study applied a machine learning-based model (ML) using CPT indices for the Prediction of ADHD.Using a retrospective factorial fitting, followed by a bootstrap technique, we trained, cross-validated, and tested learning models on CPT performance data of 458 children aged 6–12 years (213 children with ADHD and 245 typically developed children). We used the MOXO-CPT version that included visual and auditory stimuli distractors. Results showed that the ML proposed model performed better and had a higher accuracy than the benchmark approach that used clinical data only. Using the CPT total score (that included all four indices: Attention, Timeliness, Hyperactivity, and Impulsiveness), as well as four control variables [age, gender, day of the week (DoW), time of day (ToD)], provided the most salient information for discriminating children with ADHD from their typically developed peers. This model had an accuracy rate of 87%, a sensitivity rate of 89%, and a specificity rate of 84%. This performance was 34% higher than the best-achieved accuracy of the benchmark model. The ML detection model could classify children with ADHD with high accuracy based on CPT performance. ML model of ADHD holds the promise of enhancing, perhaps complementing, behavioral assessment and may be used as a supportive measure in the evaluation of ADHD.

Associations of the Behavioral Assessment and Research System (BARS) neurobehavioral outcomes with attention problems in children living near coal ash storage sites

Environmental exposures have been linked to childhood problems with overactivity, attention, and impulse control, and an increased risk of attention deficit hyperactivity disorder (ADHD) diagnosis. Two approaches to identify these types of exposure-related neurobehavioral problems include the use of computerized tests, such as the Behavioral Assessment and Research System (BARS), as well as the use of behavior rating scales. To assess comparability of these two types of measures, we analyzed data from 281 children aged 6 to 14 years enrolled in a 5-year research study investigating coal ash exposure and neurobehavioral health. All children lived in proximity of coal ash storage sites. We administered six computer tests from the BARS and obtained behavior measures from the parent-completed Child Behavior Checklist (CBCL) ADHD DSM oriented scale. BARS test performance was associated with age indicating that the tests could be used to evaluate neurodevelopmental changes over time or across a wide age range. Tests within the BARS including Continuous Performance (CPT) false alarm (standardized estimate 1.57, 95% confidence interval (CI) (0.67, 2.48), adjusted p = 0.006), Selective Attention (SAT) wrong count (standardized estimate 2.8, 95% CI (1.17, 4.44), adjusted p = 0.006), and SAT proportion correct (standardized estimate -2.45, 95% CI (-4.01, -0.88), adjusted p = 0.01) were associated with attention and impulse control problems on the CBCL after adjustment for multiple comparisons. Findings support that the BARS can contribute to research on environmental exposures by assessing subclinical behaviors related to ADHD such as sustained attention, impulse control, response inhibition, associative learning, and short-term memory. Future research can examine relationships of these BARS measures with biomarkers of neurotoxic exposures related to living near coal ash storage sites to better identify the potential risk for ADHD-related behaviors among children living near coal ash storage sites.

Objective measurement of attention deficit hyperactivity disorder symptoms outside the clinic using the QbCheck: Reliability and validity

Objective measurements of ADHD symptom levels can be a highly valuable complement to ratings. However, sometimes it is not feasible to bring patients into the clinic/lab for assessment. The aim of the present study was therefore to evaluate the psychometric properties of the QbCheck, an online computerized test that measures errors and reaction time as well as activity during testing using the computer's built-in web camera. Study I (n = 27 adolescents/adults) investigated test-retest reliability and concurrent validity of the QbCheck. Study II included 142 adolescents/adults (69 with ADHD/73 controls) and investigated convergent and diagnostic validity, as well as usability, of the QbCheck. In Study I, the QbCheck showed high test-retest reliability and high concurrent validity. In Study II, high convergent validity was observed when studying associations between the QbCheck performed in the home and the QbTest performed at the clinic. In addition, the QbCheck discriminated well between patients with ADHD and controls, with a sensitivity of 82.6 and a specificity of 79.5. The QbCheck appears to be a valuable test with good psychometric properties and will thereby enable assessment of ADHD symptom levels in adolescents and adults outside the clinic in the home setting.

A systematic review evaluating the implementation of technologies to assess, monitor and treat neurodevelopmental disorders: A map of the current evidence

Technology-based interventions provide an attractive option for improving service provision for neurodevelopmental disorders (NDD), for example, widening access to interventions, objective assessment, and monitoring; however, it is unclear whether there is sufficient evidence to support their use in clinical settings. This review provides an evidence map describing how technology is implemented in the assessment/diagnosis and monitoring/ treatment of NDD (Prospero CRD42018091156). Using predefined search terms in six databases, 7982 articles were identified, 808 full-texts were screened, resulting in 47 included papers. These studies were appraised and synthesised according to the following outcomes of interest: effectiveness (clinical effectiveness/ service delivery efficiencies), economic impact, and user impact (acceptability/ feasibility). The findings describe how technology is currently being utilised clinically, highlights gaps in knowledge, and discusses future research needs. Technology has been used to facilitate assessment and treatment across multiple NDD, especially Autism Spectrum (ASD) and attention-deficit/hyperactivity (ADHD) disorders. Technologies include mobile apps/tablets, robots, gaming, computerised tests, videos, and virtual reality. The outcomes presented largely focus on the clinical effectiveness of the technology, with approximately half the papers demonstrating some degree of effectiveness, however, the methodological quality of many studies is limited. Further research should focus on randomised controlled trial designs with longer follow-up periods, incorporating an economic evaluation, as well as qualitative studies including process evaluations and user impact.

FACT: a randomised controlled trial to assess the feasibility of QbTest in the assessment process of attention deficit hyperactivity disorder (ADHD) for young people in prison-a feasibility trial protocol

INTRODUCTION

The prevalence of attention deficit hyperactivity disorder (ADHD) within the Children and Young People Secure Estate (CYPSE) is much higher than seen in the general population. To make a diagnosis of ADHD, clinicians draw on information from multiple sources, including parents and teachers. However, obtaining these is particularly difficult for young people in the secure estate. There is increasing evidence in the community that QbTest is able to assist in the accurate and earlier diagnosis of ADHD. The objective of this study is to assess the feasibility and acceptability of QbTest in the assessment of ADHD within the CYPSE.

METHODS AND ANALYSIS

A single-centre parallel group feasibility randomised controlled trial will be conducted. Sixty young people within the CYPSE identified as displaying possible symptoms of ADHD will be randomised to the intervention arm (n=30; QbTest plus usual care) or control arm (n=30; usual care). Primary analyses will be descriptive and a process evaluation will be conducted to assess the contexts involved in implementing the intervention. Interviews will be conducted to explore acceptability and thematic analysis will be used to analyse the data.

ETHICS AND DISSEMINATION

This study was approved by National Health Service Wales research ethics committee 3 (18/WA/0347) on 15 February 2019. The findings will be published in peer-reviewed journals, presented at relevant conferences and disseminated to the public via summaries cocreated with our patient and public involvement group.

TRIAL REGISTRATION NUMBER

ISRCTN17402196.

The validity of the Strengths and Difficulties Questionnaire (SDQ) for children with ADHD symptoms

Background

The Strengths and Difficulties Questionnaire (SDQ) is widely used to assess child and adolescent mental health problems. However, the factor structure of the SDQ is subject to debate and there is limited evidence investigating measurement equivalence invariance (ME/I) between treatment groups, informants, and across time.

Method

A randomised controlled trial (RCT) recruited 250 participants (6–17 years) who had been referred for an attention deficit hyperactivity disorder (ADHD) assessment. Participants and their clinician either received or did not receive a QbTest report (computer task measuring attention, impulsivity and activity). Parents and teachers completed the SDQ at baseline and 6-months later. This study aimed to understand the factor structure of the SDQ in a clinic referred ADHD sample, and validate the scale as a screening/diagnostic aide and as a measure of treatment outcome both in clinical and research settings. Exploratory Structural Equation Modelling (ESEM) was performed to examine the factor structure, and ME/I was assessed between treatment groups, informants, and time points. The criterion validity of the SDQ predictive algorithm for ADHD was compared with clinician and research diagnoses using logistic regression and tests of diagnostic accuracy.

Results

A 5-factor structure provided the best fit with strong factorial invariance between treatment groups and across time points, but not across informants (parent and teacher ratings). SDQ ratings of ‘probable’ hyperactivity disorder were good predictors of clinical (OR = 10.20, 95%CI 2.18–48.71,p = 0.003) and research diagnoses of ADHD (OR = 6.82, 95%CI 1.95–23.84,p = 0.003), and research diagnoses of Hyperkinetic disorder (OR = 4.02, 95%CI 1.13–14.25,p = 0.031). Further examination of the SDQ hyperactivity ‘probable’ rating showed good specificity (84.5%-74.5%) but poor sensitivity (45.0–42.5%) for ADHD.

Conclusion

The findings indicate the SDQ is a valid outcome measure for use in RCTs and clinical settings. However, care should be taken when using the SDQ predictive algorithm to screen for ADHD in clinically referred samples.

Consensus workshops on the development of an ADHD medication management protocol using QbTest: developing a clinical trial protocol with multidisciplinary stakeholders

BACKGROUND

The study design and protocol that underpin a randomised controlled trial (RCT) are critical for the ultimate success of the trial. Although RCTs are considered the gold standard for research, there are multiple threats to their validity such as participant recruitment and retention, identifying a meaningful change, and non-adherence to the protocol. For clinical RCTs, involving patients and clinicians in protocol design provides the opportunity to develop research protocols that are meaningful to their target audience and may help overcome some of the inherent threats in conducting RCTs. However, the majority of protocols do not describe the methodology underpinning their development, limiting the amount of learned experience shared between research groups.

METHOD

With the purpose of reporting a collaborative approach towards developing a protocol, we present the findings from three sequential workshops that were conducted with the aim of developing a protocol to investigate the feasibility of adding a computerised test of attention, impulsivity and activity (QbTest) to medication management of children and young people with Attention deficit hyperactivity disorder (ADHD). Based on previous qualitative interviews with clinicians and families, each workshop prioritised topics for focused discussion. Information from the workshops was fed back to the participants for reflection in advance of the next workshop.

RESULTS

The workshops involved 21 multi-disciplinary ADHD experts, including clinicians, patient and public involvement (PPI) members, parents of young people with ADHD and researchers. The consensus workshops addressed key research issues such as: the most relevant outcome measures/ resource drivers; methods and time points for data collection; and the clinical protocol for utilising the QbTest, including when best to use this within the medication management process. The resulting protocol details a feasibility RCT design describing these factors.

CONCLUSION

Protocols which are co-developed may help overcome some of the risks associated with RCT completion (e.g. recruitment, retention, protocol adherence) and help prioritise outcomes of greater relevance to the populations under study. The methodology has potential value for researchers and organisations developing clinical guidelines, and offers insights into the valuable impact of PPI upon trial design.

TRIAL REGISTRATION

Clinicaltrials.gov NCT03368573, 11th December 2017 (retrospectively registered).

The Validity of the SNAP-IV in Children Displaying ADHD Symptoms

The Swanson, Nolan, and Pelham Rating Scale (SNAP-IV) is a widely used scale that measures the core symptoms of attention deficit hyperactivity disorder (ADHD). However, there are contradictory findings regarding factor structure. Factor structure and measurement equivalence/invariance analysis on parent and teacher SNAP-IV for children referred for an ADHD assessment (N = 250; 6-17 years), revealed a two-factor structure provided the best fit. SNAP-IV scores were also compared with clinician diagnosis of ADHD and research diagnoses of ADHD and hyperkinetic disorder. Parent ratings of inattention and hyperactivity/impulsivity were good predictors of research but not clinician diagnosis. For teacher ratings, only hyperactivity/impulsivity scores were associated with research and clinician diagnosis. SNAP-IV scores showed high sensitivity but low specificity to clinician diagnosis. The SNAP-IV is a valid outcome measure for use in randomized controlled trials and clinical settings, and is best used as a screening rather than a diagnostic tool for ADHD.