Artificial Intelligence‐Based Virtual Assistant for the Diagnostic Approach of Chronic Ataxias

Abstract

Background: Chronic ataxias, a complex group of over 300 diseases, pose significant diagnostic challenges because of their clinical and genetic heterogeneity. Here, we propose that artificial intelligence (AI) can aid in the identification and understanding of these disorders through the utilization of a smart virtual assistant.Objectives: The aim is to develop and validate an AI-powered virtual assistant for diagnosing chronic ataxias.Methods: A non-commercial virtual assistant was developed using advanced algorithms, decision trees, and large language models. In the validation process, 453 clinical cases from the literature were selected from 151 causes of chronic ataxia. The diagnostic accuracy was compared with that of 21 neurologists specializing in movement disorders and GPT-4. Usability regarding time and number of questions needed were also evaluated.Results: The virtual assistant accuracy was 90.9%, higher than neurologists (18.3%), and GPT-4 (19.4%). It also significantly outperformed in causes of ataxia distributed by age, inheritance, frequency, associated clinical manifestations, and treatment availability. Neurologists and GPT-4 mentioned 110 incorrect diagnoses, 83.6% of which were made by GPT-4, which also generated seven data hallucinations. The virtual assistant required an average of 14 questions and 1.5 minutes to generate a list of differential diagnoses, significantly faster than the neurologists (mean, 19.4 minutes).Conclusions: The virtual assistant proved to be accurate and easy fast-use for the diagnosis of chronic ataxias, potentially serving as a support tool in neurological consultation. This diagnostic approach could also be expanded to other neurological and non-neurological diseases.