development of an ensemble learning-based, multi-dimensional sensory impairment score to predict cognitive impairment in an elderly cohort of southern italy

Conditions: Sensory Impairments; Cognitive Impairment; Artificial Intelligence

Summary: there is now strong scientific literature showing a relationship between sensory loss and cognitive performance and between sensory loss and incident dementia. we take as our starting point that people with hearing, vision, and/or cognitive problems have poorer health outcomes, possibly due to due to common age-related mechanism(s), iatrogenic problems in the health care system (e.g., misdiagnosis), and/or the decay of social networks. with this evidence, our project will provide a better understanding of the relationship between sensory loss and cognitive loss in older adults with or at risk for dementia using objective technologies to measure sensory deficits that refer not only to vision loss, hearing loss, olfaction and taste but also to senses deemed atypical, i.e., nociception. in particular, the project aims: 1. to assess the specific association between different sensory measures (central and peripheral hearing loss, retinal abnormalities measured by oct, smell and taste objective measures, chronic pain, and proprioception subjective and electrophysiological measures. 2. to develop a multi-dimensional score using sensory features and clinical and lifestyle variables to predict the different types of dementia (alzheimer's disease, fronto-temporal dementia, and vascular dementia) at different stages (mild cognitive impairment and normal cognition). 3. to create a connectomic map of the mri morphologic and dynamic features of the dementia cases and their relationships with sensorial features, describing the patterns differences in respect to the normal cognition controls. to achieve the proposed aims, the synergic work of the four units involved in the proposal will be required. subject assessment will be divided between clinical setting (ics maugeri) and population setting (asl bari). irccs "s. de bellis" will provide expertise for both design refinement, creation and monitoring of deliverables and milestones, and technological support for sense measurements. finally, the features extracted in clinical populations afferent to the centers of the azienda sanitaria locale di bari and the neurological clinics of the ics maugeri will be analyzed with innovative methods by the polytechnic university of bari using artificial intelligence algorithms based on ensemble learning for the creation of a predictive score for cognitive impairment that takes into account both sensory and clinical aspects and related to lifestyles.

background / state of the art hearing, vision, olfaction, and taste represent a complex sensory neural construct biologically linked to age (gadkaree et al., 2016). several studies have described their role as predictors in age-related neurodegenerative processes, particularly those related to cognitive decline (brenowitz et al., 2020; schubert et al., 2017). hearing and vision are the most explored, providing robust population-based evidence (gates et al., 2010; panza et al., 2019; sardone, battista, et al., 2020) and using groundbreaking technologies, such as retinal imaging, in specific clinical settings for the latter. in its peripheral and central forms, hearing impairment has been considered one of the major modifiable risk factors for alzheimer's dementia(livingston et al., 2020). among the sensory inputs related to the perception of physical events in the body, nociception and proprioception represent a set of functions that are often underestimated in their cognitive processing. studies have shown how they are important not only in the global function of the elderly individual but also and especially in cognitive function. the interactions between aging processes and nociception are poorly investigated, particularly the relationship between chronic pain and global cognitive functions (nadar et al., 2016). in particular, there are no precise correlates between different objective cognitive function analysis technologies, such as mri and single or multiple interactions from sensory impairment. description and distribution of activities of each operating unit principal collaborators will have divided but integrated roles for the aims of the project. in particular, we can highlight two main branches of activities, with a list of the main activities for each research center: 1. study role: clinical and instrumental assessment * asl ba - controls enrollment and cognitive-behavioural assessment research expertise * scientific clinical institutes maugeri (ics-maugeri): cases enrollment and functional and somato-sensorial research expertise 2. study role: design, modelling and feature elaboration * irccs - study coordination, design, and formal analysis , sensory impairment research expertise * polytechnic university of bari (poliba)- data management and engineering, bio-signal processing (oct, electrophysiology, mri), and ensemble learning architectures development subject assessment will be divided between clinical setting (ics maugeri) and population setting (asl bari). irccs "s. de bellis" will provide expertise for both design refinement, creation and monitoring of deliverables and milestones, and technological support for sense measurements. in fact, the close collaboration between dr. rodolfo sardone and the pi and co-pi, shown by numerous publications in the field of sensory impairment and functional decline, ensures a well-established and effective synergy in the proposed area of expertise. ics maugeri, has also already collaborated with the group in other areas, but their role in this project will be truly innovative. they will be responsible for ensuring the recruitment of cases of demented individuals, whether with probable alzheimer's dementia or vascular dementia. they will also contribute dr. pavese's expertise in introducing functional and lifestyle measures to be administered to the entire sample of subjects. prof. natoli, on the other hand, will contribute her expertise in the field of chronic pain assessment, both with subjective and functional scales and in the interpretation of biomedical signals from morphological and functional mri. the technology group, essentially led by bari polytechnic, will be responsible for both the creation of the infrastructure for data collection, the processing of physiological signals (both electrophysiological and retinal imaging and mri) and all variables collected in the study populations. their expertise and synergistic collaborations with the group are showcased by a series of shared publications. specific aim 1 to assess the specific association between different sensory measures (central and peripheral hearing loss, retinal abnormalities measured by oct, smell and taste objective measures, chronic pain, and proprioception subjective and electrophysiological measures. specific aim 2 to develop a multi-dimensional score using sensory features and clinical and lifestyle variables to predict the different types of dementia (alzheimer's disease, fronto-temporal dementia, and vascular dementia) at different stages (mild cognitive impairment and normal cognition). specific aim 3 to create a connectomic map of the mri morphologic and dynamic features of the dementia cases and their relationships with sensorial features, describing the patterns differences in respect to the normal cognition controls. experimental design aim 1 study population: this longitudinal study will be conducted using a multi-centric cross-sectional nested case-control design using data from the casa della salute project in castellana grotte and from the clinical neuro-rehabilitation center of the ics maugeri - pavia. the cognitive impairment cases will be selected from the ics maugeri - pavia, unit of neurorehabilitation, and from the neuro-psychological outpatients unit of the casa della salute - aslba. the cognitive normal control group will be derived from the secondary data of the salus in the apulia study baseline. salus is an ongoing study, started in 2012, on a representative population of older residents in castellana grotte (puglia region, southern italy). the study design and data collection method are described in detail elsewhere (sardone et al. 2021). the sample included 2038 participants from the elderly (65+) residents in castellana grotte at the baseline (2012 to 2014). from this sample will be derived two sub- sample: one of the cognitively normal subjects and one with mild cognitive impairment according to the inclusion\\exclusion criteria. cases: the cases included will be on two different stages of cognitive impairment: mci and dementia. the inclusion criteria for the mci cases group will be: 1) to be at least 65 years old at the moment of enrollment: 2) to have an mci (montreal cognitive assessment, moca test, between 15.5-26) 3) to have a complete examination of the clinical, neuropsychological and sensory evaluations. the exclusion criteria for the case group will be 1) do not have the mental capacity to express consent at the follow-up; 2) have developed major malignancies or undergo major therapies could cause a loss in sensory function or cognitive decline; 3) be diagnosed with depression. the total number of mci cases will be 45. the inclusion criteria for the dementia cases group will be: 1) to be at least 65 years old at the moment of enrollment: 2) to have a mild to moderate cognitive impairment (montreal cognitive assessment, moca test, below 15.5) to have a complete examination of the clinical, neuropsychological and sensory evaluations. the exclusion criteria for the case group will be 1) do not have the mental capacity to express consent at the follow-up; 2) have developed major malignancies or undergo major therapies could cause a loss in sensory function or cognitive impairment; 3) be diagnosed with depression. the total number of dementia cases will be 22 (among all the study sites). control cohort: the inclusion criteria for the control cohort group will be: 1) to be at least 65 years old at the moment of enrollment: 2) to have a complete examination of the clinical, neuropsychological and sensory evaluations 3) to have no cognitive impairment (measured using moca greater 26). the total number of controls will be at least 151 (considering 1:5 allocation). methods: ophthalmologic, audiological, physical, sensorial (olfactory and taste), pain and cognitive data derived from the examination at each assessment time will be recorded using a cloud-based data input form, associating every measure and quantitative variable to a root code for every subject examined. further details are in section "methods of data collection". experimental design aim 2 all data derived from the examination at each assessment time will be recorded using a cloud-based data input form, associating every measure and quantitative variable to a root code for every subject examined. the personal data (e.g., name, age, sex, address) will be detached from the clinical data using a subdivision matrix with a translation code (unknown to the evaluators) that links the master data to the subject code. outcome: the cognitive decline will be considered the primary outcome, notably the transition for every subject from moca 15.5-26 to a moca score lower than 15.5. in addition, a reduction in moca score of 10% points will be considered a secondary outcome of cognitive decline at every assessment. multisensory score: the score will be calculated using different approaches to allow different combinations of sensitivity analyses to select the score with the most accurate prediction power. phenotype score will create an ordinal variable that cumulates every global impairment on each sense (e.g., hearing loss + vision loss yes\\no + hypogeusia + hyposmia) with a variable from 0 to 4. ensemble weighted score: every sense will be considered an independent weighted category depending on the number of sub-impairments that constitute the impaired sense. for example, the vision loss category will be created using the cut-offs for every oct-a macro-variable impaired (under the 25th percentile) and the low visual acuity cut-off. every variable will be implemented in a random forest machine learning model with the primary outcome as a dependent variable. the derived ranking (in terms of prediction power for cognitive decline) of variables will be used to weight each variable using the inverted rank as a multiplier for a weighted average using the total number of impairments as the denominator. unsupervised score: every continuous variable used to measure each sense (independently from the impaired side for ears and eyes) will be implemented in an autoencoder neural network algorithm, able to reduce the dimensionality of the variables. the encoders will create small coefficients (codes) explaining the total information derived from single variables. the codes will be used as predictors for each subject in further analysis. covariates: different covariates will be used as confounders of the association, particularly smoking, occupational and environmental exposure, education\\socio economical status, physical activity, and bmi. modelling: a number of adjusted cox proportional models and other non-parametric time-event models will be run to assess the association between the different scores proposed and the cognitive decline. in addition, sensitivity analysis will be used with different methods to determine the model in terms of best fitting and prediction power. due to the small number of observations in the models and considering the high number of covariates, particular attention to overfitting will be devoted, including regularised regression models. experimental design aim 3 brain mri acquisition and processing: a subsample of the participants will undergo a non-contrast-enhanced mri scanning on a 3t scanner. selected subjects already enrolled in the study will be selected according to the following criteria: n.5 with a central auditory processing disorder diagnosis n.5 with a central auditory processing disorder and cognitive impairment (moca lower than 17.5) n. 5 only with cognitive impairment (moca lower than 17.5) n. 15 normal hearing and cognitive controls the aim of this sub-study will be the description of morphological differences between the four small groups using both supervised and unsupervised machine learning feature extraction and non-parametric statistical learning methods. the differences should create new knowledge on the structural brain interactions between cognition and hearing functions in the older subjects. the controls will be enrolled all among the controls of the bari center, and the cases between bari and pavia, according to a convenience sampling until the reaching of the enrollment objective. the mri protocol will include a t1- weighted sequence, a proton density-weighted sequence, a fluid-attenuated inversion recovery (flair) sequence, and a t2¿ -weighted gradient echo sequence. for all sequences, the slice thickness will be 1.6 mm (zero-padded to 0.8 mm), except for the flair sequence for which this will be 2.5 mm. an automated brain tissue classification method, based on a k-nearest-neighbour-classifier algorithm, will be used to quantify the following: total intracranial volume (icv), total brain volume, grey matter (gm) volume, white matter (wm) volume, and cerebrospinal fluid volume (in mm3). voxel-based morphometry (vbm) will be performed according to an optimized vbm protocol. fmrib software library (fsl) will be used for vbm data processing, and all gm and wm density maps will be non-linearly registered to the standard icbm mni152 gm and wm template (montreal neurological institute) with a 1 mm × 1 mm × 1 mm voxel resolution. subsequently, spatial modulation and smoothing procedure with a 3 mm (fwhm 8 mm) isotropic gaussian kernel will be applied to all images (ikram et al. 2015). methods of data collection the personal data (e.g., name, age, sex, address) will be detached from the clinical data using a subdivision matrix with a translation code (unknown to the evaluators) that links the master data to the subject code. the research group from poliba will design, develop and implement an overall interactive system, including interfaces for data extraction, artificial intelligence (ai) algorithms for data analysis, user interfaces for data visualization and interaction for the data aforementioned. poliba will adopt a human-centred design approach \[iso9241-210\], thus actively involving the other partners in the iterative activities of requirements analysis and design of system prototypes of incremental complexity. poliba will also study recommendation algorithms for data composition, privacy-compliant, from heterogeneous sources and ai algorithms for data analysis. poliba will identify visualization characteristics based on sensorial/perceptual mechanisms which allow a more effective visualization, presentation and interaction. laboratory assessment: blood samples will be collected from all the participants and analyzed for inflammatory and metabolic biomarkers. physical \& cognitive assessment: the subjects will undergo a physical examination by a physician who will document all pertinent anamnestic information regarding sensory impairment and general health, particularly in the occupational or iatrogenic environment (e.g., exposure to ototoxic substances, optic and/or ionizing radiation), and lifestyle (e.g., nutritional status, smoking, education). actigraphs will be adopted to collect data on physical activity and sleep quality. the physical performance will be evaluated with motion technologies. further, data on socioeconomic status and mental and mood disorders will be collected. the moca test will be used to determine the subjects' cognitive level during the same session. the 30 item-geriatric depression scale (gds-30) will be used to identify individuals with depression. pain assessment: physical examination by a pain specialist and a specialist in physical medicine and rehabilitation who will evaluate the cause, severity, and nature of pain and its effects on daily function and quality of life. pain intensity will be evaluated according to the 11-point nrs (numerical rating scale). the brief pain inventory (bpi) questionnaire will be submitted to patients. quality of life will be assessed by the sf-36 questionnaire. pain thresholds will also be evaluated in all subjects by quantitative sensory testing (qst). hearing loss assessment: otoscopic and tympanometric examination to check for middle ear conditions. pure tone audiometry will be used to assess peripheral arhl in a soundproof studio with specialised headphones. the speech discrimination score (sds) will be defined as the percentage of recognition of a list of 10 phonetically balanced italian words at a 30 db sensation level over the pta threshold for each ear. the synthetic sentence identification with ipsilateral competitive message (ssi-icm) test, which measures central auditory dichotic processing, will be utilised to identify age- related capd. eye assessment: every participant will undergo a basic ophthalmological exam: 1) manual refraction and assessment of each eye's best-corrected visual acuity (bcva); 2) intraocular pressure and slit-lamp biomicroscopy; 3) the retinal optical coherence tomography with angiography (oct-a) will be scanned after pupil dilatation. taste and olfaction assessment: the olfactory function will be assessed using the battery "sniffin' sticks". individual pens will be provided to the participants, who will then be asked to categorise and describe the smells using four distinct descriptions for each cell. the four basic tastes (sweet, salty, bitter, and sour) will be tested for taste function with taste strips at concentrations above the threshold (burghart gmbh, wedel, germany). statistic plan the sample size was calculated in a case-control logic: considering the prevalence of the least common sensory impairment (age-related hearing loss) of 18% and an odds ratio (or) of 2.1 for the probability to observe cognitive impairment in subjects with age-related hearing loss with a confidence level of 95% and a desired power of the 80%, based on our previous study (sardone et al. 2020), the sample size will be of 22 cognitive impairment cases and 45 mild cognitive impairment for the cases and at least 151 subjects for the control cohort. patients will be enrolled according to a non-probabilistic convenience sampling with a target accrual of 218 patients, included and subdivided according to the inclusion/exclusion criteria described above. given the case-control research design of the study, the entire sample will be observed cross-sectionally for all the features included in the model. to comply with the proportion of the entire sample that is representative (15%) of the older population of an italian region, we will increase controls to at least 2 times the number of cases (n = 151), matched to cases using the nearest neighbor technique for age, sex, and education. feature engineering: all the data will be recorded using cloud-based input forms which can be used by all users participating in the research project in the various participating centers. the data will be interfaced via connectors directly to sense-measurement equipment and will integrate images from oct and mri with dicom technology. following collection, measurements of the completeness of the collected variables will be made. in case of missing a variable up to 30% of the entire dataset, multiple imputation chain equation will be operated above 30% the variables will be excluded from the analysis. each variable that will contribute to the creation of the score will be scaled in order to normalize its distribution and make its magnitudes comparable. this step is critical in handling large amounts of variables in the same model, especially if they are of different sources. the brain images will be post-processed and analyzed in the analysis phase, and they will be included in the database only after an accurate quality check. statistical analysis the sample will be divided into cases (two different stages of cognitive impairment: mci and dementia) and controls (neither condition). normal distributions of quantitative variables will be tested using the kolmogorov-smirnov test. therefore, clinical and functional differences will be described for the two groups in terms of frequency and associations between groups for all the variables and the features recorded during the study. normal distributions of quantitative variables will be tested using the kolmogorov¿smirnov test. data will be reported as mean±standard deviations (m±sd) for continuous measures and frequency and percentages (%) for all categorical variables. in order to focus on the practical differences between the groups, in terms of effect size (es) instead of p values, a statistical approach based on the null hypothesis significance test (nhst) will be not used. therefore es differences between continuous variables will be calculated using cohen's d difference between means, hedge's g when the assumption of a similar variance will be violated, and their es using the confidence intervals. their 95% confidence intervals (ci) will be calculated to assess essential differences in the magnitude of association. an ensemble machine learning algorithm for feature selection will be adopted to rank the predictive power of each covariate derived from the biological sample analysis using a shapley values ranking. statistical and machine learning methods: to select variables a machine learning model will be used: the random forest (rf). the rf is an ensemble model using bagging as the ensemble method and a decision tree as the individual model. this method is able both to select the variables and to rank them in terms of prediction power and most able to classify the selected outcome. every sense will be considered an independent weighted category depending on the number of sub-impairments that constitute the impaired sense. for example, the vision loss category will be created using the cut-offs for every oct-a macro-variable impaired (under the 75th percentile). every variable will be implemented in a random forest with the cognitive decline as a dependent variable. the derived ranking (in terms of prediction power for cognitive decline) of variables will be used to weight each variable using the inverted rank as a multiplier for a weighted average using the total number of impairments as the denominator. ensemble model will be selected because combining individual models, tends to be more flexible (less bias) and less data-sensitive (less variance). furthermore, to compare the association with the outcome, different multiple linear and/or logistic models (or other non- parametric models, depending on the variables) will be run to assess the association between the different levels of the scores proposed and the cognitive impairment. in addition, sensitivity analysis will be used with other methods to determine the model in terms of best fitting and prediction power. different covariates will be used as confounders of the association, particularly smoking, occupational and environmental exposure, education\\socio economic status, physical activity, and bmi. considering the high number of covariates, particular attention to overfitting will be devoted, including a regularized regression approach using different penalty regression meta-learners to find the best penalty term for each model (mahani and sharabiani, n.d.).

Eligibility criteria:
cases: the cases included will be on two different stages of cognitive impairment: mci and dementia. the inclusion criteria for the mci cases group will be: 1) to be at least 65 years old at the moment of enrollment: 2) to have an mci (montreal cognitive assessment, moca test, between 15.5-26) 3) to have a complete examination of the clinical, neuropsychological and sensory evaluations. the exclusion criteria for the case group will be 1) do not have the mental capacity to express consent at the follow-up; 2) have developed major malignancies or undergo major therapies could cause a loss in sensory function or cognitive decline; 3) be diagnosed with depression. the total number of mci cases will be 45. the inclusion criteria for the dementia cases group will be: 1) to be at least 65 years old at the moment of enrollment: 2) to have a mild to moderate cognitive impairment (montreal cognitive assessment, moca test, below 15.5) to have a complete examination of the clinical, neuropsychological and sensory evaluations. the exclusion criteria for the case group will be 1) do not have the mental capacity to express consent at the follow-up; 2) have developed major malignancies or undergo major therapies could cause a loss in sensory function or cognitive impairment; 3) be diagnosed with depression. the total number of dementia cases will be 22 (among all the study sites). control cohort: the inclusion criteria for the control cohort group will be: 1) to be at least 65 years old at the moment of enrollment: 2) to have a complete examination of the clinical, neuropsychological and sensory evaluations 3) to have no cognitive impairment (measured using moca greater 26). the total number of controls will be at least 151 (considering 1:5 allocation).

Keywords: artificial intelligence sensory impairments cognitive impairments