Skip to main content

Main menu

  • Home
  • Issues
    • Issue in progress
    • Issues by date
  • Sections
    • Editorial
    • Review
    • Research
    • Commentary
    • Psychopharmacology for the Clinician
    • Letters to the Editor
  • Topic Collections
  • Instructions for Authors
    • Overview for authors
    • Submission checklist
    • Editorial policies
    • Publication fees
    • Submit a manuscript
    • Dr. Francis Wayne Quan Memorial Prize
    • Open access
  • Alerts
    • Email alerts
    • RSS
  • About
    • General information
    • Staff
    • Editorial Board
    • Contact
  • CMAJ JOURNALS
    • CMAJ
    • CMAJ Open
    • CJS
    • JAMC

User menu

Search

  • Advanced search
JPN
  • CMAJ JOURNALS
    • CMAJ
    • CMAJ Open
    • CJS
    • JAMC
JPN

Advanced Search

  • Home
  • Issues
    • Issue in progress
    • Issues by date
  • Sections
    • Editorial
    • Review
    • Research
    • Commentary
    • Psychopharmacology for the Clinician
    • Letters to the Editor
  • Topic Collections
  • Instructions for Authors
    • Overview for authors
    • Submission checklist
    • Editorial policies
    • Publication fees
    • Submit a manuscript
    • Dr. Francis Wayne Quan Memorial Prize
    • Open access
  • Alerts
    • Email alerts
    • RSS
  • About
    • General information
    • Staff
    • Editorial Board
    • Contact
  • Subscribe to our alerts
  • RSS feeds
  • Follow JPN on Twitter
Research Paper

Magnetic resonance imaging texture predicts progression to dementia due to Alzheimer disease earlier than hippocampal volume

Subin Lee, Hyunna Lee and Ki Woong Kim; for the Alzheimer’s Disease Neuroimaging Initiative
J Psychiatry Neurosci January 01, 2020 45 (1) 7-14; DOI: https://doi.org/10.1503/jpn.180171
Subin Lee
From the Department of Brain & Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, Korea (S. Lee, Kim); the Health Innovation Big Data Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Korea (H. Lee); the Department of Neuropsychiatry, Seoul National University Bundang Hospital, Seongnam, Korea (Kim); and the Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea (Kim)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hyunna Lee
From the Department of Brain & Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, Korea (S. Lee, Kim); the Health Innovation Big Data Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Korea (H. Lee); the Department of Neuropsychiatry, Seoul National University Bundang Hospital, Seongnam, Korea (Kim); and the Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea (Kim)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ki Woong Kim
From the Department of Brain & Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, Korea (S. Lee, Kim); the Health Innovation Big Data Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Korea (H. Lee); the Department of Neuropsychiatry, Seoul National University Bundang Hospital, Seongnam, Korea (Kim); and the Department of Psychiatry, Seoul National University College of Medicine, Seoul, Korea (Kim)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF
Loading

Abstract

Background: Early identification of people at risk of imminent progression to dementia due to Alzheimer disease is crucial for timely intervention and treatment. We investigated whether the texture of MRI brain scans could predict the progression of mild cognitive impairment (MCI) to Alzheimer disease earlier than volume.

Methods: We constructed a development data set (121 people who were cognitively normal and 145 who had mild Alzheimer disease) and a validation data set (113 patients with stable MCI who did not progress to Alzheimer disease for 3 years; 40 with early MCI who progressed to Alzheimer disease after 12–36 months; and 41 with late MCI who progressed to Alzheimer disease within 12 months) from the Alzheimer’s Disease Neuroimaging Initiative. We analyzed the texture of the hippocampus, precuneus and posterior cingulate cortex using a grey-level co-occurrence matrix. We constructed texture and volume indices from the development data set using logistic regression. Using area under the curve (AUC) of receiver operator characteristics, we compared the accuracy of hippocampal volume, hippocampal texture and the composite texture of the hippocampus, precuneus and posterior cingulate cortex in predicting conversion from MCI to Alzheimer disease in the validation data set.

Results: Compared with hippocampal volume, hippocampal texture (0.790 v. 0.739, p = 0.047) and composite texture (0.811 v. 0.739, p = 0.007) showed larger AUCs for conversion to Alzheimer disease from both early and late MCI. Hippocampal texture showed a marginally larger AUC than hippocampal volume in early MCI (0.795 v. 0.726, p = 0.060). Composite texture showed a larger AUC for conversion to Alzheimer disease than hippocampal volume in both early (0.817 v. 0.726, p = 0.027) and late MCI (0.805 v. 0.753, p = 0.019).

Limitations: This study was limited by the absence of histological data, and the pathology reflected by the texture measures remains to be validated.

Conclusion: Textures of the hippocampus, precuneus and posterior cingulate cortex predicted conversion from MCI to Alzheimer disease at an earlier time point and with higher accuracy than hippocampal volume.

Introduction

The identification of people at risk for dementia due to Alzheimer disease is crucial for timely intervention and effective treatment. While amyloid and tau are sensitive markers of the disease, about 30%–50% of amyloid-positive elderly individuals are known to remain clinically normal, suggesting that the presence of these markers is not enough to cause dementia.1 Furthermore, such molecular changes are not markers of imminent conversion, because they accumulate as early as 2 decades before overt clinical onset and start to plateau during the stage of mild cognitive impairment (MCI).2 In contrast, structural brain changes are temporally closer to clinical manifestation and are a more direct cause of clinical symptoms. Therefore, structural MRI can provide evidence about the stage or severity of disease that may not be provided by amyloid measures3 and thus can be a more robust marker of imminent progression from MCI to dementia.

Hippocampal atrophy is currently the most widely applied structural MRI biomarker for the diagnosis of Alzheimer disease.4 However, atrophy may not be detected early enough to predict Alzheimer disease, because it occurs relatively downstream of the disease.2 Furthermore, volumetric information may not fully capture the neurodegenerative process in Alzheimer disease, which can involve changes at the microscopic level (i.e., amyloid deposition, chronic inflammation or spongiform changes) that may alter tissue characteristics without necessarily causing atrophy.5 On the other hand, T1 relaxation time from MRI is a direct reflection of such tissue characteristics and can independently predict histological measures of neuronal density.6,7 Such variations in relaxation time, which directly cause variations in MRI signal intensity, can harbour information beyond that provided by volumetric measures. A previous human study showed that age-dependent changes in the signal intensity of T1-weighted images occur independently of concurrent changes in cortical thickness,8 and a study in mice showed that changes in MRI signal intensity associated with dendritic changes in the amygdala following fear conditioning occurred in the absence of any volumetric changes.9 These findings point to the possible use of MRI signal intensity as a measure of neurodegeneration that may contain unique information about changes at the microscopic level that can occur before or concurrently with changes at the macroscopic level, such as atrophy, but independently of such changes.

Texture analysis is a quantitative measure of spatial patterns of local changes in signal intensity, and it can be used to detect subtle alterations in signal intensity.10 Texture is widely applied in medical image analysis, such as classification of multiple sclerosis11 and grading of brain tumours.12,13 Many studies have also applied texture to the classification of Alzheimer disease,14–23 under the working hypothesis that accumulated neuropathology in Alzheimer disease will be reflected as signal intensity changes associated with neuronal damage in brain tissue. Of these, 2 studies also applied texture to predicting progression from MCI to Alzheimer disease,14,20 suggesting that textural changes in early stages may be a valuable predictive marker of imminent progression.

However, several issues remain to be addressed. First, the theoretical value of texture lies in being able to detect changes earlier than with volume, but only 1 study has compared the predictive performance of texture and volume.20 Furthermore, that study looked at the predictive performance of texture in a heterogeneous group of patients with MCI with mixed time to progression. To determine the clinical value of texture, its predictive power in the early and late stages of MCI should be investigated separately. As well, to use texture to detect early changes, brain regions that show pathological changes earlier than the hippocampus or the temporal cortices (to which all previous studies have been limited) should be investigated. The precuneus and posterior cingulate cortex (PCC) undergo earlier neuropathological alterations24 than the hippocampus, and adding texture from these regions may add early predictive value.

The objective of this study was to determine whether textural measures in different stages of MCI can be a valuable predictive marker of imminent progression to Alzheimer disease. We investigated the predictive value of texture in the early prediction of Alzheimer disease progression compared with MRI hippocampal volume and in patients with early- and late-stage MCI separately. Specifically, we compared the performance of hippocampal volume, hippocampal texture and a combination of texture from the hippocampus, precuneus and PCC.

Methods

Study participants

We obtained MRI scans to construct a development data set and a validation data set from the Alzheimer’s Disease Neuroimaging Initiative 2 (ADNI2) database (adni.loni.usc.edu). For up-to-date information, see www.adni-info.org. The Alzheimer’s Disease Neuroimaging Initiative was approved by the institutional review board at each site, and all participants gave their written consent.

We used the development data set to develop indices of hippocampal volume and hippocampal texture, and a composite texture of hippocampus, precuneus and PCC to differentiate between Alzheimer disease and cognitively normal (CN) states. The development data set was constructed from the baseline or screening 3 T T1-weighted MRI scans of 145 patients with mild Alzheimer disease and 121 CN controls who participated in ADNI2 and completed follow-up evaluations for 2 years or longer. We included only patients with mild Alzheimer disease whose baseline total Clinical Dementia Rating was 0.5 or 1 and CN controls who maintained a CN diagnosis and a Clinical Dementia Rating sum of boxes score of 0 from baseline to at least 2 years of follow-up.

We used the validation data set to test the predictive validity of conversion from MCI to Alzheimer disease for the indices from the development data set. We constructed the validation data set using the baseline 3 T T1-weighted MRI scans of 194 patients with amnestic MCI who participated in ADNI2. Of those patients, 113 did not progress to Alzheimer disease for at least 3 years after baseline assessment (stable MCI, MCI-S), and 81 progressed to Alzheimer disease within 3 years (progressive MCI, MCI-P). In the MCI-P group, 40 progressed to Alzheimer disease 12–36 months after baseline evaluation (early MCI-P, MCI-PE) and 41 progressed to Alzheimer disease within 12 months of the baseline evaluation (late MCI-P, MCI-PL). We assumed that the longer time for conversion from MCI to Alzheimer disease indicated earlier stages of the disease.

MRI analysis

We used scanner-specific, optimally preprocessed 3 T T1-weighted MRI scans (e.g., gradient nonlinearity correction, B1 nonuniformity correction, histogram peak sharpening) downloaded from the ADNI2 database (details can be found at adni.loni.usc.edu). We resliced the original images to isovoxels (1 × 1 × 1 mm3) and used FreeSurfer 5.3.0 (surfer.nmr.mgh.harvard.edu) to obtain participant-specific masks of brain regions as defined by the Desikan–Killiany atlas.25 Briefly, this procedure involved motion correction of the T1-weighted images, removal of nonbrain tissue,26 automated Talairach transformation, segmentation of subcortical white matter and deep grey matter structures,27,28 intensity normalization,29 tessellation of the grey matter/white matter boundary, automated topology correction30,31 and surface deformation following intensity gradients.32–34 Once the cortical models were complete, they were registered to a spherical atlas,35 and the cerebral cortex parcellated into units with respect to gyral and sulcal structure.25,36 We mapped the brain parcellation mask for each participant from FreeSurfer space to the isovoxel native space and extracted 3 region-of-interest (ROI) masks (bilateral grey matter of the precuneus, PCC and hippocampus). The ROI masks were the results of collapsing the left- and right-hemisphere masks into a single bilateral mask. We visually checked for segmentation or registration errors by overlaying each participant’s native-space-transformed ROI masks onto their T1-weighted image.

To obtain bilateral volumes for the 3 ROIs, we summed the volumes of the left- and right-hemisphere ROIs returned by FreeSurfer.

To obtain texture measures of the brain regions, we conducted 3D grey-level co-occurrence matrix (GLCM) texture analysis37 in each ROI. Briefly, the GLCM is an N × N matrix where N is the total number of grey levels in the image and where each element of the matrix records the frequency of a certain voxel pairing (composed of a reference voxel with value i and a neighbouring voxel with value j, defined based on various offset distances d and directions θ) occurring in the image. This GLCM contains composite information about the spatial distributions of specific pairs of grey-level voxels and is used as an input to calculate various texture features37–43 that quantitatively represent different aspects of the homogeneity and heterogeneity of the grey-level image (described in Appendix 1, Table S1, available at jpn.ca/180171-a1). We chose the GLCM method not only because of its predominant use in previous Alzheimer disease literature on texture, but also for its relative ease of interpretation compared with other texture methods and its reliance on the relative rather than absolute value of the voxels in an image ( second-order v. first-order texture), which would make it less susceptible to interscan variability in signal-intensity values.

To conduct 3D GLCM analysis, we first applied the following preprocessing steps. We extracted ROI images with the original signal intensity values from each participant’s T1-weighted image and normalized the signal intensity in each ROI image by applying the ± 3σ normalization method. This method, which is the recommended normalization procedure for texture analysis, removes any voxels with intensity values beyond the μ ± 3σ range,44 thereby guarding against measurement error due to partial volume effects. Because texture analysis is generally assumed to be conducted over a homogeneous area (i.e., grey matter only), applying this method allowed us to exclude any voxels affected from neighbouring cerebrospinal fluid or white matter. We then performed quantization by rescaling all grey-level values in each histogram-normalized ROI image to a uniform range of 64. In GLCM analysis, grey levels are typically scaled down to 32 or 64 instead of using the original grey levels (in the thousands), to avoid too many zero-valued entries, which can prevent statistical problems from sparse matrices.45 We found 64 to be an appropriate quantization level, because the histogram-normalized ROIs typically had tens to hundreds of grey levels (e.g., the precuneus had 67–1468 grey levels). Next, in each ROI, we computed 3D GLCMs for voxel pairs of within d = 1 of each other in 13 possible directions.46 In this manner, we could consider the spatial relations of voxels not only from the same slice, but also from adjacent slices. We then calculated 21 texture features for each of the 13 GLCMs and averaged them. These averaged texture features were obtained from each of the ROIs, yielding 63 texture features in total (21 features per region × 3 regions). Texture analyses were performed in subject space and did not involve spatial normalization to avoid introducing artifacts or distorting original signal intensities.

Statistical analysis

We compared continuous variables using independent-sample t tests or 1-way analyses of variance, and categorical variables using χ2 tests. We considered a 2-sided p < 0.05 to be statistically significant.

We derived model parameters for hippocampal volume, hippocampal texture and composite texture that discriminated between Alzheimer disease and CN status in the development data set using logistic regression. For the hippocampal volume index, we entered hippocampal volume, age and sex as independent variables. While the main objective of our study was to compare texture with hippocampal volume (the current structural MRI measure in Alzheimer disease diagnostic criteria), we also created a composite volume index with the volumes of the 3 ROIs, age and sex.

For the hippocampal and composite texture indices, we found that many texture features were intercorrelated (variance inflation factor > 20), unlike in the volume models (variation inflation factor < 2). This multicollinearity can result in unstable model parameters, as well as overfitting. Thus, we used an additional regularization step in the logistic regression using the glmnet library (stanford.edu/~hastie/glmnet_matlab/) on Matlab.47 Glmnet regularizes the size of the coefficients by applying a mixture of 2 different regularization methods — ridge regression and least absolute shrinkage and selection operator (LASSO) — and has been used successfully in other Alzheimer disease classification studies involving high-dimensional MRI data.48–50 The regularized logistic regression (RLR)51,52 procedure involves first optimizing the 2 hyperparameters λ and α: λ controls the amount of coefficient regularization, and α (0 to 1) controls the weight given to ridge regression (α= 0) and LASSO (α = 1). Ridge regression handles multicollinearity by shrinking all coefficients smoothly toward 0 but retains all variables in the model, while LASSO performs both coefficient shrinking and feature selection to offer a model that is simple but that can be unstable in the presence of multicollinearity. Glmnet uses an elastic net approach to optimally combine the 2 regularization methods to yield more stable and accurate estimates than with either alone, while maintaining model parsimony.52 Hyperparameter optimization is performed by repetitively conducting 10-fold cross-validation on the development data set, with various hyperparameter values. Briefly, the development data set is divided into 10 randomly formed subgroups with 1 assigned as a test set and the remaining 9 as the training set. A model derived from the training set is applied to the test set, and this process is repeated 10 times, each time using a different subgroup as the test set. The mean performance across the 10 test sets, which is the mean cross-validated accuracy (measured via area under the curve [AUC]), is calculated for each combination of hyperparameters λ and α. The hyperparameter values that return the highest mean cross-validated accuracy are then used as inputs to an RLR analysis of the whole development data set, along with the texture features of age and sex. From here, we obtained a set of model parameters for hippocampal or composite textures.

We then applied the model parameters for texture and volume from the development data set to the validation data set to yield logit scores for each individual: hippocampal volume index (HVI), hippocampal texture index (HTI), composite texture index (CTI) and composite volume index (CVI). The composite indices included measures from all 3 ROIs (precuneus, PCC, hippocampus). We used AUC from receiver operator characteristics analyses to evaluate the accuracy of conversion from MCI to Alzheimer disease, and used DeLong tests53 to compare the AUCs among the HVI, HTI and CTI for predicting conversion from MCI to Alzheimer disease.

Results

The demographic and clinical characteristics of the participants are summarized in Table 1.

View this table:
  • View inline
  • View popup
Table 1

Baseline characteristics of the participants*

The model parameters for HVI, HTI and CTI obtained from the development data set are summarized in Table 2. Hyperparameter optimization in both the hippocampal texture model and composite texture model revealed that giving equal weight (α = 0.5) to both the LASSO and ridge regression methods gave the highest cross-validated AUC (result of 10-fold cross validation) for discriminating Alzheimer disease from CN status (AUC = 0.920 to 0.936). Thus, the estimated model parameters for both texture models reflected a mix of balance between selection of the most relevant features and model stability. The final parameters of the texture models included the intercept and non-zero coefficients. The hippocampal texture model included 15 of 21 features, and the composite texture model included 27 of 63 features. Cluster shade, maximum probability, sum average and information measures of correlation I were commonly chosen in all 3 regions. Of note is that glmnet returns coefficients in the original scale of the features, meaning that because of the various value ranges of each feature, the coefficients in Table 2 can seem fluctuous. Features with very small coefficients such as cluster shade have very high absolute values, ranging in the thousands, whereas features with large coefficients such as energy have very low subdecimal values. However, during actual calculation, the features were automatically standardized before being fitted to the RLR model.

View this table:
  • View inline
  • View popup
Table 2

Model parameters for HVI, HTI and CTI

Texture and volume for predicting progression to Alzheimer disease

The results for texture and volume in the validation data set are shown in Figure 1. In discriminating MCI-S from MCI-P, MCI-PE and MCI-PL, the performance of CTI did not significantly increase from that of HTI (p = 0.177, 0.272 and 0.338, respectively). However, both HTI (AUC = 0.790) and CTI (AUC = 0.811) discriminated MCI-P from MCI-S better than HVI (AUC = 0.739, p = 0.047 for HTI and p = 0.007 for CTI). Furthermore, HTI was able to predict Alzheimer disease conversion marginally better than HVI in early MCI (AUC = 0.795 v. 0.726, p = 0.06), but not in late MCI (AUC = 0.785 v. 0.753, p = 0.249). In the case of CTI, it predicted better than HVI in both early (AUC = 0.817 v. 0.726, p = 0.029) and late MCI (AUC = 0.805 v. 0.753, p = 0.019).

Fig. 1
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 1

Receiver operating characteristic (ROC) analysis for predicting conversion from mild cognitive impairment (MCI) to Alzheimer disease. Circles indicate points corresponding to Youden’s index for each ROC curve. AUC = area under the curve; CTI = composite texture index; HTI = hippocampal texture index; HVI = hippocampal volume index; MCI-P = patients with MCI who progressed to Alzheimer disease within 36 months of baseline evaluation; MCI-PE = patients with early-stage MCI who progressed to Alzheimer disease 12–36 months after baseline evaluation; MCI-PL = patients with late-stage MCI who progressed to Alzheimer disease within 12 months of baseline evaluation; MCI-S = patients with MCI who did not progress to Alzheimer disease within 36 months of baseline evaluation; SE = standard error.

Our main analyses compared texture to HVI, but we also conducted comparison analyses with CVI (not shown). In discriminating MCI-S from MCI-P and MCI-PE, CVI showed a nonsignificant increase in sensitivity compared with HVI (p = 0.136 and 0.589, respectively). As well, CTI remained more accurate than CVI for MCI-S versus MCI-P (AUC = 0.811 v. 0.769, p = 0.06) and MCI-S versus MCI-PE (AUC = 0.817 v. 0.741, p = 0.027). However, for MCI-S versus MCI-PL, CVI showed a significant increase (p = 0.044) compared to HVI and reached performance similar to that of CTI (AUC = 0.805 v. 0.797, p = 0.709).

We also investigated the possible impact of regularization on the performance of CTI and HTI over HVI. Using forward stepwise logistic regression (no regularization) for texture resulted in an HTI model with 5 features and a CTI model with 7 features (not shown), similar to the number of features for HVI (1 feature) and CVI (3 features). The nonregularized HTI and CTI remained more accurate than HVI for MCI-S versus MCI-P (AUC = 0.790 and 0.802 for nonregularized HTI and CTI, respectively) and for MCI-S versus MCI-PE (AUC = 0.795 and 0.805 for nonregularized HTI and CTI, respectively). For MCI-S versus MCI-PL, performance relative to HVI was similar (AUC = 0.786 and 0.799 for nonregularized HTI and CTI, respectively).

Discussion

This study showed that texture in brain MRI can be used to predict progression to Alzheimer disease in patients with MCI. The accuracy of texture in predicting conversion from MCI to Alzheimer disease (AUC = 0.79 to 0.82) reported in the present study was highest among those reported previously using structural brain MRI from ADNI. This may have been partly because of differences in field strength and the data set used (1.5 T ADNI1 data set v. 3 T ADNI2 data set), but the type of texture analysis could also have contributed. This study used second-order statistics (GLCM features) in the texture analysis, whereas previous studies that reported AUCs of 0.67 to 0.74 in predicting conversion from MCI to Alzheimer disease used spectral-based textures.14,20 It is also of note that although there were differences in the number of features and the classification method used for texture and volume, our analyses with the nonregularized texture indices provided results similar to the regularized texture indices, showing that differences in method were not the driving force behind the observed differences in accuracy between texture and volume.

In particular, texture in brain MRI showed higher performance in predicting conversion to Alzheimer disease in earlier stages of MCI compared with volume. A couple of studies investigated whether the texture of the hippocampus or medial temporal lobes can predict conversion from MCI to Alzheimer disease.14,20 However, one of those studies did not examine whether texture measures predicted conversion to Alzheimer disease earlier than volume measures.14 The other study did not directly compare the predictive performance of the texture measures for conversion to Alzheimer disease in early versus late MCI; instead, it reported that texture outperformed volume when observing conversion to Alzheimer disease for 24 months rather than for 12 months.20 This left it unclear as to whether the higher performance for the 24-month observation was because of differences in statistical power or actual differences in sensitivity to early MCI. The findings of the present study suggest that, compared with volume measures, texture measures may be more sensitive to early changes in the brain that have already occurred in patients with MCI, even up to 3 years before progression to Alzheimer disease. This result was in agreement with the findings of previous reports that microstructural changes precede macroscopic atrophy5,54 and that texture measures may reflect microstructural information unique from that provided by volumetric measures.20,55 Simoes and colleagues showed in a voxelwise comparison that the brain areas selected as differentiating between MCI and CN status were not the same in texture feature maps and grey matter density maps,55 and Sorensen and colleagues reported that both texture and volume played complementary roles in diagnosing Alzheimer disease.20

Interpretations of what texture reflects should be made with caution in the absence of histological data, but there is converging evidence that T1 relaxation time in cortical grey matter is negatively associated with histological measures of neuronal density.6,7 Indeed, T1 relaxation time is related to many factors in tissue, such as macromolecular concentration, water binding and water content.56 Loss of neuronal cell bodies (leading to reduced neuronal density), as would happen in Alzheimer disease, can result in a net loss of macromolecules in affected regions of the cortex, increasing free water in the extracellular space. Increased water content in the brain tissue leads to longer T1 relaxation times, which result in decreased signal intensity on T1-weighted MRI. Other suggested mechanisms in the literature include structure and density of intracortical myelin, bioaccumulation of iron deposits and altered water content modulated by altered synaptic density.8 Overall, a combination of these factors can lead to a pattern of changes in signal intensity that are subtle and complex, but quantifiable through textural measures. The combination of factors that cause signal intensity changes, particularly in the early stages, may not be robust enough for identifying Alzheimer disease using first-order statistics, which depend on absolute intensity values. Meanwhile, second-order statistics, which analyze the changes in spatial relationships between voxels, would still be able to detect a difference despite a minuscule change in signal intensity of a voxel.

The current study also showed the additive benefits of including textures from regions of earlier pathological change than the hippocampus. Similar to the hippocampus, the precuneus and PCC are regions of slightly accelerated atrophy rates near dementia onset. One longitudinal voxel-based morphometry study found that while MCI converters and nonconverters showed no difference in grey matter loss over 18 months in the temporal neocortex, parahippocampal cortex, and orbitofrontal and inferior parietal areas, converters showed accelerated atrophy compared with nonconverters in the hippocampal area, inferior and middle temporal gyrus, precuneus and PCC.57 However, the precuneus and PCC are also key sites of the heavy amyloid accumulation and reduced glucose metabolism that begin in very early phases before hippocampal atrophy.58 Thus, higher accumulations of microstructural abnormalities in these regions as a result of relatively earlier pathology might have contributed to the additional differentiability of composite texture compared with hippocampal texture or volume. Even when comparing the performance of composite texture with a composite index of volume from the same 3 regions, texture was significantly more sensitive than volume in detecting future progression in early-stage MCI (AUC = 0.817 v. 0.741, p = 0.027). One study did not find texture differences in the precuneus and PCC between Alzheimer disease and patients who were CN, but the voxelwise texture analysis in that study employed only 1 feature per texture map.59 Any single texture feature of brain MRI would not be sufficient to reflect the complex patterns of neuropathology in the brain.

Limitations

One limitation of the present study was that we had no histological data to validate what we saw through texture. Future studies should be conducted on the pathological correlates of texture to gain further insight into the microscopic alterations reflected in measurement of texture. Furthermore, longitudinal studies tracking the temporal relationship between texture changes and volume changes should provide more insight into the dynamics between the 2 measures. A potentially confounding factor in texture analysis is the accuracy of ROI segmentation and noise from adjacent voxels along the boundary between grey matter and white matter. To correct for this, Sorensen and colleagues removed the surface of the hippocampus and analyzed the interior, resulting in a hippocampus half the original size.20 In the current study, we removed voxels that lay outside the ±3σ range, because voxels of another tissue class would likely be among the outliers. As well, MRI field strength can influence texture analysis to some degree. In our study, we used high-field 3 T images, which are more favourable because of higher signal-to-noise ratio, but many others used 1.5 T images. Another possible limitation is that although texture showed a consistent trend toward higher performance than volume overall, there was a risk of type I error without correcting the AUC comparisons. Future studies in larger samples will need to be conducted to further validate our findings.

Conclusion

Texture features of the hippocampus, precuneus and PCC in brain MRI predicted progression from MCI to Alzheimer disease at an earlier time point and with higher accuracy than hippocampal volume.

Acknowledgements

The authors thank Nick C. Fox for comments on the manuscript, and Da-Yea Song for assistance in collection of data. This study was supported by a grant from the Korean Health Technology R&D Project, Ministry of Health, Welfare, Republic of Korea (grant no. HI09C1379 [A092077]). Data collection and sharing for this project were funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI; National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie; Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research provides funds to support ADNI clinical sites in Canada. Private-sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California.

Footnotes

  • Alzheimer’s Disease Neuroimaging Initiative investigators: A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf. Data used in preparation of this article were obtained from the ADNI database (adni.loni.usc.edu). As such, the ADNI investigators contributed to the design and implementation of ADNI and/or provided data, but did not participate in analysis or writing of this report.

  • Competing interests: H. Lee declares no competing interests. S. Lee and K.W. Kim have a patent relating to the content of this manuscript.

  • Contributors: All authors designed the study. S. Lee acquired and analyzed the data, which K.W. Kim also analyzed. S. Lee and K.W. Kim wrote the article, which all authors reviewed. All authors approved the final version to be published and can certify that no other individuals not listed as authors have made substantial contributions to the paper.

  • Received September 23, 2018.
  • Revision received December 17, 2018.
  • Revision received January 25, 2019.
  • Revision received March 5, 2019.
  • Accepted March 8, 2019.

References

  1. ↵
    1. Driscoll I,
    2. Troncoso J
    .Asymptomatic Alzheimer’s disease: a prodrome or a state of resilience?.Curr Alzheimer Res 2011;8:330–5.
    OpenUrlCrossRefPubMed
  2. ↵
    1. Jack CR,
    2. Knopman DS,
    3. Jagust WJ,
    4. et al
    .Hypothetical model of dynamic biomarkers of the Alzheimer’s pathological cascade.Lancet Neurol 2010;9:119–28.
    OpenUrlCrossRefPubMed
  3. ↵
    1. Jack CR Jr.,
    2. Lowe VJ,
    3. Senjem ML,
    4. et al
    .11C PiB and structural MRI provide complementary information in imaging of Alzheimer’s disease and amnestic mild cognitive impairment.Brain 2008;131:665–80.
    OpenUrlCrossRefPubMed
  4. ↵
    1. Albert MS,
    2. DeKosky ST,
    3. Dickson D,
    4. et al
    .The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease.Alzheimers Dement 2011;7:270–79.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Weston PSJ,
    2. Simpson IJA,
    3. Ryan NS,
    4. et al
    .Diffusion imaging changes in grey matter in Alzheimer’s disease: a potential marker of early neurodegeneration.Alzheimers Res Ther 2015;7:47
    OpenUrlCrossRefPubMed
  6. ↵
    1. Goubran M,
    2. Hammond RR,
    3. de Ribaupierre S,
    4. et al
    .Magnetic resonance imaging and histology correlation in the neocortex in temporal lobe epilepsy.Ann Neurol 2015;77:237–50.
    OpenUrl
  7. ↵
    1. Schmierer K,
    2. Parkes HG,
    3. So P-W,
    4. et al
    .High field (9.4 Tesla) magnetic resonance imaging of cortical grey matter lesions in multiple sclerosis.Brain 2010;133:858–67.
    OpenUrlCrossRefPubMed
  8. ↵
    1. Westlye LT,
    2. Walhovd KB,
    3. Dale AM,
    4. et al
    .Differentiating maturational and aging-related changes of the cerebral cortex by use of thickness and signal intensity.Neuroimage 2010;52:172–85.
    OpenUrlCrossRefPubMed
  9. ↵
    1. Keifer OP Jr.,
    2. Hurt RC,
    3. Gutman DA,
    4. et al
    .Voxel-based morphometry predicts shifts in dendritic spine density and morphology with auditory fear conditioning.Nat Commun 2015;6:7582
    OpenUrlCrossRefPubMed
  10. ↵
    1. Zhang Y,
    2. Moore GRW,
    3. Laule C,
    4. et al
    .Pathological correlates of magnetic resonance imaging texture heterogeneity in multiple sclerosis.Ann Neurol 2013;74:91–9.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Zhang J,
    2. Tong L,
    3. Wang L,
    4. et al
    .Texture analysis of multiple sclerosis: a comparative study.Magn Reson Imaging 2008;26:1160–6.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Hu LS,
    2. Ning S,
    3. Eschbacher JM,
    4. et al
    .Multi-parametric MRI and texture analysis to visualize spatial histologic heterogeneity and tumor extent in glioblastoma.PLoS One 2015;10:e0141506
    OpenUrlCrossRefPubMed
  13. ↵
    1. Zacharaki EI,
    2. Wang S,
    3. Chawla S,
    4. et al
    .Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme.Magn Reson Med 2009;62:1609–18.
    OpenUrlCrossRefPubMed
  14. ↵
    1. Chincarini A,
    2. Bosco P,
    3. Calvini P,
    4. et al
    .Local MRI analysis approach in the diagnosis of early and prodromal Alzheimer’s disease.Neuroimage 2011;58:469–80.
    OpenUrlCrossRefPubMed
    1. de Oliveira MS,
    2. Balthazar ML,
    3. D’Abreu A,
    4. et al
    .MR imaging texture analysis of the corpus callosum and thalamus in amnestic mild cognitive impairment and mild Alzheimer disease.AJNR Am J Neuroradiol 2011;32:60–6.
    OpenUrlAbstract/FREE Full Text
    1. Jiang G,
    2. Wang X,
    3. Tong L
    .Study of correlation between hippocampus’s texture and morphological features in Alzheimer’s disease patients based on MR imageDossel O, Schlegel WCWorld Congress on Medical Physics and Biomedical Engineering, September 7–12, 2009, Munich, Germany: image processing, biosignal processing, modelling and simulation, biomechanics254Heidelberg, GermanySpringer Berlin20101908–11.
    OpenUrl
    1. Keserwani P,
    2. Pammi VC,
    3. Prakash O,
    4. et al
    .Classification of Alzheimer disease using Gabor texture feature of hippocampus region.Int J Image Graphics Signal Processing 2016;8:13
    OpenUrl
    1. Li M,
    2. Oishi K,
    3. He X,
    4. et al
    .An efficient approach for differentiating Alzheimer’s disease from normal elderly based on multi-center MRI using gray-level invariant features.PLoS One 2014;9:e105563
    OpenUrl
    1. Sarwinda D,
    2. Bustamam A
    .Detection of Alzheimer’s disease using advanced local binary pattern from hippocampus and whole brain of MR images2016 International Joint Conference on Neural Networks (IJCNN)2016 Jul. 24–29Vancouver (BC)New YorkIEEE20165051–6.
  15. ↵
    1. Sorensen L,
    2. Igel C,
    3. Hansen NL,
    4. et al
    .Early detection of Alzheimer’s disease using MRI hippocampal texture.Hum Brain Mapp 2016;37:1148–61.
    OpenUrlCrossRef
    1. Xia H,
    2. Tong L,
    3. Zhou X,
    4. et al
    .Texture analysis and volumetry of hippocampus and medial temporal lobe in patients with Alzheimer’s Disease2012 International Conference on Biomedical Engineering and Biotechnology2012 May 28–30Macao, ChinaNew YorkIEEE2012905–8.
    1. Zhang J,
    2. Yu C,
    3. Jiang G,
    4. et al
    .3D texture analysis on MRI images of Alzheimer’s disease.Brain Imaging Behav 2012;6:61–9.
    OpenUrlCrossRefPubMed
  16. ↵
    1. Freeborough PA,
    2. Fox NC
    .MR image texture analysis applied to the diagnosis and tracking of Alzheimer’s disease.IEEE Trans Med Imaging 1998;17:475–8.
    OpenUrlCrossRefPubMed
  17. ↵
    1. Maarouf CL,
    2. Kokjohn TA,
    3. Walker DG,
    4. et al
    .Biochemical assessment of precuneus and posterior cingulate gyrus in the context of brain aging and Alzheimer’s disease.PLoS One 2014;9:e105784
    OpenUrl
  18. ↵
    1. Desikan RS,
    2. Segonne F,
    3. Fischl B,
    4. et al
    .An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest.Neuroimage 2006;31:968–80.
    OpenUrlCrossRefPubMed
  19. ↵
    1. Segonne F,
    2. Dale AM,
    3. Busa E,
    4. et al
    .A hybrid approach to the skull stripping problem in MRI.Neuroimage 2004;22:1060–75.
    OpenUrlCrossRefPubMed
  20. ↵
    1. Fischl B,
    2. Salat DH,
    3. Busa E,
    4. et al
    .Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain.Neuron 2002;33:341–55.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Fischl B,
    2. Salat DH,
    3. Van Der Kouwe AJ,
    4. et al
    .Sequence-independent segmentation of magnetic resonance images.Neuroimage 2004;23:S69–84.
    OpenUrlCrossRefPubMed
  22. ↵
    1. Sled JG,
    2. Zijdenbos AP,
    3. Evans AC
    .A nonparametric method for automatic correction of intensity nonuniformity in MRI data.IEEE Trans Med Imaging 1998;17:87–97.
    OpenUrlCrossRefPubMed
  23. ↵
    1. Fischl B,
    2. Liu A,
    3. Dale AM
    .Automated manifold surgery: constructing geometrically accurate and topologically correct models of the human cerebral cortex.IEEE Trans Med Imaging 2001;20:70–80.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Segonne F,
    2. Pacheco J,
    3. Fischl B
    .Geometrically accurate topology-correction of cortical surfaces using nonseparating loops.IEEE Trans Med Imaging 2007;26:518–29.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Dale AM,
    2. Fischl B,
    3. Sereno MI
    .Cortical surface-based analysis: I. Segmentation and surface reconstruction.Neuroimage 1999;9:179–94.
    OpenUrlCrossRefPubMed
    1. Dale AM,
    2. Sereno MI
    .Improved localizadon of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: a linear approach.J Cogn Neurosci 1993;5:162–76.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Fischl B,
    2. Dale AM
    .Measuring the thickness of the human cerebral cortex from magnetic resonance images.Proc Natl Acad Sci U S A 2000;97:11050–5.
    OpenUrlAbstract/FREE Full Text
  27. ↵
    1. Fischl B,
    2. Sereno MI,
    3. Tootell RB,
    4. et al
    .High-resolution intersubject averaging and a coordinate system for the cortical surface.Hum Brain Mapp 1999;8:272–84.
    OpenUrlCrossRefPubMed
  28. ↵
    1. Fischl B,
    2. Van Der Kouwe A,
    3. Destrieux C,
    4. et al
    .Automatically parcellating the human cerebral cortex.Cereb Cortex 2004;14:11–22.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Haralick RM,
    2. Shanmugam K,
    3. Dinstein IH
    .Textural features for image classification.IEEE Trans Syst Man Cybern 1973;6:610–21.
    OpenUrl
    1. Clausi DA
    .An analysis of co-occurrence texture statistics as a function of grey level quantization.Can J Rem Sens 2002;28:45–62.
    OpenUrlCrossRef
    1. Soh L-K,
    2. Tsatsoulis C
    .Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices.IEEE Trans Geosci Rem Sens 1999;37:780–95.
    OpenUrl
    1. Albregtsen F
    (2008) Statistical texture measures computed from gray level coocurrence matrices (Image Processing Laboratory, Department of Informatics, University of Oslo, Oslo, Norway).
    1. Alonso-Caneiro D,
    2. Szczesna-Iskander DH,
    3. Iskander DR,
    4. et al
    .Application of texture analysis in tear film surface assessment based on videokeratoscopy.J Optom 2013;6:185–93.
    OpenUrl
    1. van Griethuysen JJM,
    2. Fedorov A,
    3. Parmar C,
    4. et al
    .Computational radiomics system to decode the radiographic phenotype.Cancer Res 2017;77:e104–07.
    OpenUrlAbstract/FREE Full Text
  30. ↵
    1. Linfoot EH
    .An informational measure of correlation.Inf Control 1957;1:85–9.
    OpenUrlCrossRef
  31. ↵
    1. Collewet G,
    2. Strzelecki M,
    3. Mariette F
    .Influence of MRI acquisition protocols and image intensity normalization methods on texture classification.Magn Reson Imaging 2004;22:81–91.
    OpenUrlCrossRefPubMed
  32. ↵
    1. Mahmoud-Ghoneim D,
    2. Alkaabi MK,
    3. de Certaines JD,
    4. et al
    .The impact of image dynamic range on texture classification of brain white matter.BMC Med Imaging 2008;8:18
    OpenUrlCrossRefPubMed
  33. ↵
    1. Ortiz A,
    2. Palacio AA,
    3. Gorriz JM,
    4. et al
    .Segmentation of brain MRI using SOM-FCM-based method and 3D statistical descriptors.Comput Math Methods Med 2013;2013
  34. ↵
    1. Qian JHT,
    2. Friedman J,
    3. Tibshirani R,
    4. et al.
    (2013) Glmnet for Matlab, Available: www.stanford.edu/~hastie/glmnet_matlab/. accessed 2019 Jun 18.
  35. ↵
    1. Casanova R,
    2. Hsu F-C,
    3. Espeland MA,
    4. et al
    .Classification of structural MRI images in Alzheimer’s disease from the perspective of ill-posed problems.PLoS One 2012;7:e44877
    OpenUrlPubMed
    1. Casanova R,
    2. Hsu F-C,
    3. Sink KM,
    4. et al
    .Alzheimer’s disease risk assessment using large-scale machine learning methods.PLoS One 2013;8:e77949
    OpenUrl
  36. ↵
    1. Casanova R,
    2. Whitlow CT,
    3. Wagner B,
    4. et al
    .High dimensional classification of structural MRI Alzheimer’s disease data based on large scale regularization.Front Neuroinform 2011;5:22
    OpenUrl
  37. ↵
    1. Friedman J,
    2. Hastie T,
    3. Tibshirani R
    .Regularization paths for generalized linear models via coordinate descent.J Stat Softw 2010;33:1–22.
    OpenUrlCrossRefPubMed
  38. ↵
    1. Kessler RC,
    2. Warner CH,
    3. Ivany C,
    4. et al
    .Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).JAMA Psychiatry 2015;72:49–57.
    OpenUrl
  39. ↵
    1. DeLong ER,
    2. DeLong DM,
    3. Clarke-Pearson DL
    .Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.Biometrics 1988;44:837–45.
    OpenUrlCrossRefPubMed
  40. ↵
    1. Frisoni GB,
    2. Fox NC,
    3. Jack CR,
    4. et al
    .The clinical use of structural MRI in Alzheimer disease.Nat Rev Neurol 2010;6:67–77.
    OpenUrlCrossRefPubMed
  41. ↵
    1. Simoes R,
    2. Slump C,
    3. van Cappellen van Walsum
    .Using local texture maps of brain MR images to detect mild cognitive impairmentProceedings of the 21st International Conference on Pattern Recognition (ICPR2012)2012 Nov 11–15Tsukuba, JapanNew YorkIEEE2012153–6.
  42. ↵
    1. Gowland PA,
    2. Stevenson VL
    .T1: the longitudinal relaxation timeTofts PQuantitative MRI of the brainChichesterJohn Wiley & Sons2004111–41.
  43. ↵
    1. Chetelat G,
    2. Landeau B,
    3. Eustache F,
    4. et al
    .Using voxel-based morphometry to map the structural changes associated with rapid conversion in MCI: a longitudinal MRI study.Neuroimage 2005;27:934–46.
    OpenUrlCrossRefPubMed
  44. ↵
    1. Mosconi L
    .Brain glucose metabolism in the early and specific diagnosis of Alzheimer’s disease. FDG-PET studies in MCI and AD.Eur J Nucl Med Mol Imaging 2005;32:486–510.
    OpenUrlCrossRefPubMed
  45. ↵
    1. Maani R,
    2. Yang YH,
    3. Kalra S
    .Voxel-based texture analysis of the brain.PLoS One 2015;10:e0117759
    OpenUrl
PreviousNext
Back to top

In this issue

Journal of Psychiatry and Neuroscience: 45 (1)
J Psychiatry Neurosci
Vol. 45, Issue 1
1 Jan 2020
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on JPN.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Magnetic resonance imaging texture predicts progression to dementia due to Alzheimer disease earlier than hippocampal volume
(Your Name) has sent you a message from JPN
(Your Name) thought you would like to see the JPN web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Magnetic resonance imaging texture predicts progression to dementia due to Alzheimer disease earlier than hippocampal volume
Subin Lee, Hyunna Lee, Ki Woong Kim
J Psychiatry Neurosci Jan 2020, 45 (1) 7-14; DOI: 10.1503/jpn.180171

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
‍ Request Permissions
Share
Magnetic resonance imaging texture predicts progression to dementia due to Alzheimer disease earlier than hippocampal volume
Subin Lee, Hyunna Lee, Ki Woong Kim
J Psychiatry Neurosci Jan 2020, 45 (1) 7-14; DOI: 10.1503/jpn.180171
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

Similar Articles

Content

  • Current issue
  • Past issues
  • Collections
  • Alerts
  • RSS

Authors & Reviewers

  • Overview for Authors
  • Submit a manuscript
  • Manuscript Submission Checklist

About

  • General Information
  • Staff
  • Editorial Board
  • Contact Us
  • Advertising
  • Reprints
  • Copyright and Permissions
  • Accessibility
  • CMA Civility Standards
CMAJ Group

Copyright 2023, CMA Impact Inc. or its licensors. All rights reserved. ISSN 1180-4882.

All editorial matter in JPN represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.
To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: [email protected].
View CMA's Accessibility policy.

Powered by HighWire