Fully automated volumetric measurement of malignant pleural mesothelioma by deep learning AI: validation and comparison with modified RECIST response criteria

Kidd, A. C., Anderson, O., Cowell, G. W. , Weir, A. J., Voisey, J. P., Evison, M., Tsim, S., Goatman, K. A. and Blyth, K. G. (2022) Fully automated volumetric measurement of malignant pleural mesothelioma by deep learning AI: validation and comparison with modified RECIST response criteria. Thorax, 77(12), pp. 1251-1259. (doi: 10.1136/thoraxjnl-2021-217808) (PMID:35110367)

[img] Text
264927.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial.

1MB

Abstract

Background: In malignant pleural mesothelioma (MPM), complex tumour morphology results in inconsistent radiological response assessment. Promising volumetric methods require automation to be practical. We developed a fully automated Convolutional Neural Network (CNN) for this purpose, performed blinded validation and compared CNN and human response classification and survival prediction in patients treated with chemotherapy. Methods: In a multicentre retrospective cohort study; 183 CT datasets were split into training and internal validation (123 datasets (80 fully annotated); 108 patients; 1 centre) and external validation (60 datasets (all fully annotated); 30 patients; 3 centres). Detailed manual annotations were used to train the CNN, which used two-dimensional U-Net architecture. CNN performance was evaluated using correlation, Bland-Altman and Dice agreement. Volumetric response/progression were defined as ≤30%/≥20% change and compared with modified Response Evaluation Criteria In Solid Tumours (mRECIST) by Cohen’s kappa. Survival was assessed using Kaplan-Meier methodology. Results: Human and artificial intelligence (AI) volumes were strongly correlated (validation set r=0.851, p<0.0001). Agreement was strong (validation set mean bias +31 cm3 (p=0.182), 95% limits 345 to +407 cm3). Infrequent AI segmentation errors (4/60 validation cases) were associated with fissural tumour, contralateral pleural thickening and adjacent atelectasis. Human and AI volumetric responses agreed in 20/30 (67%) validation cases κ=0.439 (0.178 to 0.700). AI and mRECIST agreed in 16/30 (55%) validation cases κ=0.284 (0.026 to 0.543). Higher baseline tumour volume was associated with shorter survival. Conclusion: We have developed and validated the first fully automated CNN for volumetric MPM segmentation. CNN performance may be further improved by enriching future training sets with morphologically challenging features. Volumetric response thresholds require further calibration in future studies.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Weir, Mr Alexander and Cowell, Dr Gordon and Anderson, Owen and Blyth, Professor Kevin and Tsim, Dr Selina and Kidd, Mr Andrew
Authors: Kidd, A. C., Anderson, O., Cowell, G. W., Weir, A. J., Voisey, J. P., Evison, M., Tsim, S., Goatman, K. A., and Blyth, K. G.
College/School:College of Medical Veterinary and Life Sciences > School of Cancer Sciences
College of Medical Veterinary and Life Sciences > School of Medicine, Dentistry & Nursing
College of Science and Engineering > School of Computing Science
Journal Name:Thorax
Publisher:BMJ Publishing Group
ISSN:0040-6376
ISSN (Online):1468-3296
Published Online:02 February 2022
Copyright Holders:Copyright © 2022 The Authors
First Published:First published in Thorax 77(12): 1251-1259
Publisher Policy:Reproduced under a Creative Commons License

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
301032PRISM - Prediction of Resistance to chemotherapy using Somatic Copy Number Variation in MesotheliomaKevin BlythBritish Lung Foundation (BLF)MPG16-7Institute of Infection, Immunity & Inflammation
168769An examination of diagnostic and prognostic biomarkers in malignant pleural mesotheliomaKevin BlythOffice of the Chief Scientific Adviser (CSO)ETM/285CS - Clinical Research Garscube