Investigating the quality of machine learning research and reporting in hypertension

Du Toit, C. et al. (2022) Investigating the quality of machine learning research and reporting in hypertension. European Society of Hypertension 31st Annual Meeting, Athens, Greece, 17-21 Jul 2022. e78. (doi: 10.1097/01.hjh.0000835956.81410.5e)

Abstract

Objective: Artificial intelligence and machine learning (AI/ML) are increasingly being applied to big clinical data to tackle research questions that cannot be answered with traditional statistical methods. The field is still in its nascent stages and there is a paucity of guidelines for conducting and reporting AI/ML research in hypertension. The objective was to apply the HUMANE checklist to survey the present landscape of AI/ML in hypertension to inform the development of hypertension-specific guidelines and recommendations. Design and method: The HUMANE checklist was developed by global clinical and AI/ML experts through the Delphi method. It assesses the quality of medical AI/ML articles based on whether they cover subjects expected in any peer-reviewed, clinical or AI/ML research publication. A cooping review was carried out to identify articles presenting original research in AI/ML and hypertension published in 2019–2021. Two independent reviewers applied the checklist to each article and in the case of discordance, the response was adjudicated by an AI/ML expert. Results were analysed to assess compliance with the survey (% of papers satisfying checklist requirements). Results: A total of 63 manuscripts was reviewed. A summary of results is shown in Figure 1. Highest compliance was seen for items relating to general article presentation, with compliance ranging from 68% to 98% (description of statistical analysis methods and background context, respectively). Lowest compliance was seen with checklist items relating to clinical research and AI/ML methods. 44% of reviewed articles described the demographics of their dataset and 48% stated their inclusion/exclusion criteria. Nonetheless, datasets were deemed appropriate for investigative aims in 93% of articles. 30% of manuscripts reported their calibration measures, while 73% stated their performance metrics. Internal validation was carried out in 75% of studies, but external validity was assessed in only 14% of cases. Algorithmic bias was addressed in 11% of papers. Conclusions: Application of AI/ML methods in hypertension research is growing, but the majority of current work has major shortfalls in reporting quality, model validation and algorithmic bias. Our study identifies areas of improvement to enable the full realisation of the potential of AI/ML in hypertension.

• Item Type: Conference or Workshop Item
• Additional Information: Abstract published in Journal of Hypertension 40(Suppl1): e78.
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Lip, Dr Stefanie and Mccallum, Dr Linsay and Padmanabhan, Professor Sandosh and Alsanosi, Dr Safaa and Du Toit, Ms Clea and Rostron, Dr Maggie and Sykes, Dr Robert
• Authors: Du Toit, C., Tran, T., Aryal, S., Lip, S., Manandhar, I., Sykes, R., Pattnaik, H., Deo, N., Alsanosi, S., Sionakidis, A., Ngoc Le, N., McCallum, L., Mehta, D., Kassi, M., Rostron, M., Stevenson, L., Tummala, R., Kashyap, R., Joe, B., and Padmanabhan, S.
• College/School: College of Medical Veterinary and Life Sciences; College of Medical Veterinary and Life Sciences > School of Cardiovascular & Metabolic Health
• Journal Name: Journal of Hypertension
• ISSN: 0263-6352