Advanced Machine Learning Algorithm Accurately Predicts Risk of COVID-19 Progressing to Severe Disease or Death

The new prognostic tool, known as the Severe COVID-19 Adaptive Risk Predictor (SCARP), can help define the one-day and seven-day risk of a patient hospitalized with COVID-19 developing a more severe form of the disease or dying from it.

Clinicians often learn how to recognize patterns in COVID-19 cases after they treat many patients with it. Machine-learning systems promise to enhance that ability, recognizing more complex patterns in large numbers of people with COVID-19 and using that insight to predict the course of an individual patient’s case. However, physicians sworn to “do no harm” may be reluctant to base treatment and care strategies for their most seriously ill patients on difficult-to-use or hard-to-interpret machine-learning algorithms. SCARP asks for a minimal amount of input to give an accurate prediction, making it fast, simple to use and reliable for basing treatment and care decisions.

The brain of SCARP is a predictive algorithm called Random Forests for Survival, Longitudinal and Multivariate Data (RF-SLAM). Unlike past clinical prediction methods that base a patient’s risk score on their condition at the time they enter the hospital, RF-SLAM adapts to the latest available patient information and considers the changes in those measurements over time. To make this dynamic analysis possible, RF-SLAM divides a patient’s hospital stay into six-hour windows. Data collected during those time spans are then evaluated by the algorithm’s “random forests” of approximately 1,000 “decision trees” that operate as an ensemble. This enables SCARP to give a more accurate prediction of an outcome than each individual decision tree could do on its own.

To demonstrate SCARP’s ability to predict severe COVID-19 cases or deaths from the disease, the researchers used a clinical registry with data about patients hospitalized with COVID-19. The patient information available included demographics, other medical conditions and behavioral risk factors, along more than 100 variables over time, such as vital signs, blood counts, metabolic profiles, respiratory rates and the amount of supplemental oxygen needed. Among 3,163 patients admitted with moderate COVID-19, 228 (7%) became severely ill or died within 24 hours; an additional 355 (11%) became severely ill or died within the first week. Data also were collected on the numbers who developed severe COVID-19 or died on any day within the 14 days following admission. Overall, SCARP’s one-day risk predictions for progression to severe COVID-19 or death were 89% accurate, while the seven-day risk predictions for both outcomes were 83% accurate. The team now plans further SCARP trials to validate its performance on a large scale using national patient databases.

“SCARP was designed to provide clinicians with a predictive tool that is interactive and adaptive, enabling real-time clinical variables to be entered at a patient’s bedside,” said Matthew Robinson, M.D., assistant professor of medicine at the Johns Hopkins University School of Medicine and senior author of the paper. “By yielding a personalized clinical prediction of developing severe disease or death in the next day and week, and at any point in the first two weeks of hospitalization, SCARP will enable a medical team to make more informed decisions about how best to treat each patient with COVID-19.”

“Our successful demonstration shows that SCARP has the potential to be an easy-to-use, highly accurate and clinically meaningful risk calculator for patients hospitalized with COVID-19,” added Robinson. “Having a solid grasp of a patient’s real-time risk of progressing to severe disease or death within the next 24 hours and next week could help health care providers make more informed choices and treatment decisions for their patients with COVID-19 as they get sicker.”

Related Links:
Johns Hopkins Medicine