Human vs. machine vs. core lab for the assessment of coronary atherosclerosis with lumen and vessel contour segmentation with intravascular ultrasound

Abstract

A machine learning (ML) algorithm for automatic segmentation of intravascular ultrasound was previously validated. It has the potential to improve efficiency, accuracy and precision of coronary vessel segmentation compared to manual segmentation by interventional cardiology experts. The aim of this study is to compare the performance of human readers to the machine and against the readings from a Core Laboratory. This is a post-hoc, cross-sectional analysis of the IBIS-4 study. Forty frames were randomly selected and analyzed by 10 readers of varying expertise two separate times, 1 week apart. Their measurements of lumen, vessel, plaque areas, and plaque burden were performed in an offline software. Among humans, the intra-observer variability was not statistically significant. For the total 80 frames, inter-observer variability between human readers, the ML algorithm and Core Laboratory for lumen area, vessel area, plaque area and plaque burden were not statistically different. For lumen area, however, relative differences between the human readers and the Core Lab ranged from 0.26 to 12.61%. For vessel area, they ranged from 1.25 to 9.54%. Efficiency between the ML algorithm and the readers differed notably. Humans spent 47 min on average to complete the analyses, while the ML algorithm took on average less than 1 min. The overall lumen, vessel and plaque means analyzed by humans and the proposed ML algorithm are similar to those of the Core Lab. Machines, however, are more time efficient. It is warranted to consider use of the ML algorithm in clinical practice.