Program Information

The VAMPIRE Challenge: Results of An International Multi-Institutional Validation Study to Evaluate CT Ventilation Imaging Algorithms

J Kipritidis

J Kipritidis^1,2*, G Cazoulat³ , B Tahir⁴, M Hofman⁵ , S Siva⁵ , J Callahan⁵ , T Yamamoto⁶ , G Christensen⁷ , J Reinhardt⁷ , N Kadoya⁸ , T Patton⁹ , S Gerard⁷ , I Duarte¹⁰ , B Archibald-Heeren¹¹ , M Byrne¹¹ , R Sims¹² , E Eslick^1,2 , F Hegi-Johnson^1,5 , H Woodruff¹ , R Ireland⁴ , J Wild⁴ ,J Cai¹⁰ , J Bayouth⁹ , K Brock¹³ , P Keall¹ , (1) University of Sydney, Sydney NSW, Australia, (2) Royal North Shore Hospital, Sydney NSW, Australia, (3) University of Michigan, Ann Arbor MI, USA, (4) University of Sheffield, Sheffield, United Kingdom, (5) Peter MacCallum Cancer Centre, Melbourne VIC, Australia, (6) UC Davis School of Medicine, Sacramento CA, USA, (7) University of Iowa, Iowa City IA, USA, (8) Tohoku University Graduate School of Medicine, Sendai, Japan, (9) University of Madison-Wisconsin, Madison WI, USA, (10) Duke University Medical Centre, Durham NC, USA, (11) Sydney Adventist Hospital, Sydney NSW, Australia, (12) Auckland Radiation Oncology, Auckland, New Zealand, (13) UT MD Anderson Cancer Center, Houston TX, USA

Presentations

TH-EF-605-4 (Thursday, August 3, 2017) 1:00 PM - 3:00 PM Room: 605

Purpose: CT ventilation imaging (CTVI) is being used to achieve functionally-adaptive lung cancer radiation therapy in three clinical trials (NCT02528942, NCT02308709, NCT02843568). We have built VAMPIRE (Ventilation Archive for Medical Pulmonary Image Registration) to address the need for a common validation dataset to evaluate the accuracy of different CTVI algorithms. Here we present the results of the first VAMPIRE Challenge, launched in 2016.

Methods: The VAMPIRE dataset includes 50 pairs of 4DCT and ground truth ventilation scans - 25 humans imaged with Galligas 4DPET/CT, 21 humans imaged with DTPA-SPECT and 4 sheep imaged with Xenon-CT. For the VAMPIRE Challenge, 16 subjects were set as the “training” data (with ground truth provided) and 34 subjects were set as the “test” data (with ground truth blinded). 7 groups downloaded the Challenge dataset and uploaded CTVIs based on deformable image registration (DIR) between the 4DCT inhale/exhale phases. Participants used at least one DIR method broadly classified into B-splines, Diffeomorphisms or Biomechanical modeling (BM), and at least one ventilation metric based on DIR evaluation of volume change (“DIR-ΔVol”), Hounsfield Unit change (“DIR-ΔHU”), or a “Hybrid” approach. All CTVIs were uploaded with minimal post-processing, and evaluated against the ground truth using the voxel-wise Spearman correlation coefficient rS.

Results: Participants submitted 23 unique combinations of DIR/metric. The overall best performing combination was BM-DIR/Hybrid, with rS values having a median (range) of 0.50 (0.24-0.73) across the 34 test subjects. By comparison the other DIR/metric combinations had median rS values between 0.04 (B-spline with DIR-ΔVol) and 0.38 (B-spline with DIR-ΔHU).

Conclusion: VAMPIRE is a resource for analyzing and comparing new CTVI algorithms. The VAMPIRE Challenge reveals varying levels of CTVI accuracy depending on the choice of DIR and ventilation metric, highlighting the importance of validation studies as this technology is translated from academic centers to the clinic.

Funding Support, Disclosures, and Conflict of Interest: Dr Kipritidis was supported by a Cancer Institute NSW Early Career Fellowship. This work was supported in part by Cancer Australia Priority-driven Collaborative Cancer Research Scheme Grant APP1060919, as well as National Institute of Health Grants R01HL079406, R01CA166703, R01CA093626, P01CA059827 and R21CA195317.


Contact Email: