-
Multiomics-based Outcome Prediction for the Treatment of Brain Metastases with Personalized Ultra-fractionated Stereotactic Adaptive Radiotherapy (PULSAR)
Authors:
Haozhao Zhang,
Michael Dohopolski,
Strahinja Stojadinovic,
Luiza Giuliani,
Soummitra Anand,
Heejung Kim,
Arnold Pompos,
Andrew Godley,
Steve Jiang,
Tu Dan,
Zabi Wardak,
Robert Timmerman,
Hao Peng
Abstract:
Purpose: We aimed to develop a data-driven multiomics approach integrating radiomics, dosiomics, and delta features to predict treatment response at an earlier stage (intra-treatment) for brain metastases (BMs) patients treated with PULSAR. Methods: We conducted a retrospective study of 39 patients with 69 BMs treated with PULSAR. Radiomics, dosiomics, and delta features were extracted from pretre…
▽ More
Purpose: We aimed to develop a data-driven multiomics approach integrating radiomics, dosiomics, and delta features to predict treatment response at an earlier stage (intra-treatment) for brain metastases (BMs) patients treated with PULSAR. Methods: We conducted a retrospective study of 39 patients with 69 BMs treated with PULSAR. Radiomics, dosiomics, and delta features were extracted from pretreatment and intra-treatment MRI scans and dose distributions. Six individual models and an ensemble feature selection (EFS) model were constructed using SVM and evaluated via stratified 5-fold cross-validation. The classification task distinguished lesions with >20% volume reduction at follow-up. We assessed performance metrics including sensitivity, specificity, accuracy, precision, F1 score, and AUC. Various feature extraction and ensemble selection scenarios were explored to enhance model robustness and reduce overfitting. Results: The EFS model, integrating features from pre-treatment radiomics and dosiomics, intra-treatment radiomics, and delta-radiomics, outperformed six individual models. It achieved an AUC of 0.979, accuracy of 0.917, and F1 score of 0.821. Among the top 9 features, six were derived from post-wavelet transformation, and three from original images. The discrete wavelet transform decomposes volumetric images into multi-resolution components, offering a more comprehensive characterization of underlying structures. Conclusion: Our study demonstrated the feasibility of employing a data-driven multiomics approach to predict tumor volume changes in BMs patients with PULSAR. The EFS model demonstrates enhanced performance compared with six individual models, emphasizing the importance of integrating both pretreatment and intra-treatment data. This application holds promise for optimizing BMs management, potentially mitigating risks associated with under- or over-treatment.
△ Less
Submitted 4 July, 2024;
originally announced July 2024.
-
Overcoming the chemical complexity bottleneck in on-the-fly machine learned molecular dynamics simulations
Authors:
Lucas R. Timmerman,
Shashikant Kumar,
Phanish Suryanarayana,
Andrew J. Medford
Abstract:
We develop a framework for on-the-fly machine learned force field molecular dynamics simulations based on the multipole featurization scheme that overcomes the bottleneck with the number of chemical elements. Considering bulk systems with up to 6 elements, we demonstrate that the number of density functional theory calls remains approximately independent of the number of chemical elements, in cont…
▽ More
We develop a framework for on-the-fly machine learned force field molecular dynamics simulations based on the multipole featurization scheme that overcomes the bottleneck with the number of chemical elements. Considering bulk systems with up to 6 elements, we demonstrate that the number of density functional theory calls remains approximately independent of the number of chemical elements, in contrast to the increase in the smooth overlap of atomic positions scheme.
△ Less
Submitted 12 June, 2024; v1 submitted 11 April, 2024;
originally announced April 2024.
-
Understanding the PULSAR Effect in Combined Radiotherapy and Immunotherapy through Attention Mechanisms with a Transformer Model
Authors:
Hao Peng,
Casey Moore,
Debabrata Saha,
Steve Jiang,
Robert Timmerman
Abstract:
PULSAR (personalized, ultra-fractionated stereotactic adaptive radiotherapy) is the adaptation of stereotactic ablative radiotherapy towards personalized cancer management. For the first time, we applied a transformer-based attention mechanism to investigate the underlying interactions between combined PULSAR and PD-L1 blockade immunotherapy based on a murine cancer model (Lewis Lung Carcinoma, LL…
▽ More
PULSAR (personalized, ultra-fractionated stereotactic adaptive radiotherapy) is the adaptation of stereotactic ablative radiotherapy towards personalized cancer management. For the first time, we applied a transformer-based attention mechanism to investigate the underlying interactions between combined PULSAR and PD-L1 blockade immunotherapy based on a murine cancer model (Lewis Lung Carcinoma, LLC). The proposed approach is able to predict the trend of tumor volume change semi-quantitatively, and excels in identifying the potential causal relationships through both self-attention and cross-attention scores.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
PSA-Net: Deep Learning based Physician Style-Aware Segmentation Network for Post-Operative Prostate Cancer Clinical Target Volume
Authors:
Anjali Balagopal,
Howard Morgan,
Michael Dohopoloski,
Ramsey Timmerman,
Jie Shan,
Daniel F. Heitjan,
Wei Liu,
Dan Nguyen,
Raquibul Hannan,
Aurelie Garant,
Neil Desai,
Steve Jiang
Abstract:
Automatic segmentation of medical images with DL algorithms has proven to be highly successful. With most of these algorithms, inter-observer variation is an acknowledged problem, leading to sub-optimal results. This problem is even more significant in post-operative clinical target volume (post-op CTV) segmentation due to the absence of macroscopic visual tumor in the image. This study, using pos…
▽ More
Automatic segmentation of medical images with DL algorithms has proven to be highly successful. With most of these algorithms, inter-observer variation is an acknowledged problem, leading to sub-optimal results. This problem is even more significant in post-operative clinical target volume (post-op CTV) segmentation due to the absence of macroscopic visual tumor in the image. This study, using post-op CTV segmentation as the test bed, tries to determine if physician styles are consistent and learnable, if there is an impact of physician styles on treatment outcome and toxicity; and how to explicitly deal with physician styles in DL algorithms to facilitate its clinical acceptance. A classifier is trained to identify which physician has contoured the CTV from just the contour and corresponding CT scan, to determine if physician styles are consistent and learnable. Next, we evaluate if adapting automatic segmentation to physician styles would be clinically feasible based on a lack of difference between outcomes. For modeling different physician styles of CTV segmentation, a concept called physician style-aware (PSA) segmentation is proposed which is an encoder-multidecoder network trained with perceptual loss. With the proposed physician style-aware network (PSA-Net), Dice similarity coefficient (DSC) accuracy increases on an average of 3.4% for all physicians from a general model that is not style adapted. We show that stylistic contouring variations also exist between institutions that follow the same segmentation guidelines and show the effectiveness of the proposed method in adapting to new institutional styles. We observed an accuracy improvement of 5% in terms of DSC when adapting to the style of a separate institution.
△ Less
Submitted 15 February, 2021;
originally announced February 2021.
-
A Novel Data-driven Algorithm for the Automated Detection of Unexpectedly High Traffic Flow in Uncongested Traffic States
Authors:
Bo Klaasse,
Rik Timmerman,
Tessel van Ballegooijen,
Marko Boon,
Gerard Eijkelenboom
Abstract:
We present an algorithm to identify days that exhibit the seemingly paradoxical behaviour of high traffic flow and, simultaneously, a striking absence of traffic jams. We introduce the notion of high-performance days to refer to these days. The developed algorithm consists of three steps: step 1, based on the fundamental diagram (i.e. an empirical relation between the traffic flow and traffic dens…
▽ More
We present an algorithm to identify days that exhibit the seemingly paradoxical behaviour of high traffic flow and, simultaneously, a striking absence of traffic jams. We introduce the notion of high-performance days to refer to these days. The developed algorithm consists of three steps: step 1, based on the fundamental diagram (i.e. an empirical relation between the traffic flow and traffic density), we estimate the critical speed by using robust regression as a tool for labelling congested and uncongested data points; step 2, based on this labelling of the data, the breakdown probability can be estimated (i.e. the probability that the average speed drops below the critical speed); step 3, we identify unperturbed moments (i.e. moments when a breakdown is expected, but does not occur) and subsequently identify the high-performance days based on the number of unperturbed moments.
Identifying high-performance days could be a building block in the quest for traffic jam reduction; using more detailed data one might be able to identify specific characteristics of high-performance days. The algorithm is applied to a case study featuring the highly congested A15 motorway in the Netherlands.
△ Less
Submitted 6 March, 2020; v1 submitted 26 September, 2019;
originally announced September 2019.
-
MRI-only brain radiotherapy: assessing the dosimetric accuracy of synthetic CT images generated using a deep learning approach
Authors:
Samaneh Kazemifar,
Sarah McGuire,
Robert Timmerman,
Zabi Wardak,
Dan Nguyen,
Yang Park,
Steve Jiang,
Amir Owrangi
Abstract:
Purpose: This study assessed the dosimetric accuracy of synthetic CT images generated from magnetic resonance imaging (MRI) data for focal brain radiation therapy, using a deep learning approach. Material and Methods: We conducted a study in 77 patients with brain tumors who had undergone both MRI and computed tomography (CT) imaging as part of their simulation for external beam treatment planning…
▽ More
Purpose: This study assessed the dosimetric accuracy of synthetic CT images generated from magnetic resonance imaging (MRI) data for focal brain radiation therapy, using a deep learning approach. Material and Methods: We conducted a study in 77 patients with brain tumors who had undergone both MRI and computed tomography (CT) imaging as part of their simulation for external beam treatment planning. We designed a generative adversarial network (GAN) to generate synthetic CT images from MRI images. We used Mutual Information (MI) as the loss function in the generator to overcome the misalignment between MRI and CT images (unregistered data). The model was trained using all MRI slices with corresponding CT slices from each training subject s MRI/CT pair. Results: The proposed GAN method produced an average mean absolute error (MAE) of 47.2 +- 11.0 HU over 5-fold cross validation. The overall mean Dice similarity coefficient between CT and synthetic CT images was 80% +- 6% in bone for all test data. Though training a GAN model may take several hours, the model only needs to be trained once. Generating a complete synthetic CT volume for each new patient MRI volume using a trained GAN model took only one second. Conclusions: The GAN model we developed produced highly accurate synthetic CT images from conventional, single-sequence MRI images in seconds. Our proposed method has strong potential to perform well in a clinical workflow for MRI-only brain treatment planning.
△ Less
Submitted 11 April, 2019;
originally announced April 2019.
-
Shell feature: a new radiomics descriptor for predicting distant failure after radiotherapy in non-small cell lung cancer and cervix cancer
Authors:
Hongxia Hao,
Zhiguo Zhou,
Shulong Li,
Genevieve Maquilan,
Michael R. Folkert,
Puneeth Iyengar,
Kenneth D. Westover,
Kevin Albuquerque,
Fang Liu,
Hak Choy,
Robert Timmerman,
Lin Yang,
Jing Wang
Abstract:
Purpose To develop and demonstrate a novel tumor shell feature for predicting distant failure in non-small cell lung cancer (NSCLC) and cervical cancer (CC) patients. Patients and Methods The shell predictive model was constructed using pretreatment positron emission tomography (PET) images from 48 NSCLC patients received stereotactic body radiation therapy (SBRT) and 52 CC patients underwent exte…
▽ More
Purpose To develop and demonstrate a novel tumor shell feature for predicting distant failure in non-small cell lung cancer (NSCLC) and cervical cancer (CC) patients. Patients and Methods The shell predictive model was constructed using pretreatment positron emission tomography (PET) images from 48 NSCLC patients received stereotactic body radiation therapy (SBRT) and 52 CC patients underwent external beam radiation therapy and concurrent chemotherapy followed with high-dose-rate intracavitary brachytherapy. A shell feature, consisting of outer voxels around the tumor boundary, was extracted from a series of axial PET slices. The hypothesis behind this feature is that non-invasive and invasive tumors may have different morphologic patterns in the tumor periphery, in turn reflecting the differences in radiological presentations in the PET images. The utility of the shell was evaluated by the support vector machine (SVM) classifier in comparison with intensity, geometry, gray level co-occurrence matrix (GLCM) based texture, neighborhood gray tone difference matrix (NGTDM) based texture, and a combination of these four features. The results were assessed in terms of accuracy, sensitivity, specificity, and the area under the receiver operating curve (AUC). Results For NSCLC, the AUC achieved by the shell feature was 0.82 while the highest AUC achieved by the other features was 0.76. Similarly, for CC, the AUC achieved by the shell feature was 0.83 while the highest AUC achieved by the other features was 0.76. Also, the difference in performance between shell and the other features was significant (P < 0.005) in all cases. Conclusions We propose a boundary-based shell feature that correlates with tumor metastasis. The shell feature showed better predictive performance than all the other features for distant failure prediction in both NSCLC and CC.
△ Less
Submitted 27 September, 2017;
originally announced September 2017.
-
Dosimetric and Deformation Effects of Image-Guided Interventions during Stereotactic Body Radiation Therapy of the Prostate using an Endorectal Balloon
Authors:
Bernard L. Jones,
Gregory Gan,
Quentin Diot,
Brian Kavanagh,
Robert D. Timmerman,
Moyed Miften
Abstract:
During Stereotactic Body Radiotherapy (SBRT) for the treatment of prostate cancer, an inflatable endorectal balloon (ERB) may be used to reduce motion of the target and reduce the dose to the posterior rectal wall. This work assessed the dosimetric impact of manual interventions on ERB position in patients receiving prostate SBRT and investigated the impact of ERB interventions on prostate shape.…
▽ More
During Stereotactic Body Radiotherapy (SBRT) for the treatment of prostate cancer, an inflatable endorectal balloon (ERB) may be used to reduce motion of the target and reduce the dose to the posterior rectal wall. This work assessed the dosimetric impact of manual interventions on ERB position in patients receiving prostate SBRT and investigated the impact of ERB interventions on prostate shape. Daily kilovoltage (kV) cone-beam computed tomography (CBCT) imaging was performed to localize the PTV, and an automated fusion with the planning images yielded displacements required for PTV re-localization. When the ERB volume and/or position were judged to yield inaccurate repositioning, manual adjustment (ERB re-inflation and/or repositioning) was performed. Based on all 59 CBCT image sets acquired, a deformable registration algorithm was used to determine the dose received by, displacement of, and deformation of the prostate, bladder, and anterior rectal wall. This dose tracking methodology was applied to images taken before and after manual adjustment of the ERB (intervention), and the delivered dose was compared to that which would have been delivered in the absence of intervention. Interventions occurred in 24 out of 35 (69%) of the treated fractions. The direct effect of these interventions was an increase in the prostate radiation dose that included 95% of the PTV (D95) and an increase in prostate coverage. Additionally, ERB interventions reduced prostate deformation in the anterior-posterior (AP) direction, reduced errors in the sagittal rotation of the prostate, and increased the similarity in shape of the prostate to the radiotherapy plan. Image-guided interventions in ERB volume and/or position during prostate SBRT were necessary to ensure the delivery of the dose distribution as planned.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.