-
A Robust Ensemble Algorithm for Ischemic Stroke Lesion Segmentation: Generalizability and Clinical Utility Beyond the ISLES Challenge
Authors:
Ezequiel de la Rosa,
Mauricio Reyes,
Sook-Lei Liew,
Alexandre Hutton,
Roland Wiest,
Johannes Kaesmacher,
Uta Hanning,
Arsany Hakim,
Richard Zubal,
Waldo Valenzuela,
David Robben,
Diana M. Sima,
Vincenzo Anania,
Arne Brys,
James A. Meakin,
Anne Mickan,
Gabriel Broocks,
Christian Heitkamp,
Shengbo Gao,
Kongming Liang,
Ziji Zhang,
Md Mahfuzur Rahman Siddiquee,
Andriy Myronenko,
Pooya Ashtari,
Sabine Van Huffel
, et al. (33 additional authors not shown)
Abstract:
Diffusion-weighted MRI (DWI) is essential for stroke diagnosis, treatment decisions, and prognosis. However, image and disease variability hinder the development of generalizable AI algorithms with clinical value. We address this gap by presenting a novel ensemble algorithm derived from the 2022 Ischemic Stroke Lesion Segmentation (ISLES) challenge. ISLES'22 provided 400 patient scans with ischemi…
▽ More
Diffusion-weighted MRI (DWI) is essential for stroke diagnosis, treatment decisions, and prognosis. However, image and disease variability hinder the development of generalizable AI algorithms with clinical value. We address this gap by presenting a novel ensemble algorithm derived from the 2022 Ischemic Stroke Lesion Segmentation (ISLES) challenge. ISLES'22 provided 400 patient scans with ischemic stroke from various medical centers, facilitating the development of a wide range of cutting-edge segmentation algorithms by the research community. Through collaboration with leading teams, we combined top-performing algorithms into an ensemble model that overcomes the limitations of individual solutions. Our ensemble model achieved superior ischemic lesion detection and segmentation accuracy on our internal test set compared to individual algorithms. This accuracy generalized well across diverse image and disease variables. Furthermore, the model excelled in extracting clinical biomarkers. Notably, in a Turing-like test, neuroradiologists consistently preferred the algorithm's segmentations over manual expert efforts, highlighting increased comprehensiveness and precision. Validation using a real-world external dataset (N=1686) confirmed the model's generalizability. The algorithm's outputs also demonstrated strong correlations with clinical scores (admission NIHSS and 90-day mRS) on par with or exceeding expert-derived results, underlining its clinical relevance. This study offers two key findings. First, we present an ensemble algorithm (https://github.com/Tabrisrei/ISLES22_Ensemble) that detects and segments ischemic stroke lesions on DWI across diverse scenarios on par with expert (neuro)radiologists. Second, we show the potential for biomedical challenge outputs to extend beyond the challenge's initial objectives, demonstrating their real-world clinical applicability.
△ Less
Submitted 3 April, 2024; v1 submitted 28 March, 2024;
originally announced March 2024.
-
Computationally Efficient Electromagnetic Transient Power System Studies using Bayesian Optimization
Authors:
Willem Leterme,
Evelyn Heylen
Abstract:
The power system of the future will be governed by complex interactions and non-linear phenomena, that should be studied more and more through computationally expensive software simulations. To solve the abovementioned problems, power system engineers face problems with following characteristics: (i) a computationally expensive simulator, (ii) non-linear functions to optimize and (iii) lack of abu…
▽ More
The power system of the future will be governed by complex interactions and non-linear phenomena, that should be studied more and more through computationally expensive software simulations. To solve the abovementioned problems, power system engineers face problems with following characteristics: (i) a computationally expensive simulator, (ii) non-linear functions to optimize and (iii) lack of abundance of data. Existing optimization settings involving EMT-type simulations have been developed, but mainly use a deterministic model and optimizer, which may be computationally inefficient and do not guarantee finding a global optimum. In this paper, an automation framework based on Bayesian Optimization is introduced, and applied to two case studies. It is found that the framework has the potential to reduce computational effort, outperform deterministic optimizers and is applicable to a multitude of problems. Nevertheless, it was found that the output of the Bayesian Optimization depends on the number of evaluations used for initialization, and in addition, careful selection of surrogate models, which should be subject to future investigation.
△ Less
Submitted 20 October, 2023;
originally announced October 2023.
-
Benchmarking Explanatory Models for Inertia Forecasting using Public Data of the Nordic Area
Authors:
Jemima Graham,
Evelyn Heylen,
Yuankai Bian,
Fei Teng
Abstract:
This paper investigates the performance of a day-ahead explanatory model for inertia forecasting based on field data in the Nordic system, which achieves a 43% reduction in mean absolute percentage error (MAPE) against a state-of-the-art time-series forecast model. The generalizability of the explanatory model is verified by its consistent performance on Nordic and Great Britain datasets. Also, it…
▽ More
This paper investigates the performance of a day-ahead explanatory model for inertia forecasting based on field data in the Nordic system, which achieves a 43% reduction in mean absolute percentage error (MAPE) against a state-of-the-art time-series forecast model. The generalizability of the explanatory model is verified by its consistent performance on Nordic and Great Britain datasets. Also, it appears that a long duration of training data is not required to obtain accurate results with this model, but taking a more spatially granular approach reduces the MAPE by 3.6%. Finally, two further model enhancements are studied considering the specific features in Nordic system: (i) a monthly interaction variable applied to the day-ahead national demand forecast feature, reducing the MAPE by up to 18%; and (ii) a feature based on the inertia from hydropower, although this has a negligible impact. The field dataset used for benchmarking is also made publicly available.
△ Less
Submitted 14 July, 2023;
originally announced July 2023.
-
Challenges and opportunities of inertia estimation and forecasting in low-inertia power systems
Authors:
Evelyn Heylen,
Goran Strbac,
Fei Teng
Abstract:
Accurate inertia estimates and forecasts are crucial to support the system operation in future low-inertia power systems. A large literature on inertia estimation methods is available. This paper aims to provide an overview and classification of inertia estimation methods. The classification considers the time horizon the methods are applicable to, i.e., offline post mortem, online real time and f…
▽ More
Accurate inertia estimates and forecasts are crucial to support the system operation in future low-inertia power systems. A large literature on inertia estimation methods is available. This paper aims to provide an overview and classification of inertia estimation methods. The classification considers the time horizon the methods are applicable to, i.e., offline post mortem, online real time and forecasting methods, and the scope of the inertia estimation, e.g., system-wide, regional, generation, demand, individual resource. Shortcomings of the existing inertia estimation methods have been identified and suggestions for future work have been made.
△ Less
Submitted 28 August, 2020;
originally announced August 2020.