TY - JOUR A1 - Abdullah, T.A.A. A1 - Zahid, M.S.M. A1 - Ali, W. A1 - Hassan, S.U. N2 - Deep Learning (DL) has gained enormous popularity recently; however, it is an opaque technique that is regarded as a black box. To ensure the validity of the modelâ??s prediction, it is necessary to explain its authenticity. A well-known locally interpretable model-agnostic explanation method (LIME) uses surrogate techniques to simulate reasonable precision and provide explanations for a given ML model. However, LIME explanations are limited to tabular, textual, and image data. They cannot be provided for signal data features that are temporally interdependent. Moreover, LIME suffers from critical problems such as instability and local fidelity that prevent its implementation in real-world environments. In this work, we propose Bootstrap-LIME (B-LIME), an improvement of LIME, to generate meaningful explanations for ECG signal data. B-LIME implies a combination of heartbeat segmentation and bootstrapping techniques to improve the modelâ??s explainability considering the temporal dependencies between features. Furthermore, we investigate the main cause of instability and lack of local fidelity in LIME. We then propose modifications to the functionality of LIME, including the data generation technique, the explanation method, and the representation technique, to generate stable and locally faithful explanations. Finally, the performance of B-LIME in a hybrid deep-learning model for arrhythmia classification was investigated and validated in comparison with LIME. The results show that the proposed B-LIME provides more meaningful and credible explanations than LIME for cardiac arrhythmia signal data, considering the temporal dependencies between features. © 2023 by the authors. JF - Processes KW - Deep learning; Diseases; Heart; Lime; Statistical methods KW - Black boxes; Bootstrap-LIME; Cardiac arrhythmia; Deep learning; ECG signals; Explanation; Interpretation; Locally interpretable model-agnostic explanation method; Signal data; Surrogate techniques KW - Electrocardiograms UR - https://www.scopus.com/inward/record.uri?eid=2-s2.0-85149111083&doi=10.3390%2fpr11020595&partnerID=40&md5=a3fa125ae35e4a081f266b32b6f682a4 AV - none Y1 - 2023/// N1 - cited By 8 TI - B-LIME: An Improvement of LIME for Interpretable Deep Learning Classification of Cardiac Arrhythmia from ECG Signals IS - 2 ID - scholars18836 VL - 11 ER -