Cross-Attention Transformer Networks with Optimized Feature Selection for Explainable Respiratory Disease Classification
Keywords:
Respiratory classification, transformer networks, cross-attention, explainable AI, feature optimization, clinical systems
Abstract
Respiratory diseases require accurate diagnosis for effective treatment, yet traditional methods rely on subjective assessments and expensive procedures. This paper presents a transformer-based cross-attention framework for acoustic respiratory disease classification with explainable AI integration. The CrossAttentionAcousticNetwork combines CNN spectral feature extraction with transformer temporal modeling, enhanced by cross-attention mechanisms for multi-modal feature fusion. Namib Beetle Optimization selects discriminative features from 100-dimensional handcrafted and deep spectral representations, while LIME provides clinical interpretability. Evaluation on ICBHI 2017 and KAU datasets achieves 99.0% and 95.0% accuracy respectively, representing 21.39% improvement over existing methods. The framework demonstrates superior performance across asthma, COPD, pneumonia, and heart failure classifications while maintaining computational efficiency for real-time deployment. Integrated explainable AI reveals clinically relevant acoustic patterns, with data augmentation improving minority class recognition by 19%. This approach bridges the gap between high-performance deep learning and clinical transparency requirements for automated respiratory disease screening.
Published
2025-12-01
How to Cite
Aljunaeidi, B. Z., Tawfik, M., Issa M. Alsmadi, & Al-Sharo, Y. M. (2025). Cross-Attention Transformer Networks with Optimized Feature Selection for Explainable Respiratory Disease Classification. Statistics, Optimization & Information Computing. https://doi.org/10.19139/soic-2310-5070-2912
Issue
Section
Research Articles
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).