Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
COVID-19 detection from thermal image and tabular medical data utilizing multi-modal machine learning
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.ORCID iD: 0000-0002-1101-3793
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.ORCID iD: 0000-0002-1912-712x
Stockholm University, Faculty of Social Sciences, Department of Computer and Systems Sciences.ORCID iD: 0000-0001-5924-5457
2023 (English)In: 2023 IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS): 22-24 June 2023 / [ed] João Rafael Almeida; Myra Spiliopoulou; Jose Alberto Benitez Andrades; Giuseppe Placidi; Alejandro Rodríguez González; Rosa Sicilia; Bridget Kane, 2023, p. 646-653Conference paper, Published paper (Refereed)
Abstract [en]

COVID-19 is a viral infectious disease that has created a global pandemic, resulting in millions of deaths and disrupting the world order. Different machine learning and deep learning approaches were considered to detect it utilizing different medical data. Thermal imaging is a promising option for detecting COVID-19 as it is low-cost, non-invasive, and can be maintained remotely. This work explores the COVID-19 detection issue using the thermal image and associated tabular medical data obtained from a publicly available dataset. We incorporate a multi-modal machine learning approach where we investigate the different combinations of medical and data type modalities to get an improved result. We use different machine learning and deep learning methods, namely random forests, Extreme Gradient Boosting (XGBoost), Multilayer Perceptron (MLP), and Convolutional Neural Network (CNN). Overall multi-modal results outperform any single modalities, and it is observed that the thermal image is a crucial factor in achieving it. XGBoost provided the best result with the area under the receiver operating characteristic curve (AUROC) score of 0.91 and the area under the precision-recall curve (AUPRC) score of 0.81. We also report the average of leave-one-positive-instance-out cross- validation evaluation scores. This average score is consistent with the test evaluation score for random forests and XGBoost methods. Our results suggest that utilizing thermal image with associated tabular medical data could be a viable option to detect COVID-19, and it should be explored further to create and test a real-time, secure, private, and remote COVID-19 detection application in the future.

Place, publisher, year, edition, pages
2023. p. 646-653
Series
IEEE International Symposium on Computer-Based Medical Systems, ISSN 2372-918X, E-ISSN 2372-9198 ; 36
Keywords [en]
COVID-19 Detection, Thermal Image, Tabular Medical Data, Multi-Modality, Machine Learning, Deep Learning, Internet of Medical Things
National Category
Computer Sciences
Research subject
Computer and Systems Sciences
Identifiers
URN: urn:nbn:se:su:diva-219237DOI: 10.1109/CBMS58004.2023.00294ISI: 001037777900113Scopus ID: 2-s2.0-85166473966OAI: oai:DiVA.org:su-219237DiVA, id: diva2:1783041
Conference
36th IEEE International Symposium on Computer-Based Medical Systems (CBMS 2023), L'Aquila, Italy, June 22-24, 2023
Available from: 2023-07-18 Created: 2023-07-18 Last updated: 2024-10-16Bibliographically approved
In thesis
1. Advancing Clinical Decision Support Using Machine Learning & the Internet of Medical Things: Enhancing COVID-19 & Early Sepsis Detection
Open this publication in new window or tab >>Advancing Clinical Decision Support Using Machine Learning & the Internet of Medical Things: Enhancing COVID-19 & Early Sepsis Detection
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis presents a critical examination of the positive impact of Machine Learning (ML) and the Internet of Medical Things (IoMT) for advancing the Clinical Decision Support System (CDSS) in the context of COVID-19 and early sepsis detection.

It emphasizes the transition towards patient-centric healthcare systems, which necessitate personalized and participatory care—a transition that could be facilitated by these emerging fields. The thesis accentuates how IoMT could serve as a robust platform for data aggregation, analysis, and transmission, which could empower healthcare providers to deliver more effective care. The COVID-19 pandemic has particularly stressed the importance of such patient-centric systems for remote patient monitoring and disease management.

The integration of ML-driven CDSSs with IoMT is viewed as an extremely important step in healthcare systems that could offer real-time decision-making support and enhance patient health outcomes. The thesis investigates ML's capability to analyze complex medical datasets, identify patterns and correlations, and adapt to changing conditions, thereby enhancing its predictive capabilities. It specifically focuses on the development of IoMT-based CDSSs for COVID-19 and early sepsis detection, using advanced ML methods and medical data.

Key issues addressed cover data annotation scarcity, data sparsity, and data heterogeneity, along with the aspects of security, privacy, and accessibility. The thesis also intends to enhance the interpretability of ML prediction model-based CDSSs. Ethical considerations are prioritized to ensure adherence to the highest standards.

The thesis demonstrates the potential and efficacy of combining ML with IoMT to enhance CDSSs by emphasizing the importance of model interpretability, system compatibility, and the integration of multimodal medical data for an effective CDSS.

Overall, this thesis makes a significant contribution to the fields of ML and IoMT in healthcare, featuring their combined potential to enhance CDSSs, particularly in the areas of COVID-19 and early sepsis detection.

The thesis hopes to enhance understanding among medical stakeholders and acknowledges the need for continuous development in this sector.

Abstract [sv]

Denna avhandling presenterar en kritisk granskning av den positiva effekten av maskininlärning (ML) och Internet of Medical Things (IoMT) för att främja det kliniska beslutsstödsystemet (CDSS) kopplat till covid-19 och tidig upptäckt av sepsis.

Avhandlingen betonar övergången mot patientcentrerade vårdsystem som kräver personlig och deltagande vård – en övergång som skulle kunna underlättas av dessa framväxande områden. Studien visar hur IoMT kan fungera som en robust plattform för dataaggregering, analys och överföring, vilket kan ge vårdgivare möjlighet att erbjuda mer effektiv vård. Covid-19-pandemin har särskilt betonat vikten av sådana patientcentrerade system för fjärrövervakning av patienter och sjukdomshantering.

Integreringen av ML-drivna CDSS med IoMT ses som ett extremt viktigt steg i vårdsystemen som kan erbjuda stöd för beslutsfattande i realtid och förbättra patienternas hälsoutfall. Avhandlingen undersöker maskininlärningens förmåga att analysera komplexa medicinska dataset, identifiera mönster och korrelationer, samt göra anpassningar till föränderliga förhållanden, vilket därmed förbättrar dess prediktiva förmågor. Den fokuserar specifikt på utvecklingen av IoMT-baserade CDSS för covid-19 och tidig upptäckt av sepsis, med användning av avancerade ML-metoder och medicinska data.

Nyckelfrågor som adresseras täcker bristen på dataannotering, dataspridning och dataheterogenitet, tillsammans med aspekter av säkerhet, integritet och tillgänglighet. Avhandlingen avser också att förbättra tolkbarheten av ML-prediktionsmodellbaserade CDSS. Etiska överväganden prioriteras för att säkerställa efterlevnad av de högsta standarderna.

Avhandlingen demonstrerar potentialen och effektiviteten i att kombinera ML med IoMT för att förbättra CDSS genom att betona vikten av modelltolkbarhet, systemkompatibilitet och integrering av multimodala medicinska data för ett effektivt CDSS.

Sammantaget bidrar denna avhandling till områdena ML och IoMT inom hälsovården, med deras kombinerade potential att förbättra CDSS, särskilt inom områdena covid-19 och tidig upptäckt av sepsis.

Förhoppningen är att avhandlingen ska förbättra förståelsen bland medicinska intressenter och understryka behovet av kontinuerlig utveckling inom denna sektor.

Place, publisher, year, edition, pages
Stockholm: Department of Computer and Systems Sciences, Stockholm University, 2024. p. 85
Series
Report Series / Department of Computer & Systems Sciences, ISSN 1101-8526 ; 24-004
Keywords
Internet of Medical Things, Patient-Centric Healthcare, Clinical Decision Support System, Predictive Modeling in Healthcare, Health Informatics, Healthcare analytics, COVID-19, Sepsis, COVID-19 Detection, Early Sepsis Detection, Lung Segmentation Detection, Medical Data Annotation Scarcity, Medical Data Sparsity, Medical Data Heterogeneity, Medical Data Security & Privacy, Practical Usability Enhancement, Low-End Device Adaptability, Medical Significance, Interpretability, Visualization, LIME, SHAP, Grad-CAM, LRP, Electronic Health Records, Thermal Image, Tabular Medical Data, Chest X-ray, Machine Learning, Deep Learning, Federated Learning, Semi-Supervised Machine Learning, Multi-Task Learning, Transfer Learning, Multi-Modality, Natural Language Processing, ClinicalBERT, GAN
National Category
Computer Sciences
Research subject
Computer and Systems Sciences
Identifiers
urn:nbn:se:su:diva-226027 (URN)978-91-8014-655-5 (ISBN)978-91-8014-656-2 (ISBN)
Public defence
2024-03-28, Lilla Hörsalen, NOD-huset, Borgarfjordsgatan 12, Kista, 13:00 (English)
Opponent
Supervisors
Available from: 2024-03-05 Created: 2024-01-31 Last updated: 2024-02-26Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Alam, Mahbub UlHollmén, JaakkoRahmani Chianeh, Rahim

Search in DiVA

By author/editor
Alam, Mahbub UlHollmén, JaakkoRahmani Chianeh, Rahim
By organisation
Department of Computer and Systems Sciences
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 463 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf