Research
Explainable AI, Bayesian Networks, Causality, Clinical decision support systems, Expert elicitation, Counterfactual reasoning
Interests
Dr Kyrimi's research interests lie in Bayesian modelling and decision support under uncertainty in healthcare. Her research focuses on (1) developing clinical decision support systems using a combination of knowledge and data and (2) translating causal models into explainable AI (XAI) systems that users can trust.
The latter is a part of a 5-year research fellowship funded by the Royal Academy of Engineering (RAEng). Technological breakthroughs have led to the development of sophisticated healthcare systems, but these will only become widely adopted if patients and healthcare professionals have confidence in their recommendations. Without a solution to the problem of user trust and user acceptance of healthcare technologies generally, the undeniable benefits of these systems will never be realised and efforts to develop accurate health-AI will be in vain. The ‘right to explanation’ and regulations on algorithmic decision-making already exist. Therefore, the ExAIDSS project focuses on translating causal AI models into explainable AI systems that users can trust and adopt in healthcare.
The objectives of this prestigious research fellowship are as follows:
Investigate the fundamentals of explanation: Explore fundamental questions that have been neglected, such as what makes an explanation of AI “good”.
Develop explanation algorithms that incorporate causality: Develop explanation algorithms that produces meaningful causal explanations for various types of reasoning.
Create user-specific explanation outputs: Design an explanation that recognises who is interacting with it and the dynamics of clinical decision making.
Create an evaluation protocol: Propose a protocol for evaluating different explanations purposes.
Integrate the explanation algorithm and representation into existing healthcare digital platforms.
(more details are available
exaidss.com/)
Dr Kyrimi is also interested in understanding and bridging the existing gap between developing accurate clinical decision support systems and implementing them into practice.
Publications

Publications of specific relevance to the Centre for Multimodal AI
2024
A scoping review, novel taxonomy and catalogue of implementation frameworks for clinical decision support systemsWohlgemut JM, Pisirir E, Stoner RS, Perkins ZB,
Marsh W, Tai NRM and
Kyrimi E Bmc Medical Informatics and Decision Making,
Springer Nature vol. 24 (1)
01-11-2024
Bayesian networks may allow better performance and usability than logistic regressionWohlgemut JM, Pisirir E, Stoner RS,
Kyrimi E, Yet B,
Marsh W, Perkins ZB and Tai NRM
Critical Care,
Springer Nature vol. 28 (1)
11-07-2024
Identification of major hemorrhage in trauma patients in the prehospital setting: diagnostic accuracy and impact on outcomeWohlgemut JM, Pisirir E, Stoner RS,
Kyrimi E, Christian M, Hurst T,
Marsh W, Perkins ZB and Tai NRM
Trauma Surgery & Acute Care Open,
Bmj vol. 9 (1)
01-01-2024
Approach and Method for Bayesian Network Modelling: The Case for Pregnancy Outcomes in England and WalesMcLachlan S, Daley B, Saidi S,
Kyrimi E, Dube K, Grossan C,
Neil M, Rose L and Fenton N
Proceedings of the 17th International Joint Conference on Biomedical Engineering Systems and Technologies., 604-612.
01-01-20242023
Updating and recalibrating causal probabilistic models on a new target populationKyrimi E, Stoner RS, Perkins ZB, Pisirir E, Wohlgemut JM,
Marsh W and Tai NRM
Journal of Biomedical Informatics,
Elsevier vol. 149
09-12-2023
Enhancing the clinical relevance of haemorrhage prediction models in traumaTandle S, Wohlgemut JM, Marsden MER, Pisirir E,
Kyrimi E, Stoner RS,
Marsh W, Perkins ZB and Tai NRM
Military Medical Research,
Springer Nature vol. 10 (1)
20-09-2023
Methods used to evaluate usability of mobile clinical decision support systems for healthcare emergencies: a systematic review and qualitative synthesisWohlgemut JM, Pisirir E,
Kyrimi E, Stoner RS,
Marsh W, Perkins ZB and Tai NRM
Jamia Open,
Oxford University Press (Oup) vol. 6 (3)
04-07-2023
A Process for Evaluating Explanations for Transparent and Trustworthy AI Prediction ModelsPisirir E, Wohlgemut JM,
Kyrimi E, Stoner RS, Perkins ZB, Tai NRM and
Marsh DWR 2023 IEEE 11th International Conference on Healthcare Informatics (ICHI). vol. 00, 388-397.
29-06-2023
Diagnostic accuracy of clinical examination to identify life- and limb-threatening injuries in trauma patientsWohlgemut JM, Marsden MER, Stoner RS, Pisirir E,
Kyrimi E, Grier G, Christian M, Hurst T,
Marsh W, Tai NRM and Perkins ZB
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine,
Springer Nature vol. 31 (1)
07-04-20232022
Publisher Correction: Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AIVasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, Denniston AK, Faes L, Geerts B, Ibrahim M, Liu X, Mateen BA, Mathur P, McCradden MD, Morgan L, Ordish J, Rogers C, Saria S, Ting DSW, Watkinson P,
et al. Nature Medicine,
Springer Nature vol. 28 (10), 2218-2218.
12-08-2022
Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AIVasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, Denniston AK, Faes L, Geerts B, Ibrahim M, Liu X, Mateen BA, Mathur P, McCradden MD, Morgan L, Ordish J, Rogers C, Saria S, Ting DSW, Watkinson P,
et al. The Bmj,
Bmj vol. 377
18-05-2022
Tempting the Fate of the furious: cyber security and autonomous carsMcLachlan S, Schafer B, Dube K,
Kyrimi E and Fenton N
International Review of Law Computers & Technology,
Taylor & Francis vol. 36 (2), 181-201.
04-05-2022
Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AIVasey B, Nagendran M, Campbell B, Clifton DA, Collins GS, Denaxas S, Denniston AK, Faes L, Geerts B, Ibrahim M, Liu X, Mateen BA, Mathur P, McCradden MD, Morgan L, Ordish J, Rogers C, Saria S, Ting DSW, Watkinson P,
et al. Nature Medicine,
Springer Nature vol. 28 (5), 924-933.
01-05-2022
The outcome of a prediction algorithm should be a true patient state rather than an available surrogateWohlgemut JM,
Kyrimi E, Stoner RS, Pisirir E,
Marsh W, Perkins ZB and Tai NRM
Journal of Vascular Surgery,
Elsevier vol. 75 (4), 1495-1496.
01-04-2022
Lawmaps: enabling legal AI development through visualisation of the implicit structure of legislation and lawyerly processMcLachlan S,
Kyrimi E, Dube K, Fenton N and Webley LC
Artificial Intelligence and Law,
Springer Nature vol. 31 (1), 169-194.
24-01-20222021
A comprehensive scoping review of Bayesian networks in healthcare: Past, present and futureKyrimi E, McLachlan S, Dube K, Neves MR, Fahmi A and Fenton N
Artificial Intelligence in Medicine,
Elsevier vol. 117
13-05-2021
Bayesian networks in healthcare: What is preventing their adoption?Kyrimi E, Dube K, Fenton N, Fahmi A, Neves MR,
Marsh W and McLachlan S
Artificial Intelligence in Medicine,
Elsevier vol. 116
22-04-20212020
Real-time Online Probabilistic Medical Computation using Bayesian NetworksMclachlan S, Paterson H, Dube K,
Kyrimi E, Dementiev E,
Neil M, Daley BJ, Hitman GA and Fenton NE
2020 IEEE International Conference on Healthcare Informatics (ICHI). vol. 00, 1-8.
03-12-2020
Incorporating Clinical Decisions into Standardised CaremapsMclachlan S,
Kyrimi E, Daley BJ, Dube K, Marsden M, Finer S, Hitman GA and Fenton NE
2020 IEEE International Conference on Healthcare Informatics (ICHI). vol. 00, 1-2.
03-12-2020
Causal Bayesian Networks for Medical Diagnosis: A Case Study in Rheumatoid ArthritisFahmi A, MacBrayne A,
Kyrimi E, McLachlan S, Humby F,
Marsh W and Pitzalis C
2020 IEEE International Conference on Healthcare Informatics (ICHI). vol. 00, 1-7.
03-12-2020
Managing Knowledge in Computational Models for Global Food, Nutrition and Health TechnologiesDube K, McLachlan S, Zanamwe N,
Kyrimi E, Thomson JS and Fenton N
2020 IEEE Global Humanitarian Technology Conference (GHTC). vol. 00, 1-8.
01-11-2020
Medical idioms for clinical Bayesian network developmentKyrimi E, Raniere Neves M, Mclachlan S,
Neil M,
Marsh W and Fenton N
Journal of Biomedical Informatics,
Elsevier 30-06-2020
Data Visualisation in Midwifery: The Challenge of Seeing what Datasets HideDaley BJ,
Kyrimi E, Dube K, Fenton NE, Hitman GA and McLachlan S
Studies in Health Technology and Informatics,
Ios Press vol. 270, 1239-1240.
16-06-2020
Bayesian networks in healthcare: Distribution by medical conditionMcLachlan S, Dube K, Hitman GA, Fenton NE and
Kyrimi E Artificial Intelligence in Medicine,
Elsevier Bv vol. 107, 101912-101912.
12-06-2020
Managing Knowledge in Computational Models for Global Food, Nutrition and Health TechnologiesDube K, McLachlan S, Zanamwe N,
Kyrimi E, Thomson JS and Fenton N
,
Cold Spring Harbor Laboratory 05-06-2020
Standardising Clinical Caremaps: Model, Method and Graphical Notation for Caremap SpecificationMcLachlan S,
Kyrimi E, Dube K and Fenton N
2th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2019) - Volume 5: HEALTHINF Prague 22 Feb 2019 - 24 Feb 2019. vol. 1211 CCIS, 429-452.
06-05-2020
Towards standardisation of evidence-based clinical care process specificationsMcLachlan S,
Kyrimi E, Dube K, Hitman G, Simmonds J and Fenton N
Health Informatics Journal 18-03-2020
An incremental explanation of inference in Bayesian networks for increasing model trustworthiness and supporting clinical decision makingKyrimi E, Mossadegh S, Tai N and
Marsh W Artificial Intelligence in Medicine,
Elsevier vol. 103
31-01-20202019
LAGOS: Learning Health Systems and how they can integrate with patient careMclachlan S, Dube K,
KYRIMI E and Fenton N
Bmj: Health & Care Informatics,
Bmj 15-10-2019
Clinical Caremap Development: How can caremaps standardise care when they are not standardised?MCLACHLAN S,
KYRIMI E, FENTON N and Dube K
HEALTHINF 2019 Prague, Czech 22 Feb 2019 - 24 Feb 2019.
22-02-20192018
Combined ultrasound and Sestamibi scintigraphy provides accurate preoperative localisation for patients with primary hyperparathyroidism.Scattergood S, Marsden M,
Kyrimi E, Ishii H, Doddi S and Sinha P
Annals of The Royal College of Surgeons of England,
Royal College of Surgeons of England vol. 101 (2), 97-102.
05-10-2018
Spatial and temporal variations of childhood cancers: Literature review and contribution of the French national registryGoujon S,
Kyrimi E, Faure L, Guissou S, Hémon D, Lacour B and Clavel J
Cancer Medicine,
Wiley vol. 7 (10), 5299-5314.
19-09-20182016
A Progressive Explanation of Inference in ‘Hybrid’ Bayesian Networks for Supporting Clinical Decision MakingMARSH DWR and Kyrimi E
Conference on Probabilistic Graphical Models Lugano, Switzerland 6 Sep 2016 - 9 Sep 2016. vol. 52, 275-286.
09-09-2016
Implementation science: a Bayesian prediction tool for acute traumatic coagulopathyMossadegh S,
Kyrimi E,
Marsh W and Tai N
Society of Academic and Research Surgery Annual Meeting. vol. 103, 39-39.
12-04-20162015
Méthodes de détection d’excès localisés d’incidence des leucémies de l’enfantKyrimi E Revue D'EpidéMiologie Et De Santé Publique,
Elsevier vol. 63 (2)
01-04-2015