Overview

AI in medicine is advancing faster than our ability to decipher its trustworthiness and reliability. A model that performs well in a paper can still fail in real world clinical settings, and there is not a consensus in how to navigate this issue. The Yi lab works on both sides of that problem. First, we build methods that test medical AI’s trustworthiness, followed by building methods that make AI better: stress-testing AI robustness, measuring algorithmic fairness and studying clinician behavior amidst algorithmic advice. Second, we collaborate with scientists and clinicians to turn vetted AI tools into discoveries in pediatric cancers, sickle cell disease and other catastrophic diseases.

The team

The Yi lab is an interdisciplinary team of engineers, physician-scientists and trainees working at the intersection of computer science and medicine.

Yi research summary

The Yi lab works in biomedical informatics. Our program spans two areas: 1) developing methods for safe and trustworthy AI for medical imaging and multimodal data and 2) applying AI tools to advance discovery and care in pediatric cancer and other catastrophic diseases, in collaboration with clinicians and scientists across the institution.

Paul Yi

A matter of trust: Methods for safe, trustworthy medical AI

Benchmark accuracy is not evidence that an AI model is appropriate to use on patients. When a model provides inaccurate information pertaining to imaging, the consequence is not a lower score; it is a treatment decision made on bad information. We build methods that determine whether medical AI can be trusted and identify ways to make AI more accurate and efficient. The technologies may change, but the core questions remain the same. Our current work spans into the following areas:

  • Robustness and generalizability. Identifying when and how AI models break in real world clinical settings, e.g., different scanners, different protocols, and patients who do not resemble the training data.

  • Trust in generative AI. Whether generative models can be trusted to counsel patients and support doctors and researchers and if a deepfake medical image can be differentiated from a real one.

Applying AI to advance discovery and care

Children treated at St. Jude are imaged repeatedly over years, and these images are augmented by a rich record of labs, genomics and clinical notes. We collaborate with scientists and clinicians across the hospital to transform this information into research-ready data: quantitative phenotypes from imaging, structured variables pulled from clinical text and the endpoints and biomarkers that drive discovery research. 

Pediatric cancer
Imaging biomarkers of treatment response and disease burden.

Survivorship
Quantitative markers of frailty and chronic disease in long-term childhood cancer survivor cohorts.

Sickle cell disease
Quantitative imaging of organ involvement and disease progression.

A discovery is only as good as the measurement behind it. Therefore, we make medical AI trustworthy first and then use it to answer questions we could not answer before.

The importance of interdisciplinary work

Our research spans medicine and computer science, and both audiences need to see it to bridge the gap between code and clinic. Our work has been published in Radiology and Radiology: Artificial Intelligence (the flagship journals of the Radiological Society of North America), Nature Medicine and JAMA, as well as top computer science venues including NeurIPS and ICML.

Our lab is built from three kinds of people: clinical, technical and the ones who are becoming both. Medical students, residents and fellows work alongside research engineers and computer science trainees, and we collaborate with clinicians and scientists across medicine, basic sciences and computer sciences. Some members arrive knowing how to train an AI model and learn what a scan means; others arrive the other way around. The best work happens where those two paths meet.

Rachel Ivy and Paul Yi

Join us

Projects often pair a clinical trainee with a technical one: clinical context on one side and implementation on the other. New trainees usually start by contributing to an existing project alongside one of our engineers or postdocs, taking on more independence as they progress. 

Technical work includes comfortability with Python, a deep learning framework, Git and the patience for complicated real-world data. Clinical work must include familiarity with clinical data, expertise in conceptualizing relevant biological or medical questions, literature searches and manuscript writing. 

Ways to join

  • Staff positions. Full-time Staff roles are posted on the St. Jude job board  when open. Postdoctoral fellowships and shorter-term paid positions open periodically as grant funding allows — see below to get in touch.  
  • Graduate programs. St. Jude offers a Master's in Applied Biomedical Data Sciences (ABDS) and a PhD in Biomedical Sciences. Prospective students apply to the graduate school program rather than to the lab. We also sponsor thesis work for students in external programs, including at Johns Hopkins and UTHSC. 
  • Medical students. We work with medical students in a few ways: a dedicated research year, full-time electives or part-time work in later years for students who have previously worked with us. 
  • Visiting PhD students. We host doctoral students from other institutions, in the US and abroad, for extended research visits.  
  • Other trainees. We host trainees at every level, from undergraduates to fellows. Some come for a summer; others stay involved across several years of their training.

Getting in touch

Email Dr. Yi at Paul.Yi@stjude.org with:

  • Your CV
  • A link to something you have built or written (a repo, a paper, a project writeup)
  • One sentence on what you would like to work on here 
  • Your availability: hours per week, and start and end dates

Contact us

Paul Yi, MD
Associate Member
Department of Radiology
MS 220

St. Jude Children's Research Hospital

262 Danny Thomas Place
Memphis, TN, 38105-3678 USA
paul.yi@stjude.org

Follow Us

262 Danny Thomas Place
Memphis, TN, 38105-3678 USA
GET DIRECTIONS