| RSNA
RSNA Press Release

AI Model Predicts Breast Cancer Risk Without Racial Bias

Share: Share on Facebook PDF

Released: November 29, 2023

At A Glance

  • An image-based deep learning model accurately predicted a woman’s risk of developing ductal carcinoma in situ or invasive breast cancer and showed no bias across multiple races.
  • Traditional risk models have demonstrated poor performance across patient races, most likely due to the data used to develop the models.
  • The AI model showed no significant difference in predicting DCIS and invasive cancer among white, Black, Asian and other races.

CHICAGO — A deep learning artificial intelligence (AI) model that was developed using only mammogram image biomarkers accurately predicted both ductal carcinoma in situ (DCIS) and invasive carcinoma, according to research being presented today at the annual meeting of the Radiological Society of North America (RSNA). Additionally, the model showed no bias across multiple races.

Constance D. Lehman, M.D., Ph.D.

Constance D. Lehman, M.D., Ph.D.

Traditional breast cancer risk assessment models use information obtained from patient questionnaires, such as medical and reproductive history, to calculate a patient’s future risk of developing breast cancer.

“In the domain of precision medicine, risk-based screening has been elusive because we have not been able to accurately evaluate a woman’s risk of developing breast cancer,” said study lead author Leslie R. Lamb, M.D., M.Sc., a breast radiologist at Massachusetts General Hospital (MGH) in Boston. “Even the best existing traditional risk models do not perform well on the individual level.”

Traditional risk models have also demonstrated poor performance across different patient races, most likely due to the data used to develop the model.

“Traditional models likely have racial biases due to the populations on which they were developed,” Dr. Lamb said. “Several of the commonly used models were developed on predominantly European Caucasian populations.”

According to the American Cancer Society, Black women demonstrate the lowest 5-year relative survival rate for breast cancer among all racial and ethnic groups. This translates to a persistent 6% to 8% disparity in 5-year survival rates between Black and white women across all breast cancer types.

To accurately determine breast cancer risk, foster early detection and improve patient survival rates, it is important that risk models are developed that are applicable across different populations.

A deep learning AI risk assessment model developed using mammographic images alone can outperform traditional risk assessment models in future breast cancer development while also mitigating the racial biases seen in traditional models.

In the first study of its kind, Dr. Lamb and colleagues sought to assess the performance of an image-based deep learning risk assessment model in predicting both future invasive breast cancer and DCIS across multiple races.

The model’s performance was assessed by comparing areas under the receiver operating characteristic curve (AUC) with the DeLong test. The AUC score measures the predictive rate of the model on a scale of from 0 to 1. Multiple prior studies have estimated traditional risk model performance measured by AUC in the range of 0.59-0.62 for white women, with much lower performance in women of other races.

The multisite study included 129,340 routine bilateral screening mammograms performed in 71,479 women between 2009 to 2018 with five-year follow-up data. Patient demographics were obtained from electronic medical records, and instances of cancer were identified from the regional tumor registry.

The racial makeup of the study group included white (106,839 exams), Black (6,154 exams), Asian (6,435 exams), self-reported other races (6,257 exams) and unknown (3,655 exams). The mean age of the women was 59 years old. 

The deep learning model consistently outperformed traditional risk models in predicting a woman’s risk of developing DCIS, which is early-stage breast cancer, and invasive breast cancer, which is cancer that has potential to spread.

“The model is able to translate the full diversity of subtle imaging biomarkers in the mammogram, beyond what the naked eye can see, that can predict a woman’s future risk of both DCIS and invasive breast cancer,” Dr. Lamb said. “The deep learning image-only risk model can provide increased access to more accurate, equitable and less costly risk assessment.”

The predictive rate of both DCIS and invasive cancer was 0.71 across all races. The AUC in predicting DCIS was 0.77 in non-white patients and 0.71 in white patients. The AUC in predicting invasive cancer was 0.72 in non-white patients and 0.71 in white patients.

“This is a particularly exciting domain for AI, as it demonstrates the opportunity to apply ‘AI for good’—to reduce well-known racial disparities in risk assessment,” said senior author Constance D. Lehman, M.D., Ph.D., a breast radiologist at MGH. “We are now poised to translate these findings into improved clinical care for our patients.”

Additional co-authors are Sarah F. Mercaldo, Ph.D., and Andrew R. Carney, M.S.

Note: Copies of RSNA 2023 news releases and electronic images will be available online at RSNA.org/press23.

RSNA is an association of radiologists, radiation oncologists, medical physicists and related scientists promoting excellence in patient care and health care delivery through education, research and technologic innovation. The Society is based in Oak Brook, Illinois. (RSNA.org)

Editor’s note: The data in these releases may differ from those in the published abstract and those actually presented at the meeting, as researchers continue to update their data right up until the meeting. To ensure you are using the most up-to-date information, please call the RSNA Newsroom at 1-312-791-6610.

For patient-friendly information on breast imaging, visit RadiologyInfo.org.

Video (MP4):

Images (JPG, TIF):

Thumbnail
Infographic
High-res (TIF) version
(Right-click and Save As)
Thumbnail
Figure 1. Abnormal mammogram.
High-res (TIF) version
(Right-click and Save As)
Thumbnail
Figure 2. Normal mammogram.
High-res (TIF) version
(Right-click and Save As)
Thumbnail
Figure 3. Woman with radiologic technologist during screening mammography exam.
High-res (TIF) version
(Right-click and Save As)
Thumbnail
Figure 4. Woman with radiologic technologist during screening mammography exam.
High-res (TIF) version
(Right-click and Save As)
Thumbnail
Figure 5. Receiver operating characteristic curves for screening mammography-based DL model in predicting DCIS (A) and invasive malignancy (B), in White (blue), Black (purple) and Asian (green) patients.
High-res (TIF) version
(Right-click and Save As)

Additional Resources

Your Radiologist Explains Mammography
RadiologyInfo.org – Mammography
RadiologyInfo.org – Breast Cancer Screening
RadiologyInfo.org – Breast Cancer