08 / 09MG / ROIResearch model

bv-mammo-v1 · BlackVoxel

Mammography ROI characterization.

Benign or malignant classification on CBIS-DDSM finding crops.

Mammography crop from CBIS-DDSM
BV-MG-9004CCSuspicious lesion

What it does

The model classifies a region-of-interest crop as benign or malignant. The region is provided in advance.

Model
bv-mammo-v1
Ownership
BlackVoxel
Base
ResNet-18 / ImageNet transfer / ROI crop
Data
CBIS-DDSM / digitized film / CC BY 4.0

Demo

Image, attention map and draft report.

The screen uses previously processed results. Inference is not run on this page.

MG / ROI BV-MG-9004 bv-mammo-v1 BLACKVOXEL · R&D
Mammography crop from CBIS-DDSM
Suspicious lesion · 98.9%
CCW/L · AUTO
STORED MODEL OUTPUTGRAD-CAM

Training and evaluation

Data and setup.

01Dataset

CBIS-DDSM / digitized film / CC BY 4.0

02Architecture

ResNet-18 / ImageNet transfer / ROI crop

03Training

Task-specific labels

04Test

patient-grouped test

ResNet-18 fine-tuned on 2,437 finding crops. Patient-grouped splitting keeps cases from the same patient out of different partitions.

AUROC 0.748, AUPRC 0.701 and sensitivity 0.626 on the 627-crop test set.

Test results

Measured performance.

0.748

AUROC

patient-grouped test
0.701

AUPRC

malignant class
0.626

sensitivity

argmax threshold

The AUROC of 0.748 refers to characterization of the provided ROI. The evaluation does not include detection or screening.

Limitations

Scope of this result.

  1. 01

    Digitized film, not full-field digital mammography.

  2. 02

    The region is already provided; the model does not detect the lesion.

  3. 03

    Sensitivity 0.626 leaves a relevant share of positives unflagged.

Next model

MR / SPINE

Lumbar MRI findings

Contact

Talk to BlackVoxel.

Send a message. We will reply to the email provided.