Skip to content

Add report reconciliation: compare official radiologist report against image analysis #58

Description

@Liohtml

Part of #51. Builds on the cross-validation step (#52). This is the
market-differentiating feature
— no existing consumer product does it.

Summary

Let the user provide the official radiologist report (paste text, or ingest a
DICOM SR / PDF), and have MedCheck reconcile it against its own image-derived
findings and the ML signals: which official findings the model can localize, where
they are, and any regions the model flagged that the report did not mention — each
framed as "ask your doctor about this," never as a contradiction or a new
diagnosis.

Why (research-backed)

Market research found the landscape is siloed and nobody reconciles report vs.
image
for patients:

  • Text explainers (Scanslated, Read My MRI, ChatGPT) explain the words but
    never read the pixels → can't validate anything.
  • Viewers (Horos, Weasis, OHIF) show pixels but explain nothing.
  • Second-opinion services (DocPanel, Mediphany $95–300) do both but are paid,
    slow, closed, human.
  • The closest research prototype (ReXplain) only highlights image regions; it's
    unreleased.

Reconciliation also has clinical grounding: subspecialty second reads find
~20–25% clinically significant discrepancies, and everyday radiology
discrepancy is ~3–5% — so "here's what your report says, here's where it is, and
here's something to ask about" is genuinely useful, while staying on the safe side
of the regulatory line (it explains/locates an existing human report rather
than issuing findings).

⚠️ Positioning / safety (see epic #51)

  • Frame strictly as comprehension + question-preparation: "Your report
    mentions X — here is the region"
    and "the analysis also looked at Y; the report
    doesn't mention it — consider asking your doctor."
  • Never state the radiologist is wrong, never present a model finding as a
    diagnosis, never say a region is normal/abnormal definitively.
  • This keeps MedCheck in the educational track; presenting autonomous image
    findings to a patient as truth would make it a regulated device.

Proposed implementation

Acceptance criteria

  • Accepts an official report (text minimum; SR/PDF as follow-ons).
  • Produces corroborated / report-only / analysis-only buckets with locations
    where available.
  • All output uses question-preparation framing; no contradiction/diagnosis
    language (unit-tested phrasing guardrails).
  • Ingested report text is PHI-scrubbed (Add robust DICOM de-identification step (tag scrubbing + burned-in PHI + optional defacing) #57).
  • Tests: matching logic (synonyms via RadLex), three buckets, framing guard,
    empty-report no-op.

Dependencies

Strong synergy with #52 (validation), #53 (segmentation locations), #54 (DICOM SR
parsing), #57 (PHI scrubbing of ingested text).

Effort

~2–3 days. No heavy deps for the text path.

References (session research)

Consumer-tool market gap analysis; subspecialty second-read discrepancy ~20–25%;
everyday radiology discrepancy 3–5%; ReXplain (arXiv 2410.00441).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions