"From Black Box to Glass Box"
— Making AI diagnostic rationale verifiable.
"The AI said 'cancer.' Why?
Make that rationale cryptographically verifiable."
AI image diagnostics can now detect lesions with accuracy equal to or greater than radiologists. However, the rationale behind an AI's "positive" determination often remains a black box.
When a patient files a lawsuit, "because the AI said so" won't hold up. When regulators request an audit, "we have no logs" is unacceptable.
MAP is designed to cryptographically record every AI decision, making "when, what data was reviewed, which model, and why that diagnosis was reached" verifiable in a tamper-evident format.
Current state and challenges of healthcare AI
"The AI decided" is not a defense in medical malpractice lawsuits. Recording the decision rationale is essential.
Performance changes with retraining. Unable to track which model version made the diagnosis.
The MDR requires post-market surveillance (Arts. 83–86) and the EU AI Act provides for post-market monitoring of high-risk AI systems (Art. 72; the high-risk rules apply to Annex I systems from 2 Aug 2028); an FDA Predetermined Change Control Plan (PCCP) is optional and pre-specifies planned model changes and how they are validated. MAP (v0.1.2 Working Draft) sets out, provisionally, how records of clinical AI decisions can be made tamper-evident and how a third party can check, for each anchored batch, that no record within the batch's declared scope was omitted after anchoring.
Questions Raised:
Result: Insufficient evidence, settled out of court
Issues Identified:
Target systems and recording events (concept overview — the v0.1.2 Working Draft covers decision support, imaging, triage, ambient documentation and coverage decisions, and defers surgical-robot control loops)
Image diagnostic AI, ECG analysis AI
RequiredDigital pathology, cytology AI
RequiredDrug interaction check, dosage optimization
RequiredEmergency priority determination, ICU alerts
RequiredDecision support components
RecommendedPatient screening, endpoint evaluation
RecommendedPatient Data Input
Image/Test values
Patient history
Consent info
AI Analysis
Feature extraction
Model inference
Explainability factors
Diagnosis Generated
Classification result
Confidence score
Differential diagnosis
Treatment Plan
Recommended treatment
Risk assessment
Alternative options
Patient Outcome
Actual result
Follow-up
Prognosis data
Data flow and event structure
Patient Data
AI Model (SaMD)
Clinical Decision
MAP Recorder (sidecar)
← Records all decision events
Hash Chain
Cryptographically linked
Digital Signature
Ed25519 signed
Model Hash
Version identification
Audit Storage
Encrypted storage (designed for HIPAA/GDPR requirements)
{
"event_id": "019234ab-7c8d-7def-8123-456789abcdef",
"timestamp_ns": 1734567890123456789,
"event_type": "DIAGNOSIS_GENERATED",
"facility_id": "HOSPITAL_XXXXX",
"provenance": {
"actor": {
"type": "AI_MODEL",
"identifier": "chest_xray_classifier_v2.1.3",
"model_hash": "sha256:abc123...",
"training_date": "2024-06-15",
"fda_clearance": "K123456"
},
"input": {
"patient_id_hash": "hmac-sha256:keyed_commitment...",
"image_study_uid": "1.2.840.113619.2.55...",
"input_hash": "sha256:def456...",
"acquisition_timestamp": 1734567800000000000
},
"context": {
"clinical_indication": "CHEST_PAIN_EVALUATION",
"referring_physician_id": "NPI_XXXXXXXXXX",
"prior_studies_reviewed": 3,
"patient_age_range": "60-69",
"active_protocol": "EMERGENCY_TRIAGE"
},
"action": {
"diagnosis": "PNEUMONIA_SUSPECTED",
"confidence": 0.87,
"explainability": {
"method": "GRADCAM",
"attention_regions": ["RIGHT_LOWER_LOBE"],
"contributing_factors": [
{"factor": "consolidation_pattern", "weight": 0.45},
{"factor": "air_bronchograms", "weight": 0.32}
]
},
"differential_diagnoses": [
{"diagnosis": "ATELECTASIS", "confidence": 0.08},
{"diagnosis": "LUNG_CANCER", "confidence": 0.03}
],
"recommended_action": "CONFIRM_WITH_CT"
}
},
"prev_hash": "sha256:789xyz...",
"signature": "ed25519:..."
}
Correspondence with international regulations
| Regulation | Jurisdiction | Requirements | MAP Support |
|---|---|---|---|
| EU AI Act Art. 6(1), Annex I Section A | EU | AI that is a safety component of, or is itself, a device requiring notified-body conformity assessment under MDR/IVDR is high-risk; logging (Art. 12) applies from 2 Aug 2028 | Design target (draft) |
| FDA draft guidance: AI-Enabled Device Software Functions — Lifecycle Management (Jan 2025) | USA | Lifecycle-management and performance-monitoring recommendations (draft; non-binding) | Design target (draft) |
| FDA PCCP | USA | Predetermined Change Control Plan, model change tracking | Design target (draft) |
| MDR 2017/745 | EU | Medical device traceability | Complementary |
| 21 CFR Part 11 | USA | Electronic records/signatures, audit trail | Design target (draft) |
| HIPAA | USA | PHI protection, access logs | Crypto-Shredding |
| GDPR | EU | Right to be forgotten, data minimization | Crypto-Shredding |
| PMD Act — IDATEN change-plan confirmation procedure | Japan | Post-market change plans for AI-enabled SaMD | Planned |
Recorded events linked in a hash chain
Operator identified with Ed25519 signature
Tamper detection via cryptographic hash
UUID v7 + NTP/PTP synchronization
External anchoring makes deletion detectable, even by administrators
| ALCOA+ Principle | Description | MAP design target (draft) |
|---|---|---|
| Attributable | Who recorded it | actor.identifier + signature |
| Legible | Readable | Standard JSON format |
| Contemporaneous | Recorded at time of action | Real-time log generation |
| Original | Originality | Verifiable via hash chain |
| Accurate | Accuracy | Verified with input data hash |
| Complete | Completeness | Event gaps detected via chain breakage |
| Consistent | Consistency | Linked via trace_id |
| Enduring | Durability | Tamper-evident, cryptographically verifiable |
| Available | Availability | Accessible via standard API |
Balancing append-only, tamper-evident audit trails with the right to be forgotten
"Append-Only Audit Trail"
Cannot delete
"GDPR Right to Erasure"
Erasure on request, subject to exceptions (Art. 17(3))
Appears irreconcilable
Patient Data
Encryption
Encrypted Data
Record
MAP
Encryption Key → Securely stored in Key Management System
On Deletion Request:
Destroy encryption key → Data becomes unreadable → Rendered unreadable — whether this counts as erasure is jurisdiction- and case-dependent
Hash chain maintained → Audit trail integrity preserved
Specific application scenarios
| Phase | Without MAP | With MAP |
|---|---|---|
| At Diagnosis | AI determines "No abnormality" | Same + Decision rationale recorded |
| Lawsuit Filed | "AI missed it" claim | Same |
| Discovery | Logs potentially tampered | Cryptographically verifiable evidence |
| Root Cause | "Model problem or data problem unknown" | "Accuracy issue under specific conditions in model v2.1.3" identified |
| Liability | Settlement with ambiguous liability | Judgment on records whose integrity and completeness can be verified |
FDA Auditor
PCCP Compliance Verification Request
Audit Evidence Provided
CRO (Contract Research Organization)
EDC System
MAP Anchoring
Hash recorded to external blockchain
Tampering detectable — even by system administrators
Verifiable data-integrity evidence for regulatory inspection
Model-lifecycle provenance is defined by VAP-SLEEP (SMP, v0.2.0 Working Draft); MAP v0.1.2 records model registration and refers to it
Development
MAP Record
Validation
MAP Record
Approval
MAP Record
Deploy
MAP Record
Operation
MAP Record
Retrain
MAP Record
| GMLP Principle | MAP design target (draft) |
|---|---|
| Training/Test data independence | Dataset hash enables post-verification |
| Dataset representativeness | Demographic metadata recorded |
| Model transparency | Explainability factors (SHAP/LIME/GradCAM) recorded |
| Continuous performance monitoring | Operational inference results continuously recorded |
Concept parameters — where they differ from the MAP v0.1.2 Working Draft, the draft prevails
Millisecond (NTP synchronized)
Per diagnostic event
SHA-256
Ed25519 (Future: Dilithium)
PHI excluded from events (commitments only); crypto-shredding of protected payloads
Canonical JSON (RFC 8785); FHIR AuditEvent mirroring is an informative sketch
Configurable per regulatory requirements (typically 10-30 years)
MAP development schedule (no dates set for the remaining steps). MAP is currently a v0.1.2 Working Draft; the later milestones have not been reached.
Framework hierarchy
Cross-domain parent framework for all domains
Standards organization that develops and maintains VAP
Finance
v1.2 ReleasedAutomotive
PlannedMedical
v0.1.2 Working DraftEnergy
PlannedPublic
Partial DraftWe welcome participation from medical device manufacturers, hospitals, and regulatory authorities.
"When AI says 'cancer,' what patients want to know isn't the probability. It's the rationale."
"In medicine, trust is not given. It is verified."
This content is licensed under CC BY 4.0 International
© 2025-2026 VeritasChain Standards Organization (VSO). All rights reserved.