Pipeline
Pipeline patterns focus on data processing and transformation workflows that handle the movement, transformation, and governance of healthcare data.
Pipeline patterns address the complex requirements of healthcare data workflows:
- Audit and provenance tracking for regulatory compliance and data lineage
- Population-scale data export for research and analytics
- De-identification and privacy preservation for secondary use scenarios
- Asynchronous processing for long-running operations
The Pipeline provide essential capabilities:
Audit & Provenance Chain
Implement end-to-end audit logging and provenance tracking through a chain of responsibility pattern, enabling comprehensive traceability for regulatory compliance.
Key Benefits: - Comprehensive Tracking: Complete audit trail from request to response - Standards Compliance: Implements IHE ATNA/BALP requirements - Data Lineage: Provenance resources track data origins and transformations - Regulatory Support: Supports HIPAA, GDPR audit requirements
Population Export Pipeline
Orchestrate large-scale data extraction using FHIR Bulk Data APIs with proper authentication and transformation, enabling research and analytics use cases.
Key Benefits: - Scalable Extraction: Handle population-level data volumes - Standards-Based: Built on FHIR Bulk Data specification - Secure: Uses SMART Backend Services authentication - Flexible: Support for filtering, transformation, and multiple destinations
De-Identification Adapter
Apply consistent de-identification transformations across FHIR and DICOM data for secondary use scenarios, enabling research while preserving privacy.
Key Benefits: - Consistent Processing: Same rules applied to FHIR and DICOM - Policy-Driven: Flexible rules for different use cases - Pseudonymization: Maintain linkage while protecting identity - Standards-Based: Follows HIPAA Safe Harbor and Expert Determination
Asynchronous Invocation
Handle long-running FHIR operations through asynchronous job management and polling, enabling non-blocking execution of time-consuming processes.
Key Benefits: - Non-blocking Operations: Clients don't wait for long-running processes - Resource Management: Server resources allocated efficiently for long tasks - Progress Visibility: Real-time status and progress information - Fault Tolerance: Retry logic and error handling for unreliable operations
Common Combinations
Research Export
- Population Export Pipeline
- Asynchronous Invocation
- De-Identification Adapter
- Audit & Provenance Chain