Job Title : Data Engineer - Clinical Data Experience
Location: TORONTO, Canada
Skill Cluster : DE-Python_Full Stack (with SQL), Frameworks, DevOps.
Primary Skill : Python
Experience : 15 years
Job Description :
- We are looking for a hands-on Python / PySpark Developer with practical experience processing CCD/C-CDA clinical documents and building scalable healthcare data pipelines
Key Responsibilities
- Develop and enhance Python-based CCD/C-CDA parsing and clinical data processing solutions.
- Analyze raw CCD/C-CDA XML and extract clinical information such as demographics, encounters, diagnoses, medications, allergies, immunizations, vitals, labs, and procedures.
- Build reusable and scalable parsing logic that can support multiple EHRs, HIEs, vendors, and CCD variations.
- Onboard new CCD vendors into an existing framework with minimal vendor-specific code.
- Develop scalable data processing pipelines using Python and PySpark.
- Handle large numbers of files and large XML documents efficiently.
- Implement validation, error handling, logging, reconciliation, retry, and source-lineage capabilities.
- Troubleshoot missing, duplicate, malformed, or incorrectly interpreted clinical data.
- Optimize processing performance and support production incidents and root-cause analysis.
- Develop automated unit and regression tests to ensure new vendor changes do not impact existing integrations.
- Work with upstream providers and internal teams to resolve data-quality and clinical mapping issues.
Required Skills
- Strong hands-on Python development.
- Strong PySpark and large-scale data processing experience.
- Practical experience with XML parsing and CCD/C-CDA documents.
- Experience developing or significantly enhancing CCD/C-CDA parsers.
- Good understanding of clinical data domains such as Labs, Vitals, Problems, Medications, Immunizations, Allergies, Procedures, and Encounters.
- Experience handling different vendor/EHR implementations of CCD/C-CDA.
- Strong SQL and relational database experience.
- Experience with clinical terminology such as LOINC, SNOMED CT, ICD-10, CPT/HCPCS, RxNorm, and CVX.
- Experience designing modular, reusable, and configuration-driven solutions rather than vendor-specific hardcoded parsers.
Preferred Skills
- AWS experience including S3, Lambda, Glue, ECS/Fargate, Step Functions, SQS/SNS, CloudWatch, or similar services.
- Experience with Epic, Cerner, Meditech, HIEs, or other EHR/clinical data sources.
- Healthcare payer, population health, or clinical quality reporting experience.
- HEDIS / NCQA knowledge is an advantage but not mandatory