Associate Director of RWD Engineering
Eli Lilly and Company
August 29, 2026
Remote friendly (Indianapolis, IN)
United States
IT
Purpose
- Support the end-to-end engineering vision for Lilly’s real-world data (RWD) infrastructure by designing and executing scalable, cloud-native pipelines and data products to generate evidence faster and more reproducibly.
Responsibilities
- Lead design, development, and implementation of cloud-native data products and high-throughput pipelines that create analysis-ready RWD assets.
- Own the end-to-end lifecycle of RWD data products (requirements → prototyping → production → optimization) ensuring scalability, reliability, performance, and reproducibility.
- Build/maintain ETL/ELT ingestion and transformation pipelines for large-scale multi-modal RWD (claims, complex EHR, linked datasets).
- Implement lakehouse architectures (e.g., medallion bronze/silver/gold) in Databricks using cloud storage (AWS S3, ADLS).
- Create reusable, version-controlled transformation logic using healthcare standards (ICD-10/9, NDC, RxNorm, SNOMED, CPT/HCPCS, LOINC).
- Optimize SQL and distributed workloads (e.g., Spark) for very large datasets.
- Establish automation, data quality checks, validation, monitoring/alerting, and documentation; support CI/CD and testing.
- Collaborate with cross-functional partners; provide technical consultation and training materials.
Minimum Qualifications
- Bachelor’s degree (CS/Engineering/Statistics/IT/Bioinformatics/technical field).
- 3+ years hands-on data engineering focused on healthcare/life sciences RWD.
- 3+ years applied expertise in Python and SQL plus cloud/ETL/ELT pipeline tools (e.g., AWS Glue/EMR, Snowflake, Databricks) and orchestration (e.g., Prefect); (other listed tools acceptable).
Preferred Skills/Experience
- SQL optimization on AWS Redshift/Databricks SQL/Snowflake/BigQuery; Spark/distributed computing (Dask/Ray).
- Delta Lake/Apache Iceberg; dbt; DevOps (Git, CI/CD, Docker).
- Healthcare RWD domain expertise (claims and EHR/FHIR), terminology/ontology mapping, OMOP CDM.
- Pipeline observability/quality tools; FDA/EMA RWE audit readiness.
Compensation/Benefits (as stated)
- Anticipated wage: $156,000–$228,800; eligibility for company bonus.
- Eligible benefits include 401(k), pension, vacation, medical/dental/vision/prescription coverage, flexible benefits, life insurance, time off/leave, and well-being benefits.
- Support the end-to-end engineering vision for Lilly’s real-world data (RWD) infrastructure by designing and executing scalable, cloud-native pipelines and data products to generate evidence faster and more reproducibly.
Responsibilities
- Lead design, development, and implementation of cloud-native data products and high-throughput pipelines that create analysis-ready RWD assets.
- Own the end-to-end lifecycle of RWD data products (requirements → prototyping → production → optimization) ensuring scalability, reliability, performance, and reproducibility.
- Build/maintain ETL/ELT ingestion and transformation pipelines for large-scale multi-modal RWD (claims, complex EHR, linked datasets).
- Implement lakehouse architectures (e.g., medallion bronze/silver/gold) in Databricks using cloud storage (AWS S3, ADLS).
- Create reusable, version-controlled transformation logic using healthcare standards (ICD-10/9, NDC, RxNorm, SNOMED, CPT/HCPCS, LOINC).
- Optimize SQL and distributed workloads (e.g., Spark) for very large datasets.
- Establish automation, data quality checks, validation, monitoring/alerting, and documentation; support CI/CD and testing.
- Collaborate with cross-functional partners; provide technical consultation and training materials.
Minimum Qualifications
- Bachelor’s degree (CS/Engineering/Statistics/IT/Bioinformatics/technical field).
- 3+ years hands-on data engineering focused on healthcare/life sciences RWD.
- 3+ years applied expertise in Python and SQL plus cloud/ETL/ELT pipeline tools (e.g., AWS Glue/EMR, Snowflake, Databricks) and orchestration (e.g., Prefect); (other listed tools acceptable).
Preferred Skills/Experience
- SQL optimization on AWS Redshift/Databricks SQL/Snowflake/BigQuery; Spark/distributed computing (Dask/Ray).
- Delta Lake/Apache Iceberg; dbt; DevOps (Git, CI/CD, Docker).
- Healthcare RWD domain expertise (claims and EHR/FHIR), terminology/ontology mapping, OMOP CDM.
- Pipeline observability/quality tools; FDA/EMA RWE audit readiness.
Compensation/Benefits (as stated)
- Anticipated wage: $156,000–$228,800; eligibility for company bonus.
- Eligible benefits include 401(k), pension, vacation, medical/dental/vision/prescription coverage, flexible benefits, life insurance, time off/leave, and well-being benefits.