Role Summary
Senior Data Engineer responsible for designing, building, and maintaining data pipelines and data solutions using Palantir Foundry to support data-driven initiatives across AbbVieโs Commercial Analytics. You will design, develop, and maintain data pipelines, ensure data quality, and drive innovation through data engineering solutions. Work with cross-functional teams to translate data requirements into robust, scalable data products and services.
Responsibilities
- Planning, building, and running enterprise class information management solutions on Palantir Foundry
- Designing, developing, testing, and maintaining data pipelines to support Analytics projects within Commercial
- Design, implement, and maintain scalable Functions in Palantir Foundry
- Building data products and service processes which perform data transformation, metadata extraction, workload management and error processing management
- Collaborate with cross-functional teams to understand data requirements and translate them into robust and efficient solutions
- Develop and optimize ETL processes to ensure timely and accurate data delivery to various business applications
- Implementing standardized, automated operational and quality control processes to deliver accurate and timely data and reporting
- Adhering to best practices for coding, testing, and designing reusable code/component
- Collaborating with Data Analysts and Scientists to enable streamlined data flow for the Commercial Analytics capabilities across brands
- Ensuring appropriate security and compliance policies are followed for information access and dissemination
- Defining and applying information quality and consistency business rules throughout the data processing lifecycle
- Collaborating with information providers to ensure quality data updates are processed in a timely fashion
- Working in self-responsible Agile Teams
Skills
- Palantir Foundry
- PySpark, Python, and SQL
- Data Modeling
- Git, Jira, Confluence
- AWS
- Typescript & Javascript knowledge is a plus
Qualifications
- Required: Bachelor's Degree with 6 yearsโ experience; or Master's Degree with 4 yearsโ experience
- Required: 6+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry
- Required: Experience in data processing roles such as database developer/administrator, ETL/Big Data developer, data analyst and/or BI analytics developer
- Required: Experience with cloud platforms, big data platforms and one or more general purpose programming languages, including but not limited to: Python, SQL, Spark, Amazon Web Services, Typescript and Javascript
- Required: Experience with DevOps principals and version control (Git preferred)
- Required: End-to-end experience with data, including querying, aggregation, analysis, and visualization
- Required: Good communication and presentation skills, being able to explain complex problems and the solutions applied, and comfortable in presenting technical solutions to a nontechnical audience
- Preferred: Experience with Veeva CRM, Reltio, SAP and/or Palantir Foundry
- Preferred: Knowledge of pharmaceutical industry regulations, such as data privacy laws, is highly desirable
- Preferred: Affinity to either performance optimizing, user experience design, automated testing and/or data science