Design and develop a consolidated, conformed enterprise data warehouse and data lake that will store all critical data across customer, provider, claims, client, and benefits data
Job Summary
Design and develop a consolidated, conformed enterprise data warehouse and data lake that will store all critical data across customer, provider, claims, client, and benefits data.
Manage processes that are highly complex and impact the greater organization.
Provide thought leadership and technical expertise across multiple disciplines.
Matching Summary
Design and develop a consolidated, conformed enterprise data warehouse and data lake that will store all critical data across customer, provider, claims, client, and benefits data.
Skills & Requirements
Must-have
Enterprise data warehouse and data lake design
Data analysis for relationships and patterns
Deliver enterprise information environment
Manage highly complex organizational processes
Thought leadership and technical expertise
Lead sizable projects
Nice-to-have
Counsel top management on engineering matters
Source of knowledge for complex assignments
Key Requirements
Bachelor's degree in engineering
5 years of experience
AWS and Databricks certifications
Healthcare or PBM industry experience
Migrate data pipelines from Hadoop to AWS Databricks
Transform Oozie workflows to Databricks jobs
Migrate Hive tables to Delta Lake
Design event-driven pipelines
Build and optimize Spark workloads
Engineer serverless validation framework
Develop CI/CD pipelines with Terraform and Jenkins
Create Apache Iceberg tables
Design automation scripts for cost optimization
Experience using Kafka, NIFI, Hadoop, Java, Jenkins, Docker, Ansible, AWS, Spark, Python, Scala, Golang, Apache Kafka, Apache Camel, and Spring Boot