The Data Engineer would be responsible for the delivery of a business need, end-to-end starting from understanding the requirements to deploying the software into production
Job Summary
The Data Engineer would be responsible for the delivery of a business need, end-to-end starting from understanding the requirements to deploying the software into production.
Engineer will work on a team of truly talented individuals and be responsible for design, build and testing (using automation scripts but not limited to unit/integration/performance testing) of Individual & Family Retail Health Insurance applications and its components that interface with complex enterprise systems and external vendor systems.
Develop and maintain scalable data pipelines using AWS services and Databricks. These processes are designed to extract data from multiple sources, transform it into meaningful formats, and load it into data lakes or downstream systems.
Matching Summary
The Data Engineer would be responsible for the delivery of a business need, end-to-end starting from understanding the requirements to deploying the software into production.
Skills & Requirements
Must-have
Databricks DLT
AWS Cloud Services
Python and/or PySpark
SQL, Spark
ELT/ETL techniques
CI/CD tools
Nice-to-have
automation first mindset
continuous improvement mindset
cutting-edge engineers
consultant mentality
data governance, lineage, and catalog tools
Key Requirements
11 to 13 years of experience
Bachelor’s degree in computer science or a related discipline strongly preferred
minimum of eight years’ experience application program development