Design, develop, and optimize end-to-end data pipelines using Databricks and implement/manage Lakehouse architecture with Delta tables
Job Summary
Design, develop, and optimize end-to-end data pipelines using Databricks and implement/manage Lakehouse architecture with Delta tables.
Lead troubleshooting, root cause analysis, and performance tuning, while collaborating with Architects, Business Analysts, and downstream consumers.
Support CI/CD implementation for Databricks jobs and notebooks, mentor junior engineers, and ensure adherence to security, governance, and compliance standards.
Matching Summary
Design, develop, and optimize end-to-end data pipelines using Databricks and implement/manage Lakehouse architecture with Delta tables.