Partner with business and technical stakeholders to deeply understand and translate requirements into scalable data solutions
Job Summary
Partner with business and technical stakeholders to deeply understand and translate requirements into scalable data solutions.
Build and optimize production-grade ETL pipelines using Spark and PySpark, ensuring reliability and efficiency.
Contribute actively to Agile ceremonies, including sprint planning, grooming, daily stand-ups, demos, and retrospectives, fostering a culture of continuous improvement.
Matching Summary
Partner with business and technical stakeholders to deeply understand and translate requirements into scalable data solutions.
Skills & Requirements
Must-have
Spark and PySpark ETL pipelines
Databricks Unity Catalog
AWS services
CI/CD pipelines
Agile ceremonies
Unix/Linux shell scripting
Nice-to-have
Curiosity, drive, and collaborative spirit
Knowledge of the healthcare domain
Creativity and foresight
Key Requirements
8+ years of related hands-on experience
Proven ability to write complex SQL queries
Solid experience implementing data lake/warehouse on Databricks
Proficiency with Agile methodologies and DevOps tools