Practical experience with databricks workspace and cluster management
Intellect Minds Pte. Ltd. is seeking a Senior Data Engineer with extensive experience in data engineering principles, particularly focusing on the Databricks platform and PySpark. The role involves designing scalable data pipelines, modernizing legacy code, and collaborating with cross-functional teams
Job Summary
The role involves designing, building, and operating scalable and reliable data pipelines on the Databricks platform from ingestion through consumption.
Candidates will be responsible for refactoring legacy code and data pipelines to PySpark for improved performance and scalability while migrating traditional ETL processes to modern ELT patterns.
The position requires collaborating with data architects, analysts, and business stakeholders while mentoring junior data engineers on PySpark and Databricks technologies.
Matching Summary
Match Score: 85
Intellect Minds Pte. Ltd. is seeking a Senior Data Engineer with extensive experience in data engineering principles, particularly focusing on the Databricks platform and PySpark. The role involves designing scalable data pipelines, modernizing legacy code, and collaborating with cross-functional teams.