The role involves building and maintaining end-to-end data pipelines for ingestion, processing, and transformation using Informatica IDMC and Databricks
Job Summary
The role involves building and maintaining end-to-end data pipelines for ingestion, processing, and transformation using Informatica IDMC and Databricks.
Candidates will be responsible for monitoring pipeline performance, applying resource-scaling techniques, and automating routine tasks like scheduling and alerting.
The position requires troubleshooting production data issues, performing root-cause analysis, and contributing to cost optimization efforts within the AWS environment.
Matching Summary
Match Score: 75
The role involves building and maintaining end-to-end data pipelines for ingestion, processing, and transformation using Informatica IDMC and Databricks.
Skills & Requirements
Must-have
Informatica IDMC expertise
Databricks PySpark development
AWS cloud data engineering
Python programming proficiency
Strong SQL database skills
Nice-to-have
Tableau visualization experience
Informatica certification preferred
DevOps and CI/CD knowledge
Data governance familiarity
Git version control usage
Key Requirements
Bachelor's or Master's degree in Computer Science or related field
Minimum 3 years of cloud data engineering experience
Proficiency in Python/PySpark and strong SQL skills