Lead the development and deployment of complex data pipelines using AWS Glue, Python, and SQL, ensuring they meet performance standards
Job Summary
Lead the development and deployment of complex data pipelines using AWS Glue, Python, and SQL, ensuring they meet performance standards.
Act as the primary technical expert for Ataccama, configuring advanced matching, merging, and data quality rules.
Provide daily guidance to junior developers and conduct deep-dive code reviews to ensure best practices.
Matching Summary
Lead the development and deployment of complex data pipelines using AWS Glue, Python, and SQL, ensuring they meet performance standards.
Salary
Base: 100,000 USD - 154,000 USD; Bonus/Equity: Annual bonus plan or role-based incentive plan; Benefits: Generous PTO, 401k match up to $7,200, company stock purchase discount, and more
Skills & Requirements
Must-have
AWS Glue (Spark)
Python for data manipulation
Advanced SQL and PostgreSQL
Ataccama MDM configuration
Git (Bitbucket) workflows
CI/CD pipelines
Nice-to-have
Proactive communication
Technical mentorship
Documentation champion
Calm under pressure
Ownership mindset
Adaptable and curious
Key Requirements
5+ years in Data Engineering
Experience with ETL and AWS Cloud
Expertise in AWS Glue, SQS, and Lambda
Proficiency in Python
Hands-on experience with Ataccama or similar MDM tools