Design, develop, and maintain resilient data pipelines, as well as administer databases both in the cloud (AWS & Azure) and on-premises
Job Summary
Design, develop, and maintain resilient data pipelines, as well as administer databases both in the cloud (AWS & Azure) and on-premises.
Collaborate closely with data engineers, developers, analysts, and other cross-functional teams to ensure data is readily accessible, reliable, and optimized for performance.
Participate in modernization initiatives, including database migrations and upgrades, and contribute to automation projects aimed at streamlining the provisioning and operation of various datastores.
Matching Summary
Design, develop, and maintain resilient data pipelines, as well as administer databases both in the cloud (AWS & Azure) and on-premises.
Skills & Requirements
Must-have
PostgreSQL database management
AWS Cloud expertise
ETL/ELT pipeline design and implementation
Python programming
SQL proficiency
Data pipeline troubleshooting and monitoring
Nice-to-have
Agile methodologies
DevOps tools for operations
Open-source database technologies
Shell Scripting
Apache Spark
Key Requirements
3+ years of experience in cloud-based data engineering
3-5 years of practical experience managing Postgres databases
Hands-on experience with ETL/ELT tools and frameworks