Senior Data Engineer

Hginsights

Pune, India
**
Large-scale distributed data pipelines
Enterprise-grade big-data systems
Orchestration with airflow
** Hginsights is seeking a Senior Data Engineer to design and optimize large-scale distributed data pipelines. The ideal candidate will have extensive experience in building production-grade big data systems and will work closely with product teams to ensure data quality and system reliability. **

Job Summary

  • Design, build, and optimize large-scale distributed data pipelines for processing billions of events from and to multiple sources of data.
  • Architect and scale enterprise-grade big-data systems, including data lakes, ETL/ELT workflows, and syndication platforms for customer-facing products.
  • Drive system reliability through automation, CI/CD pipelines (Docker, Kubernetes, Terraform), and infrastructure-as-code practices.

Matching Summary

Match Score: 75

** Hginsights is seeking a Senior Data Engineer to design and optimize large-scale distributed data pipelines. The ideal candidate will have extensive experience in building production-grade big data systems and will work closely with product teams to ensure data quality and system reliability. **

Skills & Requirements

Must-have

  • Large-scale distributed data pipelines
  • Enterprise-grade big-data systems
  • Orchestration with Airflow
  • Optimized data writing
  • Data quality and reliability
  • CI/CD pipelines (Docker, Kubernetes, Terraform)

Nice-to-have

  • Data governance frameworks
  • Open-source contributions
  • DevOps monitoring tools
  • Serverless architectures

Key Requirements

  • 7+ years of experience
  • BS/MS/Ph.D. in Computer Science
  • Strong SQL skills
  • Data modeling fundamentals
  • ETL / ELT pipelines experience
  • Proficiency in Python
  • Familiarity with dbt, Airflow, Databricks

Work Rights

Not specified

Tailored Resume

Cover Letter