Senior PySpark Data Engineer

Citigroup

Pune, Maharashtra, India
On-site
6+ years professional data engineering experience
Extensive hands-on pyspark and python skills
Experience with cloudera or databricks platforms
Citigroup is seeking a Senior PySpark Data Engineer for their Pune, Maharashtra office. The ideal candidate will have extensive experience in building scalable data processing systems using PySpark and be proficient in various Big Data technologies

Job Summary

  • The role involves designing, developing, and maintaining robust, scalable, and high-performance data pipelines using PySpark.
  • Candidates will collaborate with data scientists and business stakeholders to deliver high-quality data solutions while ensuring compliance with security policies.
  • This position offers the opportunity to join a global team of over 230,000 dedicated people at Citi to make a real impact on the business.

Matching Summary

Match Score: 85

Citigroup is seeking a Senior PySpark Data Engineer for their Pune, Maharashtra office. The ideal candidate will have extensive experience in building scalable data processing systems using PySpark and be proficient in various Big Data technologies.

Skills & Requirements

Must-have

  • 6+ years professional data engineering experience
  • Extensive hands-on PySpark and Python skills
  • Experience with Cloudera or Databricks platforms
  • Proficiency with Apache Airflow for workflow orchestration
  • Strong SQL and distributed query engine knowledge
  • Experience with Linux/Unix environments and Git

Nice-to-have

  • Mentoring junior data engineers
  • Collaboration with data scientists and analysts
  • Knowledge of CI/CD pipeline implementation
  • Understanding of data governance policies
  • Experience with non-relational databases

Key Requirements

  • Bachelor's degree or equivalent experience
  • 6+ years of relevant professional experience
  • Hands-on experience with Starburst (Trino/Presto)

Work Rights

Not specified

Tailored Resume

Cover Letter