Data Engineer - Pyspark, Sql

Brightonparkbank

Pune, India
Pyspark distributed data processing
Advanced sql query writing
Hadoop big data tools
Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security

Job Summary

  • Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security.
  • Design and implement data warehouses and data lakes, develop processing algorithms, and collaborate with data scientists to deploy machine learning models.
  • Perform prescribed activities in a timely manner to a high standard, driving continuous improvement and demonstrating in-depth technical knowledge.

Matching Summary

Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security.

Skills & Requirements

Must-have

  • PySpark distributed data processing
  • Advanced SQL query writing
  • Hadoop big data tools
  • Linux Shell Scripting automation
  • Data architectures and pipelines

Nice-to-have

  • Continuous improvement mindset
  • Collaboration with data scientists
  • Leadership and team guidance
  • Risk and controls management
  • Understanding of organizational products

Key Requirements

  • Experience with Teradata enterprise data warehousing
  • Proficiency in PySpark
  • Familiarity with Hadoop
  • Strong Linux Shell Scripting skills
  • Advanced SQL skills

Work Rights

Not specified

Tailored Resume

Cover Letter