Data Engineer - Pyspark, Sql

jobs.barclays

Bengaluru, India
Advanced sql query writing and performance tuning
Teradata enterprise data warehousing experience
Proficiency in pyspark distributed data processing
The role involves building and maintaining data architectures, pipelines, warehouses, and lakes to ensure accurate, accessible, and secure data

Job Summary

  • The role involves building and maintaining data architectures, pipelines, warehouses, and lakes to ensure accurate, accessible, and secure data.
  • Candidates will collaborate with data scientists to build and deploy machine learning models while adhering to strict security measures.
  • This position requires strong leadership or individual contributor expertise in driving continuous improvement and managing operational risks.

Matching Summary

The role involves building and maintaining data architectures, pipelines, warehouses, and lakes to ensure accurate, accessible, and secure data.

Skills & Requirements

Must-have

  • Advanced SQL query writing and performance tuning
  • Teradata enterprise data warehousing experience
  • Proficiency in PySpark distributed data processing
  • Hadoop big data tools and architecture familiarity
  • Strong Linux Shell Scripting for automation

Nice-to-have

  • AWS cloud-based data platform awareness
  • Experience with data migration on AWS
  • Collaboration with data scientists for ML models
  • Leadership behaviors aligned with LEAD framework
  • Understanding of risk mitigation policies

Key Requirements

  • In-depth technical knowledge in assigned area
  • Ability to lead and supervise teams if applicable
  • Understanding of organizational products and processes

Work Rights

Not specified

Tailored Resume

Cover Letter