Senior Data Engineer

jobs.barclays

Pune, IN
Not specified; not specified; not specified
Apache spark scala pyspark
Aws ecosystem s3 glue athena
Apache iceberg lakehouse architecture
The role involves building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security within a regulated financial environment

Job Summary

  • The role involves building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security within a regulated financial environment.
  • Candidates must demonstrate strong hands-on expertise in designing scalable data solutions using Apache Spark, AWS services, and modern Lakehouse architectures like Apache Iceberg.
  • Success in this position requires collaborating with data scientists, managing risks, and adhering to Barclays' core values of Respect, Integrity, Service, Excellence, and Stewardship.

Matching Summary

The role involves building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security within a regulated financial environment.

Salary

Not specified; Not specified; Not specified

Skills & Requirements

Must-have

  • Apache Spark Scala PySpark
  • AWS ecosystem S3 Glue Athena
  • Apache Iceberg Lakehouse architecture
  • Terraform Infrastructure as Code
  • Airflow orchestration tools
  • Snowflake Databricks integration
  • Regulated enterprise environment experience

Nice-to-have

  • Ab Initio ETL experience
  • Complex data governance patterns
  • Advanced SQL and data modelling
  • Additional orchestration beyond Airflow
  • Strategic thinking and business acumen
  • Leadership and team management skills

Key Requirements

  • Strong enterprise delivery exposure
  • Experience with production-ready pipelines
  • Deep knowledge of AWS services
  • Proven track record in large enterprises

Work Rights

Not specified

Tailored Resume

Cover Letter