Data Engineer - Pyspark And Aws

jobs.barclays

Chennai, , India
Pyspark
Aws data analytics stack
Snowflake
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure

Job Summary

  • Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake and harness cutting-edge technology to revolutionise our digital offerings.
  • You will be responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards.

Matching Summary

Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Skills & Requirements

Must-have

  • PySpark
  • AWS Data Analytics Stack
  • Snowflake
  • Data ingestion to Snowflake
  • DBT with Snowflake
  • Advanced SQL and PL SQL

Nice-to-have

  • Data governance or lineage tools
  • Orchestration tools like Airflow
  • Abinitio ETL tool
  • Stakeholder engagement and requirements elicitation
  • Infrastructure setup understanding
  • Data Marts and Data Warehousing concepts

Key Requirements

  • Hands on experience in pyspark
  • Hands on Experience in AWS Cloud
  • Experience with Snowflake
  • Experience with DBT
  • Experience writing advanced SQL
  • Worked on at least two major project implementations

Work Rights

Not specified

Tailored Resume

Cover Letter