Data Engineer - Pyspark

Barclays

Bengaluru, India
Pyspark
Aws cloud
Aws data analytics stack
Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure

Job Summary

  • Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake and build reusable components using Snowflake and AWS Tools/Technology.
  • You will be responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards.

Matching Summary

Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Skills & Requirements

Must-have

  • pyspark
  • AWS Cloud
  • AWS Data Analytics Stack
  • Snowflake
  • DBT
  • advanced SQL and PL SQL

Nice-to-have

  • data governance or lineage tools
  • Orchestration tools
  • Abinitio ETL tool
  • stakeholder engagement
  • Data Marts and Data Warehousing concepts

Key Requirements

  • Hands on experience in pyspark
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake
  • Experience in Data ingestion to Snowflake
  • Experience in using DBT (Data Build Tool) with snowflake
  • Should have worked at least on two major project implementations

Work Rights

Not specified

Tailored Resume

Cover Letter