Cloud Data Engineer

Barclays

Pune, India
Pyspark, dataframes, rdd, sparksql
Aws cloud development
Aws data analytics stack
Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security

Job Summary

  • Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security.
  • Design and implement scalable data architectures, including data pipelines, data warehouses, and data lakes, adhering to security measures.
  • Collaborate with data scientists to build and deploy machine learning models, driving innovation in the digital landscape.

Matching Summary

Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security.

Skills & Requirements

Must-have

  • pyspark, Dataframes, RDD, SparkSQL
  • AWS Cloud development
  • AWS Data Analytics Stack
  • Snowflake data solutions
  • DBT for ELT pipelines
  • Advanced SQL and PL SQL

Nice-to-have

  • stakeholder engagement and requirements elicitation
  • infrastructure understanding and solutions
  • data governance or lineage tools
  • orchestration tools like Airflow
  • Abinitio ETL tool knowledge

Key Requirements

  • Minimum two major project implementations
  • Experience with Snowflake and AWS tools
  • Data warehousing and data mart concepts

Work Rights

Not specified

Tailored Resume

Cover Letter