Data Engineer - Aws, Pyspark

Brightonparkbank

Bengaluru, India
Aws cloud
Pyspark
Dataframes, rdd, sparksql
Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security

Job Summary

  • Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security.
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake and AWS technologies.
  • Collaborate with data scientists to build and deploy machine learning models, driving innovation in the digital landscape.

Matching Summary

Build and maintain systems that collect, store, process, and analyse data, ensuring accuracy, accessibility, and security.

Skills & Requirements

Must-have

  • AWS Cloud
  • PySpark
  • DataFrames, RDD, SparkSQL
  • AWS Data Analytics Stack
  • Snowflake
  • DBT with Snowflake
  • Advanced SQL and PL SQL

Nice-to-have

  • Data governance or lineage tools
  • Orchestration tools like Airflow
  • Abinitio ETL tool
  • Stakeholder engagement
  • Infrastructure setup understanding
  • Data Marts and Data Warehousing concepts

Key Requirements

  • Hands on experience in pyspark
  • Hands on Experience in AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack
  • Design and implement scalable solutions using Snowflake
  • Experience in Data ingestion to Snowflake
  • Experience in using DBT with snowflake
  • Writing advanced SQL and PL SQL programs
  • Worked on at least two major project implementations

Work Rights

Not specified

Tailored Resume

Cover Letter