Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure
Job Summary
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Design and implement scalable and efficient data transformation/storage solutions using Snowflake.
You will be responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards.
Matching Summary
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Skills & Requirements
Must-have
AWS Cloud
PySpark
DataFrames, RDD, SparkSQL
AWS Data Analytics Stack
Snowflake
DBT with Snowflake
Advanced SQL and PL SQL
Nice-to-have
Data governance or lineage tools
Orchestration tools like Airflow
Abinitio ETL tool
Data Marts and Data Warehousing concepts
Stakeholder engagement and requirement elicitation
Cloud based Enterprise data warehouse implementation
Key Requirements
Hands on experience in pyspark
Hands on Experience in developing, testing and maintaining applications on AWS Cloud
Experience in Data ingestion to Snowflake
Experience in using DBT (Data Build Tool) with snowflake