Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure
Job Summary
Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Design and implement scalable and efficient data transformation/storage solutions using Snowflake and develop processing and analysis algorithms fit for intended data complexity and volumes.
Partner with other functions and business areas, advise and influence decision making, and take responsibility for end results of a team’s operational processing and activities.
Matching Summary
Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Skills & Requirements
Must-have
PySpark
AWS Data Analytics Stack
Snowflake
DBT with Snowflake
Advanced SQL and PL SQL
Data ingestion to Snowflake
Reusable components using Snowflake and AWS
Nice-to-have
Data governance or lineage tools
Orchestration tools like Apache Airflow
Ab Initio ETL tool
Stakeholder engagement and requirement elicitation
Infrastructure setup understanding
Data Marts and Data Warehousing concepts
Cloud-based Enterprise Data Warehouse implementation