Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure
Job Summary
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
As an AWS Data Engineer - AVP, you are responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards.
You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences.
Matching Summary
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Skills & Requirements
Must-have
AWS Data Analytics Technology Stack
Snowflake
DBT (Data Build Tool)
Unix scripting
Python and PySpark
AWS Cloud development
Nice-to-have
Data governance or lineage tools
Orchestration tools like Apache Airflow
Abinitio ETL tool
Data Marts and Data Warehousing concepts
Key Requirements
Strong Test Automation skills
Hands-on experience in Unix scripting
Hands-on experience in python and pyspark
Hands-on Experience in developing, testing and maintaining applications on AWS Cloud
Strong hold on AWS Data Analytics Technology Stack
Design and implement scalable and efficient data transformation/storage solutions using Snowflake
Experience in Data ingestion to Snowflake
Experience in using DBT (Data Build Tool) with snowflake
Experience in Writing advanced SQL and PL SQL programs
Experience in AWS data pipeline development
Worked on at least two major project implementations