Hands-on experience with pyspark dataframes rdd sparksql
Developing testing maintaining applications on aws cloud
Strong knowledge of aws data analytics stack glue s3 lambda
The role involves building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security
Job Summary
The role involves building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security.
You will spearhead the evolution of the digital landscape by harnessing cutting-edge technology to revolutionize digital offerings and customer experiences.
Success requires collaborating with data scientists to build and deploy machine learning models while adhering to strict risk mitigation policies.
Matching Summary
The role involves building and maintaining systems that collect, store, process, and analyze data to ensure accuracy, accessibility, and security.
Skills & Requirements
Must-have
Hands-on experience with PySpark Dataframes RDD SparkSQL
Developing testing maintaining applications on AWS Cloud
Strong knowledge of AWS Data Analytics Stack Glue S3 Lambda
Designing scalable data transformation storage solutions using Snowflake
Experience in Data ingestion to Snowflake Parquet Iceberg JSON CSV
Using DBT Data Build Tool with Snowflake for ELT pipeline development
Writing advanced SQL and PL SQL programs
Nice-to-have
Exposure to data governance lineage tools Immuta Alation
Experience using Orchestration tools Apache Airflow Snowflake Tasks
Knowledge on Abinitio ETL tool
Ability to engage stakeholders elicit requirements translate into ETL components
Good knowledge of Data Marts and Data Warehousing concepts
Experience building reusable components using Snowflake and AWS Tools
Key Requirements
At least two major project implementations
In-depth technical knowledge in assigned area of expertise
Leadership responsibilities or individual contributor advisor role
Understanding of organizational products services and processes