Design and develop, and implement solutions to complex business problems, collaborating with stakeholders to understand their needs and requirements
Job Summary
Design and develop, and implement solutions to complex business problems, collaborating with stakeholders to understand their needs and requirements.
Design and development of solutions as products that can evolve, meeting business requirements that align with modern software engineering practices and automated delivery tooling.
Implement Cloud based Enterprise data warehouse with multiple data platform along with Snowflake and NoSQL environment to build data movement strategy.
Matching Summary
Design and develop, and implement solutions to complex business problems, collaborating with stakeholders to understand their needs and requirements.
Skills & Requirements
Must-have
design and implement data solutions
open table formats DELTA, Iceberg, Hudi
Pyspark, Dataframes, RDD, SparkSQL
AWS Data Analytics Technology Stack
DBT with snowflake/Athena/Glue
advanced SQL and PL SQL programs
enterprise data warehouse implementation
Nice-to-have
stakeholder engagement and requirement elicitation
data governance or lineage tools
orchestration tools Apache Airflow
Ab-initio ETL tool knowledge
Data Marts and Data Warehousing concepts
Key Requirements
Hands on experience in Pyspark performance optimization
Experience developing on AWS Cloud
Experience using DBT for ELT pipeline development
Worked on at least two major project implementations