$113,589 - $220,000pyear; not specified; not speci...
Scalable big data pipelines
Etl using spark and databricks
Scala, python, spark, sql development
Translates business problems into data-related solutions, identifying appropriate methods and tools, and demonstrating use cases
Job Summary
Translates business problems into data-related solutions, identifying appropriate methods and tools, and demonstrating use cases.
Builds infrastructure for optimal data transformation and integration, automating tedious tasks and deploying pipelines using orchestration frameworks.
Establishes and documents data governance projects, implementing practices in partnership with stakeholders and educating others on processes and policies.
Matching Summary
Translates business problems into data-related solutions, identifying appropriate methods and tools, and demonstrating use cases.
Salary
$113,589 - $220,000/year; Not specified; Not specified
Skills & Requirements
Must-have
scalable big data pipelines
ETL using Spark and Databricks
Scala, Python, Spark, SQL development
SQL and Spark SQL querying
cloud ecosystem (GCP, AWS, Azure)
Parquet, AVRO, CSV, ORC, JSON
HDFS, GCS, Azure Blob Storage, S3
Nice-to-have
business problem formulation
business stakeholder recommendations
data governance implementation
system architecture and design
incident and change management
Key Requirements
Bachelor's degree or equivalent + 4 years experience
Master's degree or equivalent + 2 years experience