$113,589 - $220,000pyear; not specified; not speci...
Design and implement scalable big data pipelines
Develop etl pipelines using scala, python, spark, sql
Sql and spark sql querying
Translates/co-owns business problems within one's discipline to data related or mathematical solutions, identifying appropriate methods/tools and sharing use cases
Job Summary
Translates/co-owns business problems within one's discipline to data related or mathematical solutions, identifying appropriate methods/tools and sharing use cases.
Builds the infrastructure required for optimal transformation and integration from a wide variety of data sources using modern tools, techniques, and architectures.
Establishes, modifies, and documents data governance projects and recommendations, implementing practices in partnership with business stakeholders and peers.
Matching Summary
Translates/co-owns business problems within one's discipline to data related or mathematical solutions, identifying appropriate methods/tools and sharing use cases.
Salary
$113,589 - $220,000/year; Not specified; Not specified
Skills & Requirements
Must-have
design and implement scalable big data pipelines
develop ETL pipelines using Scala, Python, Spark, SQL
SQL and Spark SQL querying
orchestrate and automate pipeline solutions
develop modules in cloud ecosystem (GCP, AWS, Azure)
work with Parquet, AVRO, CSV, ORC, JSON
experience with HDFS, GCS, Azure Blob Storage, S3
Nice-to-have
translate business problems to data solutions
provide recommendations to business stakeholders
interpret company and regulatory policies on data
create and automate dashboards using Power BI, Tableau, Looker
apply incident management and change management
Key Requirements
Bachelor's degree or equivalent in Computer Science plus 4 years of experience
Master's degree or equivalent in Computer Science plus 2 years of experience