Senior Data Engineer

Walmartpr

Bentonville, AR, US
$107,744 - $180,000pyear
Spark, hive, hadoop or hbase
Kafka message publishing/consuming
Data lakehouse concepts and architecture
Understand, articulate, and apply principles of the defined strategy to routine business problems that involve a single function

Job Summary

  • Understand, articulate, and apply principles of the defined strategy to routine business problems that involve a single function.
  • Extract data from identified databases, create data pipelines, and transform data to a structure that is relevant to the problem by selecting appropriate techniques.
  • Establish, modify, and document data governance projects and recommendations, and implement data governance practices in partnership with business stakeholders and peers.

Matching Summary

Understand, articulate, and apply principles of the defined strategy to routine business problems that involve a single function.

Salary

$107,744 - $180,000/year

Skills & Requirements

Must-have

  • Spark, Hive, Hadoop or HBase
  • Kafka message publishing/consuming
  • Data Lakehouse concepts and architecture
  • Apache Hudi for change data capture
  • Graphana and Splunk for log monitoring
  • Kibana for dashboard building
  • Object Oriented language (Scala, Java, Python)
  • Big Query or Redshift data warehouse
  • DataProc for cluster deployment
  • GCS/Azure Blob Storage/S3 buckets
  • Airflow/Atomic for pipeline scheduling
  • Github/GitLab for version control
  • Jenkins for CI/CD pipelines
  • Helm Charts and Argo CD gitops
  • Looker/Tableau/Power BI for dashboards
  • Performance tuning for cost optimization

Nice-to-have

  • articulate principles of defined strategy
  • support understanding of requirements
  • develop knowledge of data science trends
  • recommendations to business stakeholders
  • develop business cases with ROI
  • interpreter and conduit for business needs
  • oversee tasks of less experienced programmers
  • educate others on data governance

Key Requirements

  • Master's degree + 1 year experience OR Bachelor's degree + 3 years experience
  • Experience in software engineering or related field

Work Rights

Not specified

Tailored Resume

Cover Letter