Hadoop Data Infrastructure Engineer | Cloud Migration, Cluster Support, Automation, Performance Optimization, Security & High Availability

synste.no

Hybrid
Cloudera platform (cdh/hdp) or hadoop 2.x/3.x
Terraform, ansible, git, jenkins
Shell and python scripting
Lead the design, implementation, and management of enterprise-grade big data infrastructure, supporting high-availability Hadoop clusters, optimizing performance, automating deployment workflows, and integrating new technological solutions

Job Summary

  • Lead the design, implementation, and management of enterprise-grade big data infrastructure, supporting high-availability Hadoop clusters, optimizing performance, automating deployment workflows, and integrating new technological solutions.
  • Automate provisioning, patching, and configuration management of Hadoop data environments using Terraform, Ansible, and scripting, while supporting high-availability architectures and monitoring system health.
  • Support migration activities and cloud integration (AWS, Azure) for hybrid data environments, ensuring compliance with security, data governance, and enterprise standards.

Matching Summary

Lead the design, implementation, and management of enterprise-grade big data infrastructure, supporting high-availability Hadoop clusters, optimizing performance, automating deployment workflows, and integrating new technological solutions.

Skills & Requirements

Must-have

  • Cloudera platform (CDH/HDp) or Hadoop 2.x/3.x
  • Terraform, Ansible, Git, Jenkins
  • Shell and Python scripting
  • Linux OS
  • High-availability Hadoop clusters
  • Performance optimization
  • Security & High Availability

Nice-to-have

  • Spark, Hive, Presto, Kafka
  • AWS EMR, Azure HDInsight
  • Kubernetes, GitHub Actions
  • Prometheus, Grafana
  • Banking, finance, telecom, or healthcare

Key Requirements

  • 5+ years supporting large-scale Hadoop clusters
  • Experience in migration projects and automation
  • Experience in enterprise environments
  • Bachelor’s or Master’s degree in Computer Science, Data Science, or related field
  • Cloudera Certified Administrator (CCA) or AWS/Azure Data Engineer certifications are a plus

Work Rights

Not specified

Tailored Resume

Cover Letter