The role involves owning the end-to-end operational side of a critical Spark-on-Kubernetes platform used for secure data masking across ING
Job Summary
The role involves owning the end-to-end operational side of a critical Spark-on-Kubernetes platform used for secure data masking across ING.
Engineers are responsible for automating the entire Spark job lifecycle, including container builds, deployments, and security hardening on RHEL environments.
The team operates in a flexible, collaborative culture where impact is the primary driver of work and fair feedback is encouraged.
Matching Summary
The role involves owning the end-to-end operational side of a critical Spark-on-Kubernetes platform used for secure data masking across ING.
Skills & Requirements
Must-have
Apache Spark environment configuration
Kubernetes container orchestration
Docker image lifecycle management
RHEL operating system experience
CI/CD pipeline automation
Prometheus and Grafana monitoring
Nice-to-have
Cloudera to YARN migration experience
S3 object storage knowledge
Azure DevOps pipeline expertise
English language proficiency
Willingness to travel occasionally
Key Requirements
Proven DevOps or Platform Engineering experience
Strong hands-on Apache Spark tuning skills
Solid Kubernetes and Docker platform knowledge
Experience with Python, Shell, or Ansible automation
Understanding of database systems and RBAC security