Data ingestion, transformation, and storage processes
You will be responsible for designing the overall architecture of our data systems, ensuring they are robust, scalable, and efficient
Job Summary
You will be responsible for designing the overall architecture of our data systems, ensuring they are robust, scalable, and efficient.
Lead the development of scalable API solutions to facilitate Data as a Service (DaaS), providing seamless access to data for both external and internal customers.
Provide technical leadership, mentorship, and guidance to engineering teams, fostering a collaborative and innovative culture within the international group.
Matching Summary
You will be responsible for designing the overall architecture of our data systems, ensuring they are robust, scalable, and efficient.
Skills & Requirements
Must-have
Cloudera, Spark, and other relevant technologies
Data as a Service (DaaS) API solutions
data ingestion, transformation, and storage processes
Spark Streaming, Spark SQL, or other Spark modules
distributed computing principles and frameworks
Cloudera distribution and tools
Scala, Python, or Java programming languages
Nice-to-have
Cloud platforms like AWS or Azure
containerization technologies like Docker or Kubernetes
agile development practices
technical leadership and mentorship
Key Requirements
7 years of working experience in big data architecture
Bachelor’s or Master’s degree in Computer Science, Data Science, or related field
Strong understanding of API architectures and best practices
In-depth knowledge of distributed computing principles and frameworks
Extensive experience with Cloudera distribution and tools
Proven expertise in designing, implementing, and optimizing data pipelines using Spark