Strong passion for computer science and data engineering
Proven expertise in spark and delta lake technologies
Solid programming skills in scala and/or java
This role involves developing modern data architectures and Big Data Lakehouse solutions to drive real-time customer intelligence
Job Summary
This role involves developing modern data architectures and Big Data Lakehouse solutions to drive real-time customer intelligence.
The team is responsible for building the Adobe Experience Platform, handling petabytes of data with high fidelity and velocity.
Candidates are expected to contribute to architecture design, code reviews, and potentially participate in on-call rotations following a Sun rotation schedule.
Matching Summary
This role involves developing modern data architectures and Big Data Lakehouse solutions to drive real-time customer intelligence.
Salary
Not specified; Not specified; Not specified
Skills & Requirements
Must-have
Strong passion for computer science and data engineering
Proven expertise in Spark and Delta Lake technologies
Solid programming skills in Scala and/or Java
Experience with performance optimization and cluster tuning
Validated ability to research emergent technologies
Implementing observability best practices across distributed systems
Nice-to-have
Experience with Hadoop, HBase, MapReduce, Iceberg, or Kafka
Experience with Databricks platform
Working knowledge of cloud providers and Kubernetes
VM/Bare metal deployment experience
Commitment to contributing to Open Source projects
Ability to leverage AI coding agents for productivity
Key Requirements
High-scale data processing solutions in production environment
Advanced understanding of table formats and schema evolution
Robust pipeline engineering capabilities
Problem-solving mindset for complex data challenges
Very good written and verbal English communication skills