Senior Software Development Engineer - Big Data And Spark

Adobe Media and Data Science Research (MDSR) Laboratory

Apache spark expertise
Scala/java or python programming
High-scale data processing solutions
This role involves developing modern data architectures and Big Data Lakehouse solutions to power the Adobe Experience Platform

Job Summary

  • This role involves developing modern data architectures and Big Data Lakehouse solutions to power the Adobe Experience Platform.
  • The team handles petabytes of data with high fidelity and velocity to enable real-time personalized customer experiences.
  • Candidates must possess strong communication skills and be able to work efficiently across various time zones.

Matching Summary

This role involves developing modern data architectures and Big Data Lakehouse solutions to power the Adobe Experience Platform.

Skills & Requirements

Must-have

  • Apache Spark expertise
  • Scala/Java or Python programming
  • High-scale data processing solutions
  • Performance optimization and cluster tuning
  • Observability best practices implementation
  • BS/MS in Computer Science degree

Nice-to-have

  • Iceberg/DeltaLake table formats
  • Kafka and Databricks experience
  • Kubernetes and container deployments
  • Open Source project contributions
  • AI coding agent proficiency
  • Multi-cloud technology knowledge

Key Requirements

  • 4+ years software development and technical operations experience
  • Validated ability to research new emergent technologies
  • Excellent verbal and written English language skills
  • MUST possess a BS/MS in Computer Science or equivalent

Work Rights

Not specified

Tailored Resume

Cover Letter