Software Engineering & Development, Off

State Street

Hangzhou, China
Apache spark and databricks expertise
Cloud-native enterprise scale data computing
Strong programming skills in java, python, scala, sql
The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies

Job Summary

  • The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies.
  • We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential.
  • As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Matching Summary

The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies.

Skills & Requirements

Must-have

  • Apache Spark and Databricks expertise
  • Cloud-native enterprise scale data computing
  • Strong programming skills in Java, Python, Scala, SQL
  • Distributed system concepts knowledge
  • Event-driven architecture and real-time data streaming
  • Application monitoring and observability practices
  • Batch and real-time data processing experience

Nice-to-have

  • Leadership and architectural direction
  • Analytical problem-solving skills
  • Collaborative with excellent communication
  • Creative and self-motivated problem solver
  • Experience with CICD and DevOps
  • Hands-on MATLAB and MCR experience
  • System and application performance optimization

Key Requirements

  • BS/MS in Computer Science or equivalent
  • 3+ years software engineering experience
  • Strong programming skills in Java, Python, Scala, SQL, UNIX, Shell scripting
  • Deep understanding of distributed systems
  • Knowledge of cloud-native design patterns
  • Experience with Kafka, AWS SQS, Kinesis
  • Understanding of data security principles

Work Rights

Not specified

Tailored Resume

Cover Letter