Software Engineering & Development, Off

State Street UK

Hangzhou, China
Apache spark
Databricks
Big data technologies
The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies

Job Summary

  • The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies.
  • Provide architectural direction across development teams and lead technical design reviews.
  • As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most.

Matching Summary

The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies.

Skills & Requirements

Must-have

  • Apache Spark
  • Databricks
  • big data technologies
  • distributed computing technologies
  • cloud native enterprise scale data computing solutions
  • event-driven architecture
  • real-time data streaming

Nice-to-have

  • AI and machine learning tools
  • emerging tools evaluation
  • creative problem solver
  • collaborative
  • excellent communication skills

Key Requirements

  • 3+ years of software engineering experience
  • BS/MS in Computer Science or equivalent field
  • Strong programming skills in Java, Python, Scala, SQL, UNIX and Shell scripting
  • Deep understanding of distributed system concepts
  • Deep understanding of cloud-native and system integration design patterns
  • Strong understanding of data security principles
  • Strong understanding of application monitoring, observability, and alerting practices
  • Strong experience with batch and real-time data processing
  • Strong experience with OLAP and OLTP Databases
  • Hands-on experience with system and application performance optimization
  • Hands-on experience with CICD and Dev. Ops.

Work Rights

Not specified

Tailored Resume

Cover Letter