Senior Software Engineer, Data Backend(data Platform)

Appier

Taipei, Taiwan
On-site
Large-scale distributed systems
Production data pipelines
Spark clusters and kafka clusters
Design, develop, and maintain production data pipelines processing hundreds of terabytes of data daily across distributed systems

Job Summary

  • Design, develop, and maintain production data pipelines processing hundreds of terabytes of data daily across distributed systems.
  • Build, manage, and optimize large-scale data platforms including Spark clusters, Kafka clusters, and related big data infrastructure.
  • Establish architectural foundations and engineering best practices for the platform.

Matching Summary

Design, develop, and maintain production data pipelines processing hundreds of terabytes of data daily across distributed systems.

Skills & Requirements

Must-have

  • large-scale distributed systems
  • production data pipelines
  • Spark clusters and Kafka clusters
  • data warehouse systems and ETL pipelines
  • public cloud platforms (AWS, GCP, or Azure)

Nice-to-have

  • JVM performance optimization
  • modern open table formats
  • active contributions to open source

Key Requirements

  • 2+ years of hands-on experience
  • BS/MS degree in Computer Science
  • Proficiency in Java and/or Scala
  • Experience building ETL pipelines with Apache Spark
  • Experience managing data lakes or data warehouses
  • Experience with public cloud platforms

Work Rights

Not specified

Tailored Resume

Cover Letter