Backend Engineer, Data Pipeline Group - Data Platform Department (dpd)

rakuten-insurance.co.jp

Java/golang software development
Web development process understanding
Microservice architecture (spring boot/cloud)
The Data Platform Department (DPD) develops and maintains a comprehensive data platform supporting over 70 Rakuten services for data ingestion, discovery, governance, analytics, and querying

Job Summary

  • The Data Platform Department (DPD) develops and maintains a comprehensive data platform supporting over 70 Rakuten services for data ingestion, discovery, governance, analytics, and querying.
  • Backend engineers will design and implement application architecture for data processing applications, integrating On-Premise/On-Cloud computing resources and application frameworks.
  • This role offers opportunities to use cutting-edge technology, choose optimal platform solutions based on design thinking, and work with multi-location, quick-moving teams.

Matching Summary

The Data Platform Department (DPD) develops and maintains a comprehensive data platform supporting over 70 Rakuten services for data ingestion, discovery, governance, analytics, and querying.

Skills & Requirements

Must-have

  • Java/Golang software development
  • Web development process understanding
  • Microservice architecture (Spring Boot/Cloud)
  • RESTful design and testing
  • SQL and relational databases
  • CI/CD tools (Jenkins/Github actions/ArgoCD)
  • Kubernetes and public cloud

Nice-to-have

  • Python tool building
  • Airflow and DAGs
  • ETL/ELT pipeline design
  • Large-scale data processing
  • Data Governance and Security
  • Message queue experience (Kafka/RabbitMQ)
  • Service mesh architecture (Istio)

Key Requirements

  • 5+ years of software development experience
  • Experience designing and building tools
  • Experience with performance optimization
  • Team-oriented work environment

Work Rights

Not specified

Tailored Resume

Cover Letter