Senior Data Engineer

42dot

Pangyo, South Korea
Remote
8+ years software development experience
3+ years data engineering experience
Daily processing of 100 million+ records
42dot is seeking a Senior Data Engineer to design and operate large-scale data pipelines, optimizing data architecture for mobility AI solutions. The ideal candidate should have extensive experience in data engineering, particularly with large datasets and cloud infrastructure, and be proficient in Python or JVM languages

Job Summary

  • The role involves designing and operating large-scale vehicle data collection and processing pipelines to derive insights for user experience improvement.
  • Candidates must lead technical decision-making within the team and mentor junior engineers while collaborating with various organizations.
  • The position requires extensive experience in both batch and streaming data architecture design with a focus on performance optimization.

Matching Summary

Match Score: 85

42dot is seeking a Senior Data Engineer to design and operate large-scale data pipelines, optimizing data architecture for mobility AI solutions. The ideal candidate should have extensive experience in data engineering, particularly with large datasets and cloud infrastructure, and be proficient in Python or JVM languages.

Skills & Requirements

Must-have

  • 8+ years software development experience
  • 3+ years data engineering experience
  • Daily processing of 100 million+ records
  • Python or JVM language pipeline development
  • SQL data modeling and analysis
  • Cloud or on-prem infrastructure management

Nice-to-have

  • Databricks and Apache Spark performance tuning
  • Kafka real-time pipeline implementation
  • ClickHouse OLAP database operations
  • Grafana LGTM observability stack usage
  • Kubernetes service deployment experience
  • Airflow workflow orchestration
  • AI coding agent productivity tools

Key Requirements

  • Minimum 8 years total software development career
  • Minimum 3 years specific data engineering background
  • Experience handling daily data volumes exceeding 100 million records

Work Rights

Not specified

Tailored Resume

Cover Letter