Senior Staff Ai Data Infrastructure/pipeline Engineer

XPENG Inc

Santa Clara, CA, United States
**
5-8+ years large-scale data processing experience
Proficiency in python go or java programming
Experience with distributed message queues like kafka
** XPENG Inc is seeking a Senior Staff AI Data Infrastructure/Pipeline Engineer to build and optimize data pipelines crucial for autonomous driving technologies. The role requires substantial experience in data processing and strong programming skills, focusing on creating efficient, reliable data systems. **

Job Summary

  • The role involves building a reliable, observable, and cost-effective data pipeline to support the daily flow of petabyte-scale sensor data for autonomous driving.
  • Key responsibilities include designing core data closed loop pipelines and developing toolchains for data cleaning and annotation quality inspection.
  • Candidates must have hands-on project experience in at least two areas including ETL systems, stream processing, or distributed data lake systems.

Matching Summary

Match Score: 75

** XPENG Inc is seeking a Senior Staff AI Data Infrastructure/Pipeline Engineer to build and optimize data pipelines crucial for autonomous driving technologies. The role requires substantial experience in data processing and strong programming skills, focusing on creating efficient, reliable data systems. **

Skills & Requirements

Must-have

  • 5-8+ years large-scale data processing experience
  • Proficiency in Python Go or Java programming
  • Experience with distributed message queues like Kafka
  • Hands-on experience with Apache Iceberg data lake systems
  • Optimization of large-scale distributed systems performance

Nice-to-have

  • Strong cross-team communication and collaboration skills
  • Experience with Kubernetes Docker containerization deployment
  • Proactive problem-solving attitude and high responsibility
  • Familiarity with columnar storage formats like Lance

Key Requirements

  • Bachelor's degree in Computer Science or related field
  • 5-8+ years of experience in data platform development
  • Experience with MySQL PostgreSQL Redis MongoDB databases

Work Rights

Not specified

Tailored Resume

Cover Letter