Llm Pre-training & Distributed Engineer (ai Infrastructure)

Hyphen Connect

China
On-site
Deep expertise in 3d parallelism strategies
Experience managing slurm or kubernetes clusters
Strong systems engineering background with c++
Hyphen Connect is seeking a highly skilled LLM Pre-training & Distributed Systems Engineer to lead large-scale machine learning training and optimize distributed infrastructure. The ideal candidate will possess deep expertise in GPU clusters and a strong systems engineering background

Job Summary

  • This role is essential for orchestrating large-scale machine learning training runs across extensive GPU clusters.
  • The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering.
  • Responsibilities include optimizing networking and memory management to prevent out-of-memory errors during month-long training runs.

Matching Summary

Match Score: 85

Hyphen Connect is seeking a highly skilled LLM Pre-training & Distributed Systems Engineer to lead large-scale machine learning training and optimize distributed infrastructure. The ideal candidate will possess deep expertise in GPU clusters and a strong systems engineering background.

Skills & Requirements

Must-have

  • Deep expertise in 3D parallelism strategies
  • Experience managing SLURM or Kubernetes clusters
  • Strong systems engineering background with C++
  • Proficiency in CUDA and Python programming
  • Optimization of InfiniBand and RDMA networking

Nice-to-have

  • Experience with PyTorch DeepSpeed or Megatron-LM
  • Ability to automate checkpointing processes
  • Knowledge of failure recovery mechanisms

Key Requirements

  • Deep expertise in Data, Tensor, and Pipeline parallelism
  • Experience managing SLURM or Kubernetes-based GPU clusters
  • Strong systems engineering background including C++, CUDA, and Python

Work Rights

Not specified

Tailored Resume

Cover Letter