Senior Software Engineer (ML), Data Plane

Amazon

Tel Aviv, Israel
On-site
Custom ml accelerator architecture
High-performance compute kernels
Llm architecture validation
Amazon is seeking a Senior Software Development Engineer for its MLIL DataPlane team in Tel Aviv, Israel. The role focuses on designing and implementing software for efficient model inference on custom hardware, requiring deep expertise in low-level coding and ML architectures

Job Summary

  • The role involves owning the design and implementation of an inference data plane to run large models efficiently on custom hardware.
  • Candidates will develop and optimize compute kernels targeting production-level performance for large language model inference.
  • The team operates at frontier scale with rapidly evolving hardware and software, requiring end-to-end ownership from design through production.

Matching Summary

Match Score: 85

Amazon is seeking a Senior Software Development Engineer for its MLIL DataPlane team in Tel Aviv, Israel. The role focuses on designing and implementing software for efficient model inference on custom hardware, requiring deep expertise in low-level coding and ML architectures.

Skills & Requirements

Must-have

  • Custom ML accelerator architecture
  • High-performance compute kernels
  • LLM architecture validation
  • PyTorch and vLLM integration
  • Distributed execution systems
  • Low-level code optimization

Nice-to-have

  • Mentoring junior engineers
  • CI/CD pipeline design
  • Model parallelism expertise
  • Frontier scale distributed systems

Key Requirements

  • Senior level experience
  • Low-level coding proficiency
  • Hardware bringup experience

Work Rights

Not specified

Tailored Resume

Cover Letter