Ai Specialist (ai Engineering)

Hyphen Connect

China, China
On-site
Large language and vision models
Model distillation and pruning techniques
4-bit/8-bit quantization expertise
Hyphen Connect is seeking an AI Specialist Engineer to enhance the performance of language and vision models for on-device inference. The ideal candidate will have expertise in model optimization techniques and experience with deployment across various hardware architectures

Job Summary

  • The role focuses on enhancing the performance of large language and vision models specifically for on-device inference.
  • Candidates will develop pipelines for model distillation and handle hardware-specific compilation tasks.
  • Performance benchmarking across various NPU and GPU architectures is a core responsibility of this position.

Matching Summary

Match Score: 85

Hyphen Connect is seeking an AI Specialist Engineer to enhance the performance of language and vision models for on-device inference. The ideal candidate will have expertise in model optimization techniques and experience with deployment across various hardware architectures.

Skills & Requirements

Must-have

  • Large language and vision models
  • Model distillation and pruning techniques
  • 4-bit/8-bit quantization expertise
  • TensorRT and ONNX Runtime experience
  • NPU/GPU architecture benchmarking

Nice-to-have

  • Edge deployment proficiency
  • Hardware-specific compilation skills
  • Diverse hardware architecture knowledge

Key Requirements

  • Strong C++ and Python programming skills
  • Hands-on experience with edge deployment tools
  • Expertise in model compression techniques

Work Rights

Not specified

Tailored Resume

Cover Letter