Multimodal Ai Systems Architect (ai Engineering)

Hyphen Partners

Australia, Australia
On-site
Integrate vision encoders and audio-native models
Optimize streaming latency for voice interactions
Architect multimodal rag systems
Hyphen Partners is looking for a Multimodal AI Systems Architect to enhance AI systems by integrating vision and audio models, particularly focusing on voice-to-voice interactions and multimodal retrieval. The ideal candidate will possess experience with specific AI technologies and frameworks, as well as knowledge of streaming architectures

Job Summary

  • The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.
  • Candidates will be responsible for architecting multimodal RAG systems capable of retrieving insights from videos and PDFs.
  • This position requires optimizing streaming latency to ensure efficient and innovative AI performance.

Matching Summary

Match Score: 85

Hyphen Partners is looking for a Multimodal AI Systems Architect to enhance AI systems by integrating vision and audio models, particularly focusing on voice-to-voice interactions and multimodal retrieval. The ideal candidate will possess experience with specific AI technologies and frameworks, as well as knowledge of streaming architectures.

Skills & Requirements

Must-have

  • Integrate vision encoders and audio-native models
  • Optimize streaming latency for voice interactions
  • Architect multimodal RAG systems
  • Experience with Whisper and CLIP models
  • Knowledge of WebRTC streaming architectures

Nice-to-have

  • Expertise in cross-modal alignment techniques
  • Innovative system design approach
  • Efficient multimodal LLM integration skills

Key Requirements

  • Experience with multimodal LLM integration
  • Knowledge of streaming architectures and WebRTC
  • Expertise in cross-modal alignment

Work Rights

Not specified

Tailored Resume

Cover Letter