Multimodal Ai Systems Architect (ai Engineering)

Hyphen Partners

Boston, United States
On-site
Integrate vision encoders and audio-native models
Optimize streaming latency for voice interactions
Architect multimodal rag systems
The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions

Job Summary

  • The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.
  • Candidates will be responsible for architecting multimodal RAG systems capable of retrieving insights from videos and PDFs.
  • This position requires expertise in optimizing streaming latency to ensure efficient and innovative AI performance.

Matching Summary

The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.

Skills & Requirements

Must-have

  • Integrate vision encoders and audio-native models
  • Optimize streaming latency for voice interactions
  • Architect multimodal RAG systems
  • Experience with Whisper and CLIP models
  • Knowledge of WebRTC streaming architectures

Nice-to-have

  • Expertise in cross-modal alignment techniques
  • Innovative system design capabilities
  • Efficient AI model optimization skills

Key Requirements

  • Experience with multimodal LLM integration
  • Knowledge of streaming architectures
  • Expertise in cross-modal alignment

Work Rights

Not specified

Tailored Resume

Cover Letter