Multimodal Ai Systems Architect (ai Engineering)

Hyphen Connect

Boston, United States
On-site
Integrate vision encoders and audio-native models
Optimize streaming latency for voice interactions
Architect multimodal rag systems
The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions

Job Summary

  • The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.
  • Candidates will be responsible for architecting multimodal RAG systems capable of retrieving insights from videos and PDFs.
  • This position requires optimizing streaming latency to ensure efficient and innovative AI performance.

Matching Summary

The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.

Skills & Requirements

Must-have

  • Integrate vision encoders and audio-native models
  • Optimize streaming latency for voice interactions
  • Architect multimodal RAG systems
  • Experience with Whisper and CLIP models
  • Knowledge of WebRTC streaming architectures

Nice-to-have

  • Expertise in cross-modal alignment techniques
  • Multimodal LLM integration experience
  • Innovative system design capabilities

Key Requirements

  • Experience with Whisper, CLIP, and multimodal LLM integration
  • Knowledge of streaming architectures and WebRTC
  • Expertise in cross-modal alignment

Work Rights

Not specified

Tailored Resume

Cover Letter