Multimodal Ai Systems Architect (ai Engineering)

Hyphen Partners

Seattle, United States
On-site
Integrate vision encoders and audio-native models
Optimize streaming latency for voice interactions
Architect multimodal rag systems for video and pdfs
The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions

Job Summary

  • The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.
  • Candidates will be responsible for architecting multimodal RAG systems capable of retrieving insights from videos and PDFs.
  • This position requires expertise in optimizing streaming latency to ensure efficient and innovative AI performance.

Matching Summary

The role focuses on developing AI systems that seamlessly integrate vision and audio models to enhance voice-to-voice interactions.

Skills & Requirements

Must-have

  • Integrate vision encoders and audio-native models
  • Optimize streaming latency for voice interactions
  • Architect multimodal RAG systems for video and PDFs
  • Experience with Whisper, CLIP, and multimodal LLMs
  • Knowledge of streaming architectures and WebRTC

Nice-to-have

  • Expertise in cross-modal alignment techniques
  • Innovative system design capabilities
  • Efficient AI architecture optimization skills

Key Requirements

  • Experience with Whisper, CLIP, and multimodal LLM integration
  • Knowledge of streaming architectures and WebRTC
  • Expertise in cross-modal alignment

Work Rights

Not specified

Tailored Resume

Cover Letter