Ai Systems & Data Engineer

HyperFi AI Inc

San Francisco, CA, United States
On-site
Databricks pipelines in python
Pyspark for data processing
Langchain agent development
We’re building a fast, flexible, and complex platform with a robust, event-driven architecture that connects systems and enables smart automation

Job Summary

  • We’re building a fast, flexible, and complex platform with a robust, event-driven architecture that connects systems and enables smart automation.
  • Engineers are respected with autonomy, fixed cycles to protect focus, and a culture that values shipping daily and solving real problems.
  • This full-time role offers competitive compensation, flexible hours, and an engineering-led, async-friendly environment with locations in San Francisco, Las Vegas, or Tel Aviv.

Matching Summary

We’re building a fast, flexible, and complex platform with a robust, event-driven architecture that connects systems and enables smart automation.

Skills & Requirements

Must-have

  • Databricks pipelines in Python
  • PySpark for data processing
  • LangChain agent development
  • Delta Lake and Unity Catalog
  • Data pipeline orchestration with Temporal
  • Data quality and lineage enforcement
  • AI systems integration

Nice-to-have

  • Experience with semantic chunking
  • Vector search or hybrid retrieval strategies
  • Open source software contributions
  • Engineering-led async-friendly culture
  • Prototype to production iteration
  • Data lakehouse architecture familiarity
  • Collaborative and high-trust environment

Key Requirements

  • 5-7 years building production ML or AI systems
  • Strong prompt engineering and retrieval design skills
  • Experience with Databricks Data Intelligence Platform
  • Knowledge of Databricks AI Security Framework
  • Confident English communication skills
  • Familiarity with Unity Catalog governance

Work Rights

Must be based in San Francisco, Las Vegas, or Tel Aviv

Tailored Resume

Cover Letter