Ind - Staff Engineer, Data

The Hartford

Apache kafka or aws kinesis
Snowflake data platform expertise
Python and spark programming
Lead the design and maintenance of scalable real-time data streaming pipelines using technologies like Apache Kafka and AWS Kinesis

Job Summary

  • Lead the design and maintenance of scalable real-time data streaming pipelines using technologies like Apache Kafka and AWS Kinesis.
  • Implement Retrieval-Augmented Generation (RAG) architectures and integrate them with enterprise data infrastructure to support AI solutions.
  • Collaborate with cross-functional teams to develop data domains and products that enable reporting, data science, and analytics capabilities.

Matching Summary

Lead the design and maintenance of scalable real-time data streaming pipelines using technologies like Apache Kafka and AWS Kinesis.

Skills & Requirements

Must-have

  • Apache Kafka or AWS Kinesis
  • Snowflake data platform expertise
  • Python and Spark programming
  • RAG pipeline implementation
  • Graph database development (Neo4j)
  • AWS cloud infrastructure mastery
  • Generative AI solution design

Nice-to-have

  • Mentoring junior engineering teams
  • AI-driven auto-generation of pipelines
  • Semantic layer architecture design
  • Synthetic data workflow validation
  • Agentic solution integration
  • Knowledge graph relationship modeling
  • Advanced DevOps self-healing practices

Key Requirements

  • Bachelor's or Master's degree in Computer Science or related field
  • 6+ years of data engineering experience
  • 3+ years of hands-on Snowflake experience
  • 1+ year of Generative AI engineering experience
  • Strong Python programming and deep learning framework skills

Work Rights

Not specified

Tailored Resume

Cover Letter