Data Engineer (gen Ai)

Interactive Brokers Group, Inc.

New York, NY, United States
Base: $150,000 to $200,000 py; bonus/equity: discr...
On-site
6+ years data engineering experience
Aws cloud services s3 glue athena emr lambda
Python programming for etl and applications
This role involves designing and maintaining scalable data pipelines and data lake platforms to support enterprise-wide AI initiatives

Job Summary

  • This role involves designing and maintaining scalable data pipelines and data lake platforms to support enterprise-wide AI initiatives.
  • The position requires proficiency in AWS cloud services including S3, AWS Glue, and Kafka for real-time streaming data processing.
  • Interactive Brokers offers a competitive salary range of $150,000 to $200,000 along with comprehensive benefits including stock grants and health coverage.

Matching Summary

This role involves designing and maintaining scalable data pipelines and data lake platforms to support enterprise-wide AI initiatives.

Salary

Base: $150,000 to $200,000 per year; Bonus/Equity: Discretionary cash bonus and stock award; Benefits: 401(k) match, healthcare, tuition reimbursement

Skills & Requirements

Must-have

  • 6+ years data engineering experience
  • AWS cloud services S3 Glue Athena EMR Lambda
  • Python programming for ETL and applications
  • PySpark on EMR for large-scale processing
  • Kafka for real-time streaming pipelines
  • Iceberg table formats and data lake architecture
  • CI/CD practices with Git Docker containerization

Nice-to-have

  • Experience with Gen AI RAG workflows
  • Knowledge of unstructured data processing
  • Strong collaboration and communication skills
  • Self-motivated ability to work independently
  • Enthusiasm for emerging data trends

Key Requirements

  • 6+ years hands-on data engineering experience
  • Proficiency in Python and PySpark
  • Strong SQL skills for data analysis
  • Experience with modern data stack technologies

Work Rights

Not specified

Tailored Resume

Cover Letter