Data Engineer (gen Ai)

Interactive Brokers Group, Inc.

New York, NY, United States
Base: $150,000 to $200,000 py; bonus/equity: discr...
On-site
6+ years data engineering experience
Aws cloud services s3 glue athena emr
Python programming for etl and applications
This role involves designing and building scalable data pipelines and AI-enabled workflows to support enterprise-wide initiatives

Job Summary

  • This role involves designing and building scalable data pipelines and AI-enabled workflows to support enterprise-wide initiatives.
  • The company offers a competitive salary range of $150,000 to $200,000 per year along with stock grants and performance bonuses.
  • Employees enjoy hybrid work arrangements requiring three days in the office and two days remote, plus comprehensive health and wellness benefits.

Matching Summary

This role involves designing and building scalable data pipelines and AI-enabled workflows to support enterprise-wide initiatives.

Salary

Base: $150,000 to $200,000 per year; Bonus/Equity: Discretionary cash bonus and stock award; Benefits: Competitive 401(k) match, healthcare, tuition reimbursement

Skills & Requirements

Must-have

  • 6+ years data engineering experience
  • AWS cloud services S3 Glue Athena EMR
  • Python programming for ETL and applications
  • PySpark on EMR for large-scale processing
  • Kafka for real-time streaming pipelines
  • Iceberg table formats and data lake architecture
  • CI/CD practices with Git Docker and containers

Nice-to-have

  • Experience with Gen AI RAG workflows
  • Knowledge of unstructured data processing
  • Strong collaboration and communication skills
  • Self-motivated ability to work independently
  • Willingness to learn emerging AI technologies

Key Requirements

  • 6+ years hands-on data engineering experience
  • Proficiency in Python and PySpark
  • Strong SQL skills for data analysis
  • Experience with AWS cloud infrastructure
  • Knowledge of Kafka and streaming data

Work Rights

Not specified

Tailored Resume

Cover Letter