Big Data Engineer

Canadian Derivatives Clearing Corporation

Base: 100,000 - 120,000 cadpyear; bonus/equity: no...
Hybrid
5-8 years it experience
4+ years big data technologies
Strong aws cloud knowledge
The role involves designing and maintaining robust data pipeline architecture while managing a wide range of AWS services including S3, EMR, and Managed Airflow

Job Summary

  • The role involves designing and maintaining robust data pipeline architecture while managing a wide range of AWS services including S3, EMR, and Managed Airflow.
  • Candidates must possess strong analytical skills to optimize data delivery and re-design infrastructure for enhanced scalability and performance across multiple teams.
  • TMX offers a hybrid workstyle with generous time-off, wellness support, and the opportunity to power mission-critical systems driving global economic advancement.

Matching Summary

The role involves designing and maintaining robust data pipeline architecture while managing a wide range of AWS services including S3, EMR, and Managed Airflow.

Salary

Base: 100,000 - 120,000 CAD/year; Bonus/Equity: Not specified; Benefits: Hybrid workstyle, generous time-off, wellness programs

Skills & Requirements

Must-have

  • 5-8 years IT experience
  • 4+ years Big Data technologies
  • Strong AWS cloud knowledge
  • Python Scala Java programming
  • Spark Hive Presto expertise
  • Snowflake experience required
  • Agile methodology development

Nice-to-have

  • Equity Markets business knowledge
  • Terraform Ansible experience
  • Kafka streaming experience
  • Machine learning stack design
  • Strategic thinking ability
  • Mentoring junior staff skills

Key Requirements

  • University degree in Computer Science or related field
  • 5-8 years overall IT experience
  • 4+ years in Big Data technologies
  • Experience with Spark, Hive, and Presto
  • Strong knowledge of Snowflake
  • Proficiency in Python, Scala, Shell scripting, and Java
  • Authorized to work in Canada without sponsorship

Work Rights

Must be authorized to work in Canada

Tailored Resume

Cover Letter