Full-stack Data Engineering Specialist (hybrid)

Morgan Stanley

Montreal, Quebec, Canada
Hybrid
Apache spark
Azure databricks
Airflow
Build end-to-end systems from data sourcing to calculations to reporting using cutting-edge big data technologies

Job Summary

  • Build end-to-end systems from data sourcing to calculations to reporting using cutting-edge big data technologies.
  • The department delivers technology to report the firm’s balance sheet externally to multi-jurisdictional Regulators as well as internally to the firm’s controllers and business units.
  • This is a Software Engineering III position at Associate level, which is part of the job family responsible for developing and maintaining software solutions that support business needs.

Matching Summary

Build end-to-end systems from data sourcing to calculations to reporting using cutting-edge big data technologies.

Skills & Requirements

Must-have

  • Apache Spark
  • Azure Databricks
  • Airflow
  • Snowflake
  • Java/Scala
  • Python
  • SQL
  • Cloud Technologies (Azure, AWS, GCP)
  • DevOps automation
  • CI/CD pipelines

Nice-to-have

  • Machine learning experience
  • GenAI experience
  • Power BI reporting knowledge

Key Requirements

  • 4 to 8 years of experience
  • At least 5 years+ relevant experience in Java/Scala, Python and SQL
  • At least 3 years+ relevant experience in large-scale data processing engines like Apache Spark or cloud compute technologies like Azure Databricks
  • At least 3 years+ relevant experience in cloud technologies (Azure, AWS or GCP)
  • At least 3 years+ relevant experience in building data pipelines and in ETL/ELT development using Airflow
  • At least 4 years+ relevant experience in databases technologies: Snowflake, DB2 and Teradata
  • At least 5 years+ relevant experience in DevOps automation and CI/CD pipelines
  • Knowledge of French and English is required

Work Rights

Not specified

Tailored Resume

Cover Letter