Data Platform Engineer Category Computer/software Location Toronto, Ontario Job Type Full Time
hireVouch
Toronto, Ontario, Canada
On-site
Designing and optimizing data platforms
Petabyte scale data storage
Java and python development
Design and optimize the data platform that powers our API, managing everything from data streaming and storage to analytics features at petabyte scale
Job Summary
Design and optimize the data platform that powers our API, managing everything from data streaming and storage to analytics features at petabyte scale.
Own projects aimed at enhancing data replication, storage, enrichment, and reporting capabilities, and build and optimize efficient streaming and batch data pipelines.
Shape architectural decisions to ensure scalability and reliability throughout the data platform, and implement distributed tracing, data lineage and observability patterns.
Matching Summary
Design and optimize the data platform that powers our API, managing everything from data streaming and storage to analytics features at petabyte scale.
Skills & Requirements
Must-have
designing and optimizing data platforms
petabyte scale data storage
Java and Python development
Iceberg, Flink, and Kafka
streaming and batch data pipelines
distributed tracing and data lineage
Nice-to-have
workflow engines
serverless architectures
event-driven architectures
Javascript/Typescript
Key Requirements
3+ years of experience in platform or data engineering
2+ years designing and optimizing data pipelines at TB to PB scale