The role will play a critical role in ensuring the reliability, scalability, and compliance of data pipelines that support surveillance systems across communications and trading activities
Job Summary
The role will play a critical role in ensuring the reliability, scalability, and compliance of data pipelines that support surveillance systems across communications and trading activities.
Design, build, maintain and optimise end-to-end data pipelines and workflows between the source data points and target destinations, working with the wider Surveillance Technology team to prioritise automation, scalability and strategy at the heart of the design.
Partnering with the Data Strategy and Data Infrastructure team to ensure Data Lineage, auditability and retention policies are enforced across all necessary pipelines.
Matching Summary
The role will play a critical role in ensuring the reliability, scalability, and compliance of data pipelines that support surveillance systems across communications and trading activities.
Skills & Requirements
Must-have
ETL/ELT data pipeline builds
Automated data completeness checks
AWS infrastructure using Terraform
Python or Java, SQL proficiency
Data pipeline frameworks (Airflow, dbt, Spark)
AWS ecosystem experience
Nice-to-have
Market data ingestion experience
Event-driven architectures knowledge
Streaming technologies (Kafka, Kinesis)
Monitoring tools (Grafana) experience
Financial markets and trading platforms
Key Requirements
Bachelor’s degree in Computer Science, Data Science, Engineering, or related field
Previous experience in Data Ops and Data Engineering