Data Engineer - Market Data Platform

Barclays

Prague, Czech Republic
Expert-level aws cloud services proficiency
Senior level python programming skills
Etl/elt frameworks and data transformation
The role focuses on building scalable pipelines for market data onboarding, cataloging, and governed distribution within the enterprise

Job Summary

  • The role focuses on building scalable pipelines for market data onboarding, cataloging, and governed distribution within the enterprise.
  • Candidates must possess expert-level proficiency in AWS services including S3, Glue, Athena, and Lake Formation to design cloud-native platforms.
  • This position requires collaboration with data scientists to deploy machine learning models while ensuring high-quality, compliant datasets.

Matching Summary

The role focuses on building scalable pipelines for market data onboarding, cataloging, and governed distribution within the enterprise.

Skills & Requirements

Must-have

  • Expert-level AWS cloud services proficiency
  • Senior level Python programming skills
  • ETL/ELT frameworks and data transformation
  • Snowflake data warehousing experience
  • Apache Iceberg open table formats

Nice-to-have

  • Apache Airflow workflow orchestration
  • IAM permissions management knowledge
  • Databricks or Starburst distributed processing
  • Collaboration with diverse internal teams
  • Data cataloguing and metadata practices

Key Requirements

  • Senior level Python programming expertise
  • Strong background in data architecture and pipelines
  • Experience with data quality tooling like Great Expectations

Work Rights

Not specified

Tailored Resume

Cover Letter