Principal Aws Data Engineer

Capco

Edinburgh, United Kingdom
On-site
Aws-native tools
Modern data architectures
Python, scala or java
Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures

Job Summary

  • Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures.
  • Collaborate with clients to gather requirements, define solutions, and deliver production-grade systems.
  • Support and mentor junior engineers, contributing to knowledge sharing across the team.

Matching Summary

Design and build end-to-end data pipelines leveraging AWS-native tools and modern data architectures.

Skills & Requirements

Must-have

  • AWS-native tools
  • modern data architectures
  • Python, Scala or Java
  • Spark, Hadoop
  • real-time event streaming pipelines
  • AWS Well-Architected Principles
  • CI/CD practices
  • data governance including GDPR

Nice-to-have

  • Data Modelling, schema design
  • structured and semi-structured data
  • distributed systems
  • AWS Lake Formation
  • highly regulated industries

Key Requirements

  • Proficient in Python, Scala or Java
  • Experience in Big Data technologies
  • Practical knowledge of real-time event streaming
  • Proficiency in AWS cloud environments
  • Proven experience developing modern data architectures
  • Solid understanding of CI/CD practices
  • Solid understanding of data governance including GDPR

Work Rights

Not specified

Tailored Resume

Cover Letter