Principal Data Engineer - Gcp

Capco

London, United Kingdom
On-site
Google cloud platform (gcp)
Bigquery, dataflow, dataproc
Python, sql, pyspark
Design and build resilient, scalable data pipelines using GCP services such as BigQuery, Dataflow, and Dataproc

Job Summary

  • Design and build resilient, scalable data pipelines using GCP services such as BigQuery, Dataflow, and Dataproc.
  • Collaborate closely with clients to define business requirements and architect fit-for-purpose data solutions.
  • Support and mentor junior engineers, contributing to knowledge sharing across the team.

Matching Summary

Design and build resilient, scalable data pipelines using GCP services such as BigQuery, Dataflow, and Dataproc.

Skills & Requirements

Must-have

  • Google Cloud Platform (GCP)
  • BigQuery, Dataflow, Dataproc
  • Python, SQL, PySpark
  • CI/CD, testing, version control
  • Agile environments

Nice-to-have

  • real-time streaming tools
  • MLOps practices
  • data visualisation tools
  • VertixAI development
  • SQL and NoSQL solutions

Key Requirements

  • Hands-on experience with GCP
  • Proven ability in Python, SQL, and PySpark
  • Knowledge of DevOps principles
  • Track record of delivering data engineering solutions
  • Confident communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter