Tech Lead - Data Engineeringpittsburgh, Pa

CGI

Pittsburgh, PA, United States
$70,800.00 - $156,700.00; not specified; not speci...
Onsite
Python and pyspark development
Kafka streaming platform
Elastic search (elk stack)
CGI is seeking a Tech Lead in Data Engineering for a role based in Pittsburgh, PA, focused on managing data engineering projects for a major financial institution. The ideal candidate will have extensive experience with Python, Spark, SQL, and the ELK stack, as well as strong leadership and communication skills

Job Summary

  • Work on projects for one of the largest financial institutions in the US, gaining exposure to advanced tools and technology suites.
  • Build and optimize Spark Streaming applications for real-time ingestion, transformation, and event-driven processing using Kafka or other messaging systems.
  • Collaborate with cross-functional teams to troubleshoot, monitor, and improve data pipelines in production environments while ensuring compliance with data security and governance.

Matching Summary

Match Score: 85

CGI is seeking a Tech Lead in Data Engineering for a role based in Pittsburgh, PA, focused on managing data engineering projects for a major financial institution. The ideal candidate will have extensive experience with Python, Spark, SQL, and the ELK stack, as well as strong leadership and communication skills.

Salary

$70,800.00 - $156,700.00; Not specified; Not specified

Skills & Requirements

Must-have

  • Python and PySpark development
  • Kafka Streaming Platform
  • Elastic Search (ELK Stack)
  • Spark Streaming applications
  • CI/CD workflows using Git, Jenkins, Bitbucket

Nice-to-have

  • Data Observability within streaming
  • containerization and orchestration
  • GenAI, Azure OpenAI, and GPT knowledge
  • BIAN standards knowledge

Key Requirements

  • 8+ yrs professional experience
  • 5+ yrs relational databases experience
  • 6+ yrs Python and PySpark experience
  • 3+ yrs Kafka Streaming Platform experience
  • 3+ yrs Elastic Search (ELK Stack) experience
  • Agile experience required

Work Rights

Not specified

Tailored Resume

Cover Letter