Da Lead Data Engineer

Lauer Kim Laboratory

Not specified
Pyspark, python, spark, scala
Snowflake / databricks cloud data warehouse
Etl from multiple data sources
The Lauer Kim Laboratory is seeking a Lead Data Engineer with extensive experience in data ingestion and processing, particularly using technologies such as PySpark, Snowflake, and cloud platforms like AWS. The ideal candidate will possess strong technical skills and a collaborative approach, ensuring high-quality data management while delivering innovative solutions

Job Summary

  • Designing and implementing highly performant data ingestion pipelines from multiple sources.
  • Developing scalable and re-usable frameworks for ingesting of data sets and integrating end-to-end data pipelines.
  • Working with event based / streaming technologies to ingest and process data, and evaluating tool performance against customer requirements.

Matching Summary

Match Score: 85

The Lauer Kim Laboratory is seeking a Lead Data Engineer with extensive experience in data ingestion and processing, particularly using technologies such as PySpark, Snowflake, and cloud platforms like AWS. The ideal candidate will possess strong technical skills and a collaborative approach, ensuring high-quality data management while delivering innovative solutions.

Skills & Requirements

Must-have

  • PySpark, Python, Spark, Scala
  • Snowflake / Databricks Cloud Data Warehouse
  • ETL from multiple data sources
  • event based / streaming technologies
  • modern schedulers (Airflow, Matillion)
  • AWS cloud technologies (EC2, S3, Lambda, SQS, SNS)
  • CI/CD domain (Jenkins, Terraform, Docker, Kubernetes)

Nice-to-have

  • business intelligence and reporting
  • modern visualization solutions
  • Pharma industry experience
  • strong communication and collaboration skills

Key Requirements

  • At least 5 years of Hands-on experience
  • At least 5 years of Snowflake /Databricks Cloud Data warehouse Implementation experience
  • Experience in CI/CD domain

Work Rights

Not specified

Tailored Resume

Cover Letter