Lauer Kim Laboratory is seeking a Senior Data Engineer to design and implement efficient data ingestion pipelines and frameworks while ensuring data quality across various formats. The ideal candidate should have extensive experience with technologies such as PySpark, Snowflake, and cloud platforms like AWS, alongside strong communication skills
Job Summary
Designing and implementing highly performant data ingestion pipelines from multiple sources.
Developing scalable and re-usable frameworks for ingesting of data sets and integrating end-to-end data pipelines.
Working with event based / streaming technologies to ingest and process data, ensuring quality and consistency.
Matching Summary
Match Score: 85
Lauer Kim Laboratory is seeking a Senior Data Engineer to design and implement efficient data ingestion pipelines and frameworks while ensuring data quality across various formats. The ideal candidate should have extensive experience with technologies such as PySpark, Snowflake, and cloud platforms like AWS, alongside strong communication skills.
Skills & Requirements
Must-have
PySpark, Python, Spark, Scala experience
Snowflake / Databricks Cloud Data warehouse
ETL data from multiple sources
event based / streaming technologies
modern schedulers (Airflow, Matillion)
AWS cloud technologies (EC2, S3, Lambda)
Nice-to-have
business intelligence and reporting
modern visualization solutions
CI/CD domain experience
strong communication and collaboration skills
Key Requirements
At least 3 years of Hands-on experience
At least 3 years of Snowflake /Databricks Cloud Data warehouse Implementation experience