Base: $95,000; bonus/equity: not specified; benefi...
Master's degree in computer science or related field
4+ years experience as data engineer or software developer
2+ years leading a team of data engineers
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making
Job Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
This role involves designing and managing scalable data ETL pipelines that process over 10 million data points daily using Kafka and MongoDB across Kubernetes clusters.
The position offers the opportunity to contribute to cutting-edge research in social computing at the COSMOS Research Center while collaborating with researchers and developers.
Matching Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
Salary
Base: $95,000; Bonus/Equity: Not specified; Benefits: Eligible
Skills & Requirements
Must-have
Master's degree in Computer Science or related field
4+ years experience as data engineer or software developer
2+ years leading a team of data engineers
Expert proficiency in Python, Golang, Kafka, and MongoDB
Experience designing ETL pipelines processing 10M+ daily data points
Proficiency with Kubernetes, Docker, FlaskAPI, and GraphQL
Expertise in Elasticsearch, Prometheus, Grafana, and Kibana
Nice-to-have
Front-end development skills with HTML/CSS/JavaScript
Experience training and deploying machine learning models
Knowledge of Spring Boot and React frameworks
Ability to collaborate with researchers on social computing projects
Familiarity with CI/CD pipelines using Jenkins and GitLab CI
Key Requirements
Master's degree in Computer Science, Information Science, or related discipline
PhD degree in Computer Science, Information Science, or related discipline
4+ years of experience in data engineering or software development roles
2+ years of experience leading a team of data engineers
Proof of legal authority to work in the United States
Work Rights
Must have proof of legal authority to work in the United States