Base: $85,000; bonus/equity: not specified; benefi...
Master's degree in computer science or related field
2+ years experience as data engineer or software developer
1+ years leading a team of data engineers
The Data Engineer III will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making
Job Summary
The Data Engineer III will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
This role involves designing scalable microservices and managing infrastructure across Kubernetes clusters to process over 10 million data points daily.
The position offers the opportunity to contribute to cutting-edge research in social computing at the COSMOS Research Center while collaborating with partner organizations.
Matching Summary
The Data Engineer III will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
Salary
Base: $85,000; Bonus/Equity: Not specified; Benefits: Eligible
Skills & Requirements
Must-have
Master's degree in Computer Science or related field
2+ years experience as data engineer or software developer
1+ years leading a team of data engineers
Advanced proficiency in Python and Golang
Experience with Kafka, MongoDB, and Kubernetes
Expertise in designing ETL pipelines processing 10M+ daily points
Proficiency in microservices architecture using FlaskAPI and GraphQL
Nice-to-have
Front-end development skills with HTML/CSS/JavaScript
Experience training and deploying machine learning models
Knowledge of CI/CD pipelines with Jenkins and GitLab
Familiarity with monitoring tools like Prometheus and Grafana
Ability to collaborate with researchers on social computing projects
Key Requirements
Master's degree required
2+ years data engineering experience
1+ years team leadership experience
Proof of legal authority to work in US
Work Rights
Must have proof of legal authority to work in the United States