Base: $95,000; bonus/equity: not specified; benefi...
Master's degree in computer science or related field
4+ years experience as data engineer or software developer
2+ years leading a team of data engineers
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for cutting-edge research at the COSMOS Research Center
Job Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for cutting-edge research at the COSMOS Research Center.
This role involves designing scalable microservices and managing complex data pipelines that process over 10 million data points daily using technologies like Kafka and MongoDB.
The position offers a salary of $95,000 and is eligible for benefits, requiring candidates to have a Master's degree and significant leadership experience in data engineering.
Matching Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for cutting-edge research at the COSMOS Research Center.
Salary
Base: $95,000; Bonus/Equity: Not specified; Benefits: Eligible
Skills & Requirements
Must-have
Master's degree in Computer Science or related field
4+ years experience as data engineer or software developer
2+ years leading a team of data engineers
Expert proficiency in Python, Golang, Kafka, and MongoDB
Experience designing ETL pipelines processing 10M+ daily data points
Proficiency with Kubernetes, Docker, FlaskAPI, and GraphQL
Expertise in Elasticsearch, Grafana, Prometheus, and Kibana
Nice-to-have
Strong communication and problem-solving skills
Front-end development skills in HTML/CSS/JavaScript
Experience with Spring Boot and React frameworks
Ability to collaborate with researchers and partner organizations
Knowledge of cloud platforms like AWS, Azure, or GCP
Key Requirements
Master's degree in Computer Science, Information Science, or related discipline
PhD in Computer Science, Information Science, or related discipline
4+ years of experience as a data engineer, software developer, or similar role
2+ years of experience leading a team of data engineers
Proof of legal authority to work in the United States
Work Rights
Must have proof of legal authority to work in the United States