Base: $95,000; bonus/equity: not specified; benefi...
Master's degree in computer science or related field
4+ years experience as data engineer or software developer
2+ years leading a team of data engineers
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making
Job Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
This role involves designing and managing data ETL pipelines processing over 10 million data points daily using Kafka and MongoDB across Kubernetes clusters.
The position offers the opportunity to collaborate with researchers at the COSMOS Research Center on cutting-edge projects in social computing.
Matching Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
Salary
Base: $95,000; Bonus/Equity: Not specified; Benefits: Eligible
Skills & Requirements
Must-have
Master's degree in Computer Science or related field
4+ years experience as Data Engineer or Software Developer
2+ years leading a team of data engineers
Expert proficiency in Kafka, MongoDB, and Kubernetes
Expert proficiency in Python, Golang, FlaskAPI, and GraphQL
Experience designing microservices with Docker
Expert proficiency in Elasticsearch, Grafana, Prometheus, and Kibana
Nice-to-have
Front-end development skills with HTML/CSS/JavaScript
Experience with Spring Boot and React frameworks
Knowledge of CI/CD pipelines using Jenkins and GitLab
Ability to train and deploy machine learning models
Strong communication and problem-solving skills
Key Requirements
Master's degree in Computer Science, Information Science, or related discipline
PhD in Computer Science, Information Science, or related discipline
4+ years of experience as a data engineer/software developer/database administrator
2+ years of experience leading a team of data engineers
Proof of legal authority to work in the United States
Work Rights
Must have proof of legal authority to work in the United States