Base: $95,000; bonus/equity: not specified; benefi...
Master's degree in computer science or related field
4+ years experience as data engineer or software developer
2+ years leading a team of data engineers
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making
Job Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
This role involves designing and managing scalable data ETL pipelines processing over 10 million data points daily using Kafka and MongoDB across Kubernetes clusters.
The position offers a salary of $95,000 and is eligible for benefits while contributing to cutting-edge research in social computing at the COSMOS Research Center.
Matching Summary
The Data Engineer IV will lead a team to collect, manage, and convert raw social media data into usable information for analytics and decision-making.
Salary
Base: $95,000; Bonus/Equity: Not specified; Benefits: Yes
Skills & Requirements
Must-have
Master's degree in Computer Science or related field
4+ years experience as Data Engineer or Software Developer
2+ years leading a team of data engineers
Expert proficiency in Kafka and MongoDB on Kubernetes
Experience designing microservices with Python and Golang
Proficiency in CI/CD pipelines using Jenkins and GitLab
Expertise in Elasticsearch, Grafana, Prometheus, and Kibana
Nice-to-have
Front-end development skills with HTML/CSS and JavaScript
Experience training and deploying machine learning models
Strong communication and problem-solving abilities
Knowledge of cloud platforms like AWS, Azure, or GCP
Familiarity with Spring Boot and React frameworks
Key Requirements
Master's degree in Computer Science, Information Science, or related discipline
PhD degree in Computer Science, Information Science, or related discipline
4+ years of experience as a data engineer or software developer
2+ years of experience leading a team of data engineers
Proof of legal authority to work in the United States
Work Rights
Must have proof of legal authority to work in the United States