The Data Engineer IV will collect, manage, and convert raw data into usable information for analytics and decision-making, interpreting trends and patterns, and building algorithms and prototypes
Job Summary
The Data Engineer IV will collect, manage, and convert raw data into usable information for analytics and decision-making, interpreting trends and patterns, and building algorithms and prototypes.
Responsibilities include leading the development of social media data collection pipelines, inference and classification methods, and visualization dashboards, while collaborating with researchers.
This role requires expert proficiency in various data technologies, programming languages, and ML model deployment, with a focus on improving data quality and efficiency through leveraging data systems and pipelines.
Matching Summary
The Data Engineer IV will collect, manage, and convert raw data into usable information for analytics and decision-making, interpreting trends and patterns, and building algorithms and prototypes.
Salary
$95,000; Not specified; Not specified
Skills & Requirements
Must-have
Data pipelines and ETL processes
Python and Golang microservices
Kafka and MongoDB expertise
Kubernetes cluster management
CI/CD pipelines with Jenkins/GitLab CI
Prometheus, Grafana, Kibana integration
Social media data collection
Nice-to-have
Cutting-edge research in social computing
Collaborate with researchers and partner organizations
Enhance system fault tolerance
Flexible learning and internship opportunities
Key Requirements
Master's degree in Computer Science or related field
4+ years of data engineer/software developer experience
PhD degree in Computer Science or related field
2+ years of experience leading data engineers
Work Rights
Must have proof of legal authority to work in the United States