Cosmos - Data Engineer Iii

University of Arkansas at Little Rock

Little Rock, Arkansas, US
$85,000 py
On-campus (not specified as hybrid or remote)
Data pipelines and etl processes
Kafka and mongodb expertise
Microservices development
The University of Arkansas at Little Rock is seeking a Data Engineer III to join the COSMOS Research Center. The role involves data collection, management, and analysis, with a focus on developing data pipelines and collaborating with researchers to enhance data quality and efficiency

Job Summary

  • The Data Engineer III will lead the development of social media data collection pipelines, inference methods, and infrastructure, as well as classification methods and visualization dashboards.
  • This role involves designing and managing data ETL pipelines processing over 10 million data points daily, utilizing Kafka for real-time streaming and MongoDB for NoSQL storage across Kubernetes clusters.
  • The position offers an opportunity to collaborate with researchers and contribute to cutting-edge research in the exciting field of social computing at the COSMOS Research Center.

Matching Summary

Match Score: 85

The University of Arkansas at Little Rock is seeking a Data Engineer III to join the COSMOS Research Center. The role involves data collection, management, and analysis, with a focus on developing data pipelines and collaborating with researchers to enhance data quality and efficiency.

Salary

$85,000

Skills & Requirements

Must-have

  • Data pipelines and ETL processes
  • Kafka and MongoDB expertise
  • Microservices development
  • Python and Golang proficiency
  • Elasticsearch integration
  • CI/CD pipelines with Jenkins/GitLab CI
  • Prometheus and Grafana monitoring

Nice-to-have

  • Social computing research
  • Cutting-edge research opportunities
  • Collaborative research environment
  • Problem-solving skills

Key Requirements

  • Master's degree in Computer Science or related discipline
  • 2+ years of data engineer/software developer experience
  • 1+ years of leading a team of data engineers

Work Rights

Proof of legal authority to work in the US

Tailored Resume

Cover Letter