Cosmos - Data Engineer Iii

University of Arkansas at Little Rock

Little Rock, United States
$85,000 py
On-site
Develop and maintain datasets
Improve data quality and efficiency
Interpret trends and patterns of data
The University of Arkansas at Little Rock is seeking a Data Engineer III to join their COSMOS Research Center. This full-time position involves managing and analyzing data, leading a team, and contributing to innovative research projects, requiring advanced technical skills and excellent communication abilities

Job Summary

  • The Data Engineer III will collect, manage, and convert raw data into usable information for analytics and decision-making, requiring comprehensive data analysis skills and the development and maintenance of datasets.
  • Responsibilities include leading the development of social media data collection pipelines, inference methods, infrastructure, classification methods, and visualization dashboards, collaborating with researchers to achieve optimal performance metrics.
  • This role requires advanced proficiency in various programming languages, data integration platforms, SQL database design, data mining, machine learning model training and deployment, and managing complex data infrastructure.

Matching Summary

Match Score: 85

The University of Arkansas at Little Rock is seeking a Data Engineer III to join their COSMOS Research Center. This full-time position involves managing and analyzing data, leading a team, and contributing to innovative research projects, requiring advanced technical skills and excellent communication abilities.

Salary

$85,000

Skills & Requirements

Must-have

  • Develop and maintain datasets
  • Improve data quality and efficiency
  • Interpret trends and patterns of data
  • Build algorithms and prototypes
  • Lead social media data collection pipelines
  • Develop inference and classification methods
  • Build visualization dashboards
  • Collaborate with researchers and developers
  • Design and manage data ETL pipelines
  • Process 10 million+ data points daily
  • Utilize Kafka for real-time data streaming
  • Use MongoDB for NoSQL storage
  • Deploy scalable microservices in Python and Golang
  • Leverage FlaskAPI, GraphQL, and Docker
  • Achieve sub-second response times
  • Migrate data from legacy databases to MongoDB
  • Optimize storage for unstructured data
  • Integrate Elasticsearch
  • Setup and manage data infrastructure
  • Evaluate model needs and objectives
  • Conduct complex data analysis and report
  • Prepare data for analysis and reporting
  • Combine raw information from different sources
  • Enhance data quality and reliability
  • Identify opportunities for data acquisition
  • Develop analytical tools and programs
  • Manage services and operational infrastructure
  • Create CI/CD pipelines with Jenkins and GitLab CI
  • Integrate Prometheus for monitoring
  • Use Grafana for real-time dashboarding
  • Log analysis with Kibana
  • Train machine learning (ML) models
  • Deploy machine learning (ML) models
  • Enhance system fault tolerance with alerting

Nice-to-have

  • Cutting-edge research in social computing
  • Excellent communication and problem-solving skills
  • Front-end development (HTML/CSS, JavaScript, Node.js)

Key Requirements

  • Master's degree in Computer Science, Information Science, or related discipline
  • 2+ years of experience as a data engineer/software developer/software engineer/database administrator
  • 1+ years of experience leading a team of data engineers

Work Rights

Not specified

Tailored Resume

Cover Letter