This role involves designing scalable data pipelines, optimizing SQL-based systems, and building intelligent solutions leveraging large language models within a modern Azure-based platform
Job Summary
This role involves designing scalable data pipelines, optimizing SQL-based systems, and building intelligent solutions leveraging large language models within a modern Azure-based platform.
Key responsibilities include designing, developing, and optimizing ETL pipelines, implementing incremental data processing, building CI/CD pipelines, and developing/deploying data science solutions including LLM-based features.
RPMGlobal is the mining industry's leading enterprise technology and training provider, advancing the industry towards a safer, more efficient, and sustainable future through innovative software solutions and deep domain mining expertise.
Matching Summary
This role involves designing scalable data pipelines, optimizing SQL-based systems, and building intelligent solutions leveraging large language models within a modern Azure-based platform.
Skills & Requirements
Must-have
Microsoft SQL Server expertise
ETL pipeline development
Change Data Capture (CDC)
Azure DevOps CI/CD pipelines
Large Language Models (LLMs)
Azure cloud platform
Nice-to-have
Data engineering experience
Building data platforms
Databricks or Azure OneLake
Distributed data processing frameworks
Mining or resources industry experience
Key Requirements
Bachelor's degree in Data Science, Computer Science, or related field