Data Engineer

Assurant Services Australia Pty Limited

Hyderabad, India
5 years design and development experience
Azure databricks and data factory expertise
Sql performance tuning and code optimization
The Data Engineer will develop scalable data solutions for structured and unstructured data to support reporting, analytics, ML, and AI

Job Summary

  • The Data Engineer will develop scalable data solutions for structured and unstructured data to support reporting, analytics, ML, and AI.
  • This role requires wrangling data in support of Data Science projects while assisting with the optimization of big data ecosystems.
  • Candidates must possess 5 years of design and development experience with specific knowledge of Azure technologies like Databricks and Data Factory.

Matching Summary

The Data Engineer will develop scalable data solutions for structured and unstructured data to support reporting, analytics, ML, and AI.

Skills & Requirements

Must-have

  • 5 years design and development experience
  • Azure Databricks and Data Factory expertise
  • SQL performance tuning and code optimization
  • Experience with structured and unstructured data
  • Knowledge of CRISP-DM methodology

Nice-to-have

  • Proof of concept research and building
  • Creative problem-solving in established processes
  • Collaboration on project risk mitigation plans
  • Feature engineering of data solutions
  • Experience with job scheduling tools

Key Requirements

  • Bachelor of Science degree required
  • 5 years of design and development experience
  • Proficiency in SQL, C#, .NET, Python, and Linux Shell Scripting
  • Knowledge of Big Data technologies including Spark, Hive, and NoSQL
  • Experience with Cloud Service Models (PaaS, IaaS, SaaS)

Work Rights

Not specified

Tailored Resume

Cover Letter