Data Engineer

Comet Group

Penang, Malaysia
Not specified; not specified; benefits include pro...
On-site
Python programming expertise
Databricks spark pyspark pipeline development
Sql database modeling and api integration
The role involves designing and maintaining high-availability global data systems using Databricks and Python for a leading Swiss technology company

Job Summary

  • The role involves designing and maintaining high-availability global data systems using Databricks and Python for a leading Swiss technology company.
  • Candidates will collaborate with Infrastructure teams to manage Kubernetes environments and implement robust CI/CD pipelines with test automation.
  • Comet offers flexible working options, profit sharing, and comprehensive benefits including meal allowances and health coverage for international colleagues.

Matching Summary

The role involves designing and maintaining high-availability global data systems using Databricks and Python for a leading Swiss technology company.

Salary

Not specified; Not specified; Benefits include profit sharing, meal/transport allowances, and Flexi Benefits for health care

Skills & Requirements

Must-have

  • Python programming expertise
  • Databricks Spark PySpark pipeline development
  • SQL database modeling and API integration
  • ETL/ELT process design and maintenance

Nice-to-have

  • Kubernetes container orchestration experience
  • Infrastructure as Code tools like Terraform
  • Message brokers RabbitMQ MQTT Kafka familiarity
  • Time-series databases InfluxDB knowledge
  • Customer and team-oriented mindset

Key Requirements

  • Bachelor's degree in Computer Science or related field
  • Fluency in spoken and written English

Work Rights

Not specified

Tailored Resume

Cover Letter