Big Data Engineer

Datamatics Technologies

Lahore, Pakistan
On-site
Apache hadoop ecosystem experience
Apache spark pyspark or scala
Apache kafka streaming implementation
Datamatics Technologies is seeking a Big Data Engineer with 5 to 8 years of experience to design, develop, and maintain scalable data pipelines and distributed processing systems. The role requires strong proficiency in big data technologies, particularly within the Cloudera Data Platform, and offers an opportunity to work on both batch and real-time data analytics

Job Summary

  • The Big Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines to support enterprise-wide analytics initiatives.
  • This role requires building distributed data processing solutions using Apache Hadoop, Spark, and Cloudera Data Platform within both batch and real-time environments.
  • Candidates must possess strong problem-solving skills to optimize data workflows while ensuring adherence to governance, security, and data quality standards.

Matching Summary

Match Score: 85

Datamatics Technologies is seeking a Big Data Engineer with 5 to 8 years of experience to design, develop, and maintain scalable data pipelines and distributed processing systems. The role requires strong proficiency in big data technologies, particularly within the Cloudera Data Platform, and offers an opportunity to work on both batch and real-time data analytics.

Skills & Requirements

Must-have

  • Apache Hadoop ecosystem experience
  • Apache Spark PySpark or Scala
  • Apache Kafka streaming implementation
  • Apache NiFi ETL orchestration
  • Cloudera Data Platform CDP
  • HDFS Hive Impala query engines

Nice-to-have

  • Cloud platform AWS Azure GCP
  • Docker Kubernetes containerization
  • CI/CD pipeline exposure
  • Event-driven architecture knowledge

Key Requirements

  • 5 to 8 years of Big Data Engineering experience
  • Bachelor's or Master's degree in Computer Science or related field
  • Proficiency in SQL and Python, Scala, or Java

Work Rights

Not specified

Tailored Resume

Cover Letter