Senior Data Engineer

Arcana.io Inc

Bangalore, India
On-site
Real-time data ingestion and processing
Large-scale enterprise data solutions
Production data pipelines with pyspark
Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer

Job Summary

  • Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.
  • Develop and implement real-time data ingestion and processing systems, and design, build, and operationalize large-scale enterprise data solutions.
  • Translate complex business challenges into scalable and efficient technical solutions and own the full lifecycle of solution implementation.

Matching Summary

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer.

Skills & Requirements

Must-have

  • real-time data ingestion and processing
  • large-scale enterprise data solutions
  • production data pipelines with PySpark
  • Python, Airflow, SQL proficiency
  • cloud platforms expertise
  • version control with Git/GitHub

Nice-to-have

  • computer science fundamentals
  • data structures and algorithms
  • system design understanding
  • peak performance and reliability

Key Requirements

  • Bachelor's Degree in Computer Science or similar
  • 3 - 8 years of professional experience
  • Proven experience with ETL processes and PySpark
  • Strong understanding of data engineering concepts
  • Proficiency in SQL and Data Warehouse concepts
  • Experience with SQL or NoSQL databases
  • Knowledge of AWS technologies and big data tools

Work Rights

Not specified

Tailored Resume

Cover Letter