Provide L1 production support for data processing pipelines and analytical platforms, monitoring jobs and ensuring system stability
Job Summary
Provide L1 production support for data processing pipelines and analytical platforms, monitoring jobs and ensuring system stability.
Troubleshoot and resolve code-level issues in data pipelines written in Python, SQL, Hive, Spark, or Scala, and debug/optimize Hive queries.
Collaborate with Data Engineers, Business Analysts, and Platform teams to resolve issues, contribute to documentation, and identify automation opportunities.
Matching Summary
Provide L1 production support for data processing pipelines and analytical platforms, monitoring jobs and ensuring system stability.
Skills & Requirements
Must-have
SQL, Apache HIVE, Hadoop Ecosystem
Python for scripting and automation
Linux/Unix environments and shell scripting
Data pipelines and ETL workflows
Troubleshooting production code issues and logs
Nice-to-have
Apache Spark batch and streaming
Scala programming for Spark
Job schedulers like Airflow or Oozie
Cloud data platforms (Azure/AWS/GCP)
DevOps practices and CI/CD automation
Key Requirements
Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent practical experience)