Sr Associate Software Engineer (databricks Developer)

Amgen UK

Hyderabad, India
On-site
Databricks, pyspark, sparksql, apache spark
Aws services (redshift, s3, glue, lambda)
Python, sql
Design, develop, and optimize scalable data pipelines using AWS and Databricks to support enterprise analytics and reporting

Job Summary

  • Design, develop, and optimize scalable data pipelines using AWS and Databricks to support enterprise analytics and reporting.
  • Architect and implement robust data models and batch/real-time processing frameworks, ensuring data quality, reliability, and performance at scale.
  • Collaborate with cross-functional teams, drive continuous improvements in CI/CD pipelines, and mentor junior engineers.

Matching Summary

Design, develop, and optimize scalable data pipelines using AWS and Databricks to support enterprise analytics and reporting.

Skills & Requirements

Must-have

  • Databricks, PySpark, SparkSQL, Apache Spark
  • AWS services (Redshift, S3, Glue, Lambda)
  • Python, SQL
  • Data modeling (dimensional, normalized)
  • Batch and real-time data processing
  • Data quality, reliability, performance
  • Data security, compliance, RBAC
  • CI/CD for data pipelines
  • Scaled Agile Framework (SAFe)

Nice-to-have

  • Biotech & Pharma industry expertise
  • Writing APIs for data access
  • SQL/NOSQL/vector databases
  • Software engineering best-practices
  • Git, Jenkins, Maven

Key Requirements

  • 5 - 9 years of experience
  • Any degree
  • AWS Certified Data Engineer preferred
  • Databricks Certified preferred
  • Scaled Agile SAFe certification preferred

Work Rights

Not specified

Tailored Resume

Cover Letter