Sr Associate Software Engineer (databricks Developer)

Amgen

Hyderabad, India
On-site
Databricks
Pyspark
Sparksql
Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting

Job Summary

  • Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting.
  • Architect and implement robust data models (dimensional and normalized) to enable high-performance querying and optimized reporting in Redshift.
  • Develop and drive continuous improvements in CI/CD pipelines for automated data pipeline deployments, automated testing, version control, and monitoring for data platforms in a cloud-native environment.

Matching Summary

Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting.

Skills & Requirements

Must-have

  • Databricks
  • PySpark
  • SparkSQL
  • Apache Spark
  • AWS
  • Python
  • SQL
  • Redshift
  • Data Fabric
  • Data Mesh

Nice-to-have

  • Biotech & Pharma expertise
  • Writing APIs
  • SQL/NOSQL database
  • Vector database for LLMs
  • Software engineering best-practices
  • CI/CD
  • Automated unit testing

Key Requirements

  • 5 - 9 years of experience
  • Computer Science, IT or related field degree
  • AWS Certified Data Engineer preferred
  • Databricks Certified preferred
  • Scaled Agile SAFe certification preferred

Work Rights

Not specified

Tailored Resume

Cover Letter