Eg-100 - Information Technology / Data Architecture
Bristol Myers Squibb
Hyderabad, IN, United States
50% onsite
Designing and building etl pipelines
Data products and analytic ready data
Real time data ingestion pipelines in aws
The Data Engineer will be responsible for designing, building, and maintaining the ETL pipelines, data products, evolution of the data products, and utilize the most suitable data architecture required for our organization's data needs
Job Summary
The Data Engineer will be responsible for designing, building, and maintaining the ETL pipelines, data products, evolution of the data products, and utilize the most suitable data architecture required for our organization's data needs.
Responsible for delivering high quality, data products and analytic ready data solution Work with an end-to-end ownership mindset, innovate and drive initiatives through completion.
Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a wide variety of competitive benefits, services and programs that provide our employees with the resources to pursue their goals, both at work and in their personal lives.
Matching Summary
The Data Engineer will be responsible for designing, building, and maintaining the ETL pipelines, data products, evolution of the data products, and utilize the most suitable data architecture required for our organization's data needs.
Skills & Requirements
Must-have
designing and building ETL pipelines
data products and analytic ready data
real time data ingestion pipelines in AWS
Databricks SME grade expertise
AWS Glue services and ecosystem
Python, R, PySpark, Scala programming skills
SQL and database technologies
Nice-to-have
end-to-end ownership mindset
innovate and drive initiatives
collaboration and communication skills
Lifesciences Research and Development domain
Agile/Product based environment experience
Key Requirements
5-8 years hands-on experience
Cloud environment experience
Data lakehouses, master/reference data management
Data quality and analytics/AI ML experience
Expertise in designing and building real time data ingestion data pipelines in AWS
Expertise in CloudFormation
Developing and using Custom Resources in CFTs
Developing GitHub Workflows & integrating with AWS
Using boto3 apis for Lambda, S3, Glue
Expert in building APIs using AWS services
5+ years of experience in data engineering or software development
Experience with cloud-based data technologies (AWS, Azure, GCP)
Experience establishing agile and product-oriented teams