Software Engineer Ii - Data Engineer - Data & Ml Engineering
Bristol Myers Squibb
50% onsite
Etl/elt pipelines
Data warehouse
Data storage and retrieval
The Data Engineer will be responsible for developing and maintaining ETL/ELT pipelines for ingesting data from various sources into our data warehouse
Job Summary
The Data Engineer will be responsible for developing and maintaining ETL/ELT pipelines for ingesting data from various sources into our data warehouse.
Optimize data storage and retrieval to ensure efficient performance and scalability.
Stay up-to-date with emerging trends and technologies in data engineering and analytic.
Matching Summary
The Data Engineer will be responsible for developing and maintaining ETL/ELT pipelines for ingesting data from various sources into our data warehouse.
Skills & Requirements
Must-have
ETL/ELT pipelines
data warehouse
data storage and retrieval
data quality and integrity
real time data ingestion pipelines
AWS Glue services
AWS data engineering ecosystem
Nice-to-have
end-to-end ownership mindset
innovate and drive initiatives
collaboration with data architects
fast-paced environment
minimal oversight
Agile/Product based environment
Key Requirements
3-5 years of hands-on experience
5+ years of experience in data engineering or software development
Expertise in Databricks
Expertise in designing and building real time data ingestion data pipelines in AWS
Expertise in CloudFormation
Developing and using Custom Resources in CFTs
Expertise in developing GitHub Workflows & integrating GitHub workflows with AWS
Expertise with using boto3 apis
Expert in building APIs using AWS services
In-depth knowledge and hands-on experience with ASW Glue services
Hands-on experience developing and delivering data, ETL solutions
Prior experience working in an Agile/Product based environment