Software EngineeringData Engineer-Data Platforms-AWSProfessionalPune, IN

IBM

Pune, Maharashtra, India
Hybrid
Aws emr and aws glue experience
Batch and real-time pipeline development
Aws redshift, aurora, and dynamodb
IBM is seeking a Data Engineer specializing in AWS Data Platforms for its Consulting division in Pune, India. The role involves designing, building, and maintaining data engineering solutions using various AWS services and requires experience in data pipeline development for both batch and real-time applications

Job Summary

  • You will work in IBM Consulting Client Innovation Centers to deliver deep technical expertise to public and private sector clients globally.
  • The role involves designing and operating batch and real-time data pipelines using various AWS services to drive meaningful change.
  • IBM fosters a culture of growth where curiosity fuels success and employees are encouraged to challenge the norm and explore new ideas.

Matching Summary

Match Score: 85

IBM is seeking a Data Engineer specializing in AWS Data Platforms for its Consulting division in Pune, India. The role involves designing, building, and maintaining data engineering solutions using various AWS services and requires experience in data pipeline development for both batch and real-time applications.

Skills & Requirements

Must-have

  • AWS EMR and AWS Glue experience
  • Batch and real-time pipeline development
  • AWS RedShift, Aurora, and DynamoDB
  • Apache Airflow and dbt proficiency
  • Spark Python or Scala on AWS

Nice-to-have

  • AWS Databrew for data preparation
  • Lambda functions with Python
  • RedShift Spectrum knowledge
  • Managed Streaming for Apache Kafka

Key Requirements

  • Bachelor's Degree required
  • 5-7 years of professional experience
  • Master's Degree preferred

Work Rights

Not specified

Tailored Resume

Cover Letter