In_associate_ Aws Data Architect_d&a_advisory_kolkata
PwC PricewaterhouseCoopers GmbH
Kolkata, India
Hybrid
Aws glue, lambda, kinesis
Streaming and batch data pipelines
Real-time ingestion and processing
Design and build robust streaming and batch data pipelines with AWS Glue, Lambda, Kinesis Data Streams/Firehose, Amazon MSK (Kafka), and Step Functions
Job Summary
Design and build robust streaming and batch data pipelines with AWS Glue, Lambda, Kinesis Data Streams/Firehose, Amazon MSK (Kafka), and Step Functions.
Architect end-to-end systems for real-time ingestion, processing, and analytics, leveraging Kinesis, MSK, Managed Flink, EMR, and Lambda for low-latency, high-availability operations.
Govern data security (encryption, access control, network isolation), ensure compliance, and embed monitoring/observability pipelines for SLA/SLO adherence.
Matching Summary
Design and build robust streaming and batch data pipelines with AWS Glue, Lambda, Kinesis Data Streams/Firehose, Amazon MSK (Kafka), and Step Functions.
Skills & Requirements
Must-have
AWS Glue, Lambda, Kinesis
streaming and batch data pipelines
real-time ingestion and processing
large-scale data lake/lakehouse
distributed computing strategies
data security and governance
Nice-to-have
event-driven microservices
near-real-time dashboards
DevOps/IaC experience
stakeholder leadership skills
Key Requirements
8-12 years of data engineering/architecture experience
Significant leadership in AWS cloud data platforms