The role involves building scalable, secure, and high-performance data pipelines spanning both legacy Hadoop clusters and modern AWS cloud services
Job Summary
The role involves building scalable, secure, and high-performance data pipelines spanning both legacy Hadoop clusters and modern AWS cloud services.
Alight Solutions emphasizes a culture where employees champion people, grow with purpose, and act with integrity to improve lives through unified benefits ecosystems.
Candidates will provide technical leadership, guide peers, and ensure operational excellence while optimizing costs and ensuring regulatory compliance across hybrid data platforms.
Matching Summary
The role involves building scalable, secure, and high-performance data pipelines spanning both legacy Hadoop clusters and modern AWS cloud services.
Skills & Requirements
Must-have
5-8 years Hadoop ecosystem experience
Strong PySpark and Spark optimization skills
AWS data stack expertise (S3, Glue, EMR)
ETL pipeline design and maintenance
Airflow or Control-M orchestration
Data modeling and flow diagram creation
Nice-to-have
Knowledge of Miro for data flow diagrams
Healthcare domain knowledge
AWS certifications in Data Engineering
Experience with serverless patterns
Containerization with Docker/ECS/EKS
Key Requirements
5-8 years of relevant experience
Proficiency in Scala or Python scripting
Strong SQL skills in Hive and Impala
Experience with CI/CD and Git workflows
Understanding of AWS networking and security
Work Rights
Must have work authorization without future visa sponsorship