Data Engineer - Director - Data & Analytics Engineering
Morgan Stanley UK
United Kingdom
Batch data engineering on apache spark
Real-time service integration off kafka
Near real-time stream processing
We’re seeking someone to join our CDRR Technology team as a Data Engineer, in Non-Financial Risk Technology to provides operational controls and surveillance capabilities to enhance the firm's resilience to threats and fraudulent behaviour
Job Summary
We’re seeking someone to join our CDRR Technology team as a Data Engineer, in Non-Financial Risk Technology to provides operational controls and surveillance capabilities to enhance the firm's resilience to threats and fraudulent behaviour.
As a senior data engineer your role will be to create and deliver high quality, resilient data solutions to our fraud business partners and being a productive member of the development team.
You will be working on various existing and new technology stacks which include on-prem relational and big-data technologies & new cloud-based technologies in AWS and Azure.
Matching Summary
We’re seeking someone to join our CDRR Technology team as a Data Engineer, in Non-Financial Risk Technology to provides operational controls and surveillance capabilities to enhance the firm's resilience to threats and fraudulent behaviour.
Skills & Requirements
Must-have
Batch data engineering on Apache Spark
Real-time service integration off Kafka
Near real-time stream processing
SQL Server & Hadoop based implementations
Strong SQL & Stored Procedure skills
Linux environment and Python/Shell scripts
Dimensional modelling for data mart design
Nice-to-have
Machine learning and AI-based techniques
Modern software engineering tools
Agile team using Scrum
Full development lifecycle involvement
Collaborate with wider team
Work on own initiative
Key Requirements
6 to 8 years of relevant work experience
Strong with programming in Python
Good hands-on experience with job scheduling tools