Capital One is seeking a Lead Data Engineer with expertise in Python, Spark, Glue, and AWS to drive data transformation initiatives. The ideal candidate should have significant experience in application development and big data technologies, along with a collaborative mindset
Job Summary
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake.
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment.
Matching Summary
Match Score: 85
Capital One is seeking a Lead Data Engineer with expertise in Python, Spark, Glue, and AWS to drive data transformation initiatives. The ideal candidate should have significant experience in application development and big data technologies, along with a collaborative mindset.
Salary
Base: $179,400 - $204,700; Bonus/Equity: Performance based incentive compensation; Benefits: Comprehensive, competitive, and inclusive set of health, financial and other benefits
Skills & Requirements
Must-have
Python
Spark
AWS
Glue
Big data technologies
Cloud computing
Nice-to-have
Machine learning
Distributed microservices
Full stack systems
Open Source RDBMS
NoSQL databases
Redshift
Snowflake
Real-time data
Streaming applications
NoSQL implementation
UNIX/Linux
Shell scripting
Agile engineering practices
Key Requirements
Bachelor's Degree
4+ years application development
2+ years big data technologies
1+ year cloud computing
7+ years application development (Python, SQL, Scala, or Java)
4+ years public cloud (AWS, Azure, GCP)
4+ years distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
4+ years real-time data and streaming applications