Lead Data Engineer (python, Spark, Aws)

Capital One

New York, NY, United States
New york, ny: $215,200 - $245,600; bonus/equity: p...
Python
Spark
AWS
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

Job Summary

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
  • Deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment.

Matching Summary

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.

Salary

New York, NY: $215,200 - $245,600; Bonus/Equity: performance based incentive compensation; Benefits: comprehensive, competitive, and inclusive set of health, financial and other benefits

Skills & Requirements

Must-have

  • Python
  • Spark
  • AWS
  • big data technologies
  • cloud computing
  • application development

Nice-to-have

  • machine learning
  • distributed microservices
  • full stack systems
  • staying on top of tech trends
  • experimenting with new technologies
  • mentoring other members

Key Requirements

  • Bachelor’s Degree
  • At least 4 years of experience in application development
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing
  • 7+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices

Work Rights

Not specified

Tailored Resume

Cover Letter