Senior Data Engineer | Growth And Transformation

Redventures

Charlotte, NC, US
On-site
Cloud lakehouse architecture
Aws and databricks
Batch and streaming pipelines
Design and evolve a cloud lakehouse architecture on AWS and Databricks, owning end-to-end batch and streaming pipelines

Job Summary

  • Design and evolve a cloud lakehouse architecture on AWS and Databricks, owning end-to-end batch and streaming pipelines.
  • Build high-impact data products and engineer reliable data pipelines using Python, Spark, Kafka, dbt, and Airflow with CI/CD.
  • Champion data quality, enable analytics and AI solutions, and influence a growing team by mentoring mid-level engineers.

Matching Summary

Design and evolve a cloud lakehouse architecture on AWS and Databricks, owning end-to-end batch and streaming pipelines.

Skills & Requirements

Must-have

  • Cloud lakehouse architecture
  • AWS and Databricks
  • Batch and streaming pipelines
  • Scalable data models
  • Python and Spark jobs
  • Kafka and Spark Streaming
  • dbt transformations
  • Airflow orchestration
  • CI/CD with GitHub Actions
  • Terraform
  • Data quality and observability
  • AI and ML enablement
  • Big data platforms
  • Data lake and lakehouse architectures
  • SQL performance tuning
  • Data warehouses (Snowflake, Databricks SQL)
  • Governance and compliance (CCPA/SOC 2)
  • Salesforce Data Cloud

Nice-to-have

  • Monte Carlo, Alation/Collibra policies
  • Power BI and Tableau
  • LLM-driven agentic workflows
  • Distributed systems design
  • Data vault schemas
  • Data architecture system design
  • Consumer finance, banking or fintech domain
  • Translate technical concepts to non-technical audiences
  • Salesforce Data Cloud and Adobe AEP certification
  • GenAI, LLM, agentic workflows
  • Marketing cloud activations
  • Data mesh architecture

Key Requirements

  • 5+ years designing and developing on AWS and Databricks data lake and lakehouse architectures
  • Expert in SQL, Python/Scala
  • Hands on with Kafka and Spark Structured Streaming
  • Dimensional, data vault, and real time schemas
  • SQL performance tuning on data warehouses
  • Airflow, dbt, GitHub Actions, Terraform
  • Familiar with CCPA/SOC 2 controls
  • Expert in designing, implementing and maintaining Salesforce Data Cloud solutions
  • System design experience for batch and real time
  • Prior work in consumer finance, banking or fintech
  • Proven ability to translate technical concepts to non technical audiences

Work Rights

Not specified

Tailored Resume

Cover Letter