Senior Data Engineer, Data Platform (usa)

Virtasant Inc

United States
On-site
Python & sql programming
Production-grade data/platform services
Schema evolution tooling
Develop scalable backend services, APIs, and internal tools to automate data platform workflows like data onboarding, validation, and pipeline orchestration

Job Summary

  • Develop scalable backend services, APIs, and internal tools to automate data platform workflows like data onboarding, validation, and pipeline orchestration.
  • Integrate tools with core data infrastructure, building pipelines using technologies such as Airflow, Spark, dbt, Kafka, and Snowflake.
  • Build visualization and monitoring components for data lineage, job health, and quality metrics, collaborating with data engineering, product, and DevOps teams.

Matching Summary

Develop scalable backend services, APIs, and internal tools to automate data platform workflows like data onboarding, validation, and pipeline orchestration.

Skills & Requirements

Must-have

  • Python & SQL programming
  • production-grade data/platform services
  • schema evolution tooling
  • streaming, distributed compute, or S3-based formats
  • schema governance, metadata systems
  • orchestration tools (Airflow, Dagster, Prefect)
  • CI/CD and Docker
  • AWS experience
  • dbt for data pipelines

Nice-to-have

  • data observability, catalog, or metadata tools
  • healthcare data (X12, FHIR)
  • data migration projects
  • internal developer platforms or data portals
  • authentication/authorization (OAuth2, JWT, SSO)

Key Requirements

  • 7+ years of experience in data engineering or software development
  • 5+ years building production-grade data or platform services
  • 2+ years of experience in AWS
  • Must live in contiguous United States
  • Must have documentation to work under an independent contractor agreement

Work Rights

US citizen, Green Card Holder, or sole proprietor of their own LLC company

Tailored Resume

Cover Letter