Design and build data testing frameworks using Snowflake and scripting pipelines to ensure timely, accurate, and reliable data products
Job Summary
Design and build data testing frameworks using Snowflake and scripting pipelines to ensure timely, accurate, and reliable data products.
Validate data ingestion and transformation from diverse sources including databases, files, API endpoints, and AWS S3.
Partner closely with Data Engineering and Business Intelligence teams to embed data quality checks early in the development lifecycle and establish scalable QA standards.
Matching Summary
Design and build data testing frameworks using Snowflake and scripting pipelines to ensure timely, accurate, and reliable data products.
Salary
$125,000 - $145,000
Skills & Requirements
Must-have
Data testing frameworks
Snowflake or equivalent cloud data platforms
ETL/ELT processes validation
SQL queries in Snowflake
Python scripting for test cases
Data accuracy, completeness, and consistency validation
Nice-to-have
AWS, Azure, or Google Cloud
Data Lakes, AWS S3
Splunk for data logging
Matillion for orchestration
JSON, XML, YAML, TypeScript, Linux shell scripting