Design, automate, implement & maintain data architecture patterns in AWS & GCP for data collection infrastructure & pipelines for multi-region cloud-based big data IaaS & PaaS solutions
Job Summary
Design, automate, implement & maintain data architecture patterns in AWS & GCP for data collection infrastructure & pipelines for multi-region cloud-based big data IaaS & PaaS solutions.
Perform end-to-end pipeline load performance testing, support technology upgrades through PostgreSQL & Cloud SQL cloud migrations, and perform SQL & NoSQL database tuning & maintenance.
Provide guidance on data management & SQL optimization, and develop data warehousing management policies.
Matching Summary
Design, automate, implement & maintain data architecture patterns in AWS & GCP for data collection infrastructure & pipelines for multi-region cloud-based big data IaaS & PaaS solutions.
Skills & Requirements
Must-have
AWS & GCP cloud environments
Snowflake, Spark, & Python
Kubernetes for application deployments
Terraform IAC
CI/CD pipeline
Splunk Observability
Nice-to-have
Data management policies
SQL optimization guidance
Cloud Composer automation
Key Requirements
Bachelor's degree in Comp Science, Comp Engineering, IT or related