The role requires proficiency in building production-grade data pipelines and ETL/ELT data integration using various cloud platforms
Job Summary
The role requires proficiency in building production-grade data pipelines and ETL/ELT data integration using various cloud platforms.
Candidates must demonstrate strong skills in database design, data cleaning, and transformation across multiple database types including SQL and NoSQL.
This position serves as a bridge between engineering and analytics teams, requiring comfort in both Windows and Linux development environments.
Matching Summary
Match Score: 85
The role requires proficiency in building production-grade data pipelines and ETL/ELT data integration using various cloud platforms.
Skills & Requirements
Must-have
Proficient in SQL and Python scripting
Experience building ETL pipelines
Database design and management skills
Cloud platform experience AWS Azure Google
Knowledge of big data frameworks Hadoop Spark
Familiarity with REST APIs and web protocols
Experience with data modeling and warehousing
Nice-to-have
Experience with Airflow and RDBMS integration
Background in search index integration
Web scraping expertise with Selenium BeautifulSoup
Interest in bridging engineering and analytics
Familiarity with GIS databases
Experience with NoSQL databases like MongoDB Cassandra
Knowledge of data governance and security policies
Key Requirements
Proficiency in SQL and Python
Experience with cloud technologies AWS Azure Google
Knowledge of big data frameworks and tools
Understanding of data governance and security best practices
Comfortable working in Windows and Linux environments