Proficient in sql and python for data transformation
Experience building etl pipelines using aws glue or ssis
Knowledge of cloud platforms like aws, azure, or google cloud
The role involves designing and maintaining large-scale batch and real-time data pipelines to support business efficiency
Job Summary
The role involves designing and maintaining large-scale batch and real-time data pipelines to support business efficiency.
Candidates will collaborate with cross-functional teams including Data Architects and Business Analysts to build scalable data-driven products.
The company offers competitive compensation, flexible work arrangements, and a dedicated staff development budget for learning and growth.
Matching Summary
Match Score: 85
The role involves designing and maintaining large-scale batch and real-time data pipelines to support business efficiency.
Salary
Market competitive salary; Variable performance bonus aligned to skills and impact; Outpatient medical, specialist coverage, and flexi benefits included
Skills & Requirements
Must-have
Proficient in SQL and Python for data transformation
Experience building ETL pipelines using AWS Glue or SSIS
Knowledge of cloud platforms like AWS, Azure, or Google Cloud
Familiarity with big data frameworks such as Spark or Kafka
Experience with database design across SQL and NoSQL systems
Nice-to-have
Passion for data engineering in big data environments
Interest in bridging engineering and analytics teams
Experience with web scraping tools like Selenium or BeautifulSoup
Comfortable working in Agile environments with CI/CD practices
Familiarity with data governance and security best practices
Key Requirements
1 year contract duration specified
Proficiency in scripting languages like SQL or Python
Experience with both Windows and Linux development environments