Experience building etl pipelines with aws glue or ssis
Knowledge of cloud platforms like aws, azure, or gcp
Jobster Private Ltd. is seeking a Data Engineer to design, develop, and maintain data infrastructure and pipelines. The ideal candidate will have strong technical skills in data transformation, ETL processes, and cloud technologies, and will thrive in an Agile environment
Job Summary
The role involves designing and maintaining large-scale batch and real-time data pipelines using modern cloud technologies.
Candidates will collaborate with cross-functional teams including Data Architects, Business Analysts, and Frontend Developers to build scalable products.
The position requires proficiency in data extraction, transformation, and loading (ETL) processes, potentially including web scraping tasks.
Matching Summary
Match Score: 85
Jobster Private Ltd. is seeking a Data Engineer to design, develop, and maintain data infrastructure and pipelines. The ideal candidate will have strong technical skills in data transformation, ETL processes, and cloud technologies, and will thrive in an Agile environment.
Skills & Requirements
Must-have
Proficient in SQL and Python for data cleaning
Experience building ETL pipelines with AWS Glue or SSIS
Knowledge of cloud platforms like AWS, Azure, or GCP
Familiarity with big data frameworks such as Spark and Kafka
Experience with database design across SQL and NoSQL systems
Ability to work in Agile environments with CI/CD practices
Nice-to-have
Experience with web scraping tools like Selenium or BeautifulSoup
Knowledge of data governance policies and security best practices
Interest in bridging engineering and analytics teams
Familiarity with REST APIs and web protocols
Comfortable working in both Windows and Linux environments
Key Requirements
Proficiency in SQL, Python, or R
Experience with AWS, Azure, or Google Cloud
Knowledge of data modeling and storage infrastructure