Pyspark Big Data Developer

Workforcity

Pune, India
Python, sql and pyspark
Distributed data processing
Big data tools and technologies
Work with a cross-functional and geographically dispersed team for quality assurance

Job Summary

  • Work with a cross-functional and geographically dispersed team for quality assurance.
  • Perform end to end features development of application including requirements understanding, impact analysis, development and execution, production deployment and maintenance.
  • Opportunity for professional development in the international and multicultural organization.

Matching Summary

Work with a cross-functional and geographically dispersed team for quality assurance.

Skills & Requirements

Must-have

  • Python, SQL and PySpark
  • distributed data processing
  • big data tools and technologies
  • backend development (FASTAPI / FLASK)
  • Devops: GIT, CI/CD basics, Linux/Unix
  • design, develop, and maintain big data pipelines

Nice-to-have

  • NoSQL databases, ElasticSearch
  • understand of LLMs, prompt engineering
  • Data query systems (NL to SQL)
  • vector databases (FAISS, pinecone etc)

Key Requirements

  • At least 4+ years’ experience
  • Bachelor’s degree (preferably in technology /engineering or related field)

Work Rights

Not specified

Tailored Resume

Cover Letter