The primary purpose of this position is to architect, develop, and maintain advanced automated data extraction systems that harvest critical business intelligence
Job Summary
The primary purpose of this position is to architect, develop, and maintain advanced automated data extraction systems that harvest critical business intelligence.
Candidates must possess a 'hacker' mindset with deep experience in defeating sophisticated anti-bot security measures like Cloudflare and DataDome.
This role involves designing scalable crawling architectures and managing the storage integrity of millions of records using advanced SQL.
Matching Summary
The primary purpose of this position is to architect, develop, and maintain advanced automated data extraction systems that harvest critical business intelligence.
Skills & Requirements
Must-have
Senior Python Engineer experience
Scrapy or Playwright framework expertise
Reverse-engineering web applications
Bypassing Cloudflare and DataDome
High-performance SQL database management
Nice-to-have
Hacker mindset for problem solving
Experience with distributed crawling architectures