Data Engineer, Web Scraping

10a Labs

Washington D.C., US
$105k–$125k; performance-based annual bonus; compr...
On-site
Design and implement data pipelines
Web scraping and data collection
Data cleaning and transformation
10a Labs is seeking a Data Engineer specializing in web scraping to design and optimize data pipelines for structured and unstructured data. The ideal candidate should have experience in data engineering, proficiency in Python and SQL, and familiarity with web scraping tools and Google Cloud Platform

Job Summary

  • Design, implement, and optimize end-to-end data pipelines for scraping and processing structured and unstructured data using Google Cloud Platform.
  • Conduct ad hoc web scraping and data collection to support research and intelligence initiatives, preparing data for further analysis.
  • Collaborate with ML engineers, other data engineers, and software developers to deliver actionable insights and functional tools.

Matching Summary

Match Score: 85

10a Labs is seeking a Data Engineer specializing in web scraping to design and optimize data pipelines for structured and unstructured data. The ideal candidate should have experience in data engineering, proficiency in Python and SQL, and familiarity with web scraping tools and Google Cloud Platform.

Salary

$105K–$125K; Performance-based annual bonus; Comprehensive health, dental, and vision coverage, 401(k) plan, Professional Development, Generous PTO

Skills & Requirements

Must-have

  • Design and implement data pipelines
  • Web scraping and data collection
  • Data cleaning and transformation
  • Python and SQL proficiency
  • Google Cloud Platform experience

Nice-to-have

  • Collaborate with ML engineers
  • Contribute to API development
  • Work in fast-moving environments

Key Requirements

  • 2+ years of professional experience
  • Degree in Computer Science or related field
  • Proficiency in Python and SQL
  • Experience with web scraping tools
  • Experience with Google Cloud Platform
  • Experience building data pipelines for text data

Work Rights

Not specified

Tailored Resume

Cover Letter