Senior Full-stack Web Scraping Engineer

Role Overview

We are seeking a highly pragmatic Senior Full-stack Web Scraping Engineer to drive the MVP development of an innovative B2C-to-B platform. In this pivotal role, you will be responsible for designing and deploying robust, cost-efficient production web scrapers, enhancing existing proof of concepts (POCs), and utilizing modern managed services.

Responsibilities

• Design and implement efficient web scraping solutions to support the platform's MVP development.
• Refine and enhance existing POCs to production-ready web scrapers.
• Leverage deep expertise in Python and API-driven solutions to navigate anti-bot protections effectively.
• Utilize modern managed services such as Railway for deployment and Supabase for database management.
• Ensure the scalability and reliability of web scraping tools in a production environment.
• Initial 5-stores MUST be deployed by Friday Nov 14th.

Required Skills

• Extensive experience in Python for web scraping and data extraction.
• Deployment MUST be on Railway, pushing to tables in Supabase. Must have familiarity with both
• Proficiency in developing API-driven scraping solutions to handle anti-bot protections.
• Ability to design and deploy cost-efficient and robust production web scrapers.

Nice to Have

• Experience with anti-bot protection techniques and strategies.
• Background in developing B2C-to-B platforms.