Back-end Web Scrapper - PT Freelance - Worldwide

Role Overview

We are seeking a highly skilled and experienced Web Scraping Developer to join our founding management team. You will play a crucial role in our pilot project to enhance our market intelligence and client acquisition strategy within the property management industry. Your primary task will be to fix and optimize an existing scraper for a complex real estate website and subsequently develop new scraping solutions for other targeted applications.

This is a unique opportunity for a developer who excels at solving intricate scraping challenges, particularly those involving complex website structures and data extraction. We are looking for the best talent in this niche and are committed to offering competitive compensation for a quick and effective solution.

Key Responsibilities

• Take ownership of an existing Python-based web scraper that targets rental listings on a major real estate website (Zillow).
• Diagnose and resolve the issues preventing the current scraper from accurately extracting data from all property types.
• Develop robust scraping solutions that can navigate complex website backends, including those with deeply nested JSON trees and JavaScript-driven content.
• Collaborate with the founding team to understand data requirements and deliver extracted information in a clean, usable format (e.g., CSV).
• Lead the development of similar scraping projects for other websites and applications in the future.
• Contribute to the strategic use of extracted data for market analysis and client base mapping.

Required Skills & Experience

• Expert-level proficiency in Python for web scraping.
• Proven experience building and maintaining complex, large-scale web scraping projects.
• Deep understanding of web technologies, including HTML, CSS, and JavaScript.
• Expertise in working with deeply nested JSON trees and extracting data from dynamic, API-driven websites.
• Experience with a variety of scraping libraries and tools (e.g., Scrapy, Beautiful Soup, Selenium, or Puppeteer).
• Strong problem-solving skills and the ability to reverse-engineer website data flows.
• Experience in storing and managing extracted data in a structured format.

Nice to Have

• Prior experience scraping real estate or property-related websites.
• Familiarity with third-party anti-bot detection APIs.
• Experience with backend development and database integration for data storage and retrieval.