Backend Developer

Role Overview

We are looking for a skilled Backend Developer to undertake a project focused on scraping data from the California government website, specifically the DIR apprenticeship database. The goal is to construct a well-organized relational database that encompasses all California counties and trades. Additionally, the role involves implementing an automated system to verify data against the live site every 30 days.

Responsibilities

• Scrape data from the California DIR apprenticeship database efficiently and accurately.
• Design and develop a structured relational database that covers all relevant information across California counties and trades.
• Implement an automated process to perform 30-day verification of the database against the live website to ensure data accuracy and currency.
• Ensure that the database solution incurs zero or minimal licensing costs.

Required Skills

• Proficiency in backend development and web scraping techniques.
• Experience with relational database design and management.
• Ability to automate verification processes and maintain data integrity.
• Strong problem-solving skills and attention to detail.

Nice to Have

• Familiarity with California government data structures and compliance requirements.
• Experience with cost-efficient database solutions.