Comp Trading specializes in customer retention through incentive programs and a wide range of top brand products, enhancing brand image and loyalty.

Andrew Makepeace

### Role Overview

Join our innovative team as a **Senior Engineer** tasked with designing and building a scalable monitoring system for Ticketmaster event pages. Your mission is to create a robust architecture capable of handling hundreds to thousands of pages, ensuring continuous and reliable operation. This project requires a sophisticated approach to infrastructure and fault-tolerant design, elevating beyond simple scripting.

#### Responsibilities

- Develop and implement a system to monitor Ticketmaster event pages, extracting crucial ticket data.
- Design rule-based condition checks to trigger alerts for specific ticket availability criteria such as section, row, and price.
- Ensure the system operates continuously with high reliability and scalability.
- Architect a scalable solution across multiple servers or distributed workers.
- Implement robust logging, error handling, retries, and monitoring mechanisms.
- Collaborate on designing infrastructure for distributed scaling and fault tolerance.
- Integrate request scheduling, rate limiting, and proxy/IP management to maintain system reliability.
- Design long-running background processes with stable operation over extended periods.

#### Required Skills

- Proven experience in building scalable web automation, crawling, or monitoring systems.
- Strong expertise in distributed systems and fault-tolerant architecture.
- Demonstrated ability to design systems for continuous, long-running processes.
- Familiarity with proxy/IP rotation, rate limiting, and request scheduling.
- Proficient understanding of logging, monitoring, and error recovery strategies.

#### Nice to Have

- Experience with Python and Node.js for automation and backend services.
- Familiarity with FastAPI and Express.js for API development and orchestration.
- Knowledge of PostgreSQL and Redis for data persistence and caching.
- Experience with AWS services (EC2, ECS, Lambda, S3), Docker, and Kubernetes for scaling and container orchestration.
- Proficiency in monitoring and logging tools like Prometheus, Grafana, and the ELK stack.
- Experience with automation tools such as Playwright, Puppeteer, or Selenium for page monitoring and scraping.
- Understanding of networking components like proxy/IP rotation services and load balancers.
- Familiarity with CI/CD pipelines such as GitHub Actions or Jenkins.

