Senior Engineer – Scalable Monitoring System US/NA-PT

Role Overview

Join our innovative team as a Senior Engineer tasked with designing and building a scalable monitoring system for Ticketmaster event pages. Your mission is to create a robust architecture capable of handling hundreds to thousands of pages, ensuring continuous and reliable operation. This project requires a sophisticated approach to infrastructure and fault-tolerant design, elevating beyond simple scripting.

Responsibilities

• Develop and implement a system to monitor Ticketmaster event pages, extracting crucial ticket data.
• Design rule-based condition checks to trigger alerts for specific ticket availability criteria such as section, row, and price.
• Ensure the system operates continuously with high reliability and scalability.
• Architect a scalable solution across multiple servers or distributed workers.
• Implement robust logging, error handling, retries, and monitoring mechanisms.
• Collaborate on designing infrastructure for distributed scaling and fault tolerance.
• Integrate request scheduling, rate limiting, and proxy/IP management to maintain system reliability.
• Design long-running background processes with stable operation over extended periods.

Required Skills

• Proven experience in building scalable web automation, crawling, or monitoring systems.
• Strong expertise in distributed systems and fault-tolerant architecture.
• Demonstrated ability to design systems for continuous, long-running processes.
• Familiarity with proxy/IP rotation, rate limiting, and request scheduling.
• Proficient understanding of logging, monitoring, and error recovery strategies.

Nice to Have

• Experience with Python and Node.js for automation and backend services.
• Familiarity with FastAPI and Express.js for API development and orchestration.
• Knowledge of PostgreSQL and Redis for data persistence and caching.
• Experience with AWS services (EC2, ECS, Lambda, S3), Docker, and Kubernetes for scaling and container orchestration.
• Proficiency in monitoring and logging tools like Prometheus, Grafana, and the ELK stack.
• Experience with automation tools such as Playwright, Puppeteer, or Selenium for page monitoring and scraping.
• Understanding of networking components like proxy/IP rotation services and load balancers.
• Familiarity with CI/CD pipelines such as GitHub Actions or Jenkins.