Software Engineer, Data Platform(Apache Pinot)

The Data Infrastructure team is at the core of client's SaaS offering - enabling our customers to leverage real-time data to accelerate key decision-making by building world-class data ingestion, processing, and serving systems. The team is responsible for scaling and evolving client's Pinot Engine and the corresponding data platforms.

Project overview:

Client is a cloud-based software company that enables business customers to derive advanced insights from real-time and historical data. Client was founded by the core software engineering team and inventors of Apache Pinot, which currently powers hundreds of user-facing applications at companies across industries, including LinkedIn, Uber, Target, 7Eleven, Etsy, Walmart, WePay, Factual, Weibo, and more. Client's Cloud solution has enabled even more companies to deploy and operate real-time analytics at scale, including Stripe, Sovrn, Roadie, Just Eat Takeaway.com, Dialpad, Guitar Center, Blinkit, and more.

Requirements:

• 5+ years experience in a related field
• Proficiency in Java, C++, or Scala programming languages
• Experience with cloud technologies (AWS, Azure, GCP, Kubernetes, etc)
• Familiarity with stream/batch processing, database, and/or data system internals
• Hands on experience working on large-scale distributed systems
• Knowledge of multi-threading and concurrency concepts
• Open-source contributions is a plus

Responsibilities:

In this role, you’ll be contributing to the open-source Apache Pinot software in addition to the following areas:

• Building real-time database/data system internals
• Query engine optimization, compilation, and execution
• Data ingestion, storage, modeling, and indexing services
• Building scalable, low latency, distributed systems
• Creating automation and abstraction self-service tooling