Role Overview
We are seeking a skilled Senior Software Engineer to lead and manage the graph serving layer within our platform. You will be responsible for building and maintaining the pipeline that supports our graph database, ensuring it remains current and efficient as new data is integrated. Additionally, you will evaluate and select the appropriate graph store based on our data model and access patterns, and manage the query and access layer utilized by analysts and downstream products.
Responsibilities
- Design and build the pipeline that produces and maintains the graph database derived from our data lake.
- Evaluate and select a suitable graph store, considering traversal, query complexity, and data aging requirements.
- Operate and manage the chosen graph store, ensuring efficient updates and deletions.
- Develop and maintain the query and access layer for graph data interaction.
- Manage the EKS infrastructure, including Crossplane compositions, Argo CD applications, deployment pipelines, and monitoring tools.
Required Skills
- Proven experience operating a stateful data store in production, including sizing, upgrades, and restoration.
- Proficiency with Kubernetes in a production environment and infrastructure as code.
- Strong background in backend service and API development.
- Experience with Spark and lake table technologies to construct the serving layer pipelines.
- Expertise in query performance optimization, including reading plans, designing indexes, and addressing slow queries.
- Must be a US Citizen.
Nice to Have
- Experience with graph databases is beneficial but not mandatory. Emphasis is on distributed systems and operations expertise.