We are looking for highly skilled Data Infrastructure Engineers with strong expertise in distributed systems, API development, and software engineering. The ideal candidates should have hands-on experience building distributed applications in Scala and Kubernetes.
Key Responsibilities:
- Develop and maintain a batch orchestration platform.
- Develop migration tooling to facilitate the transfer of job configurations to a new data platform.
- Write efficient, high-performance code in Scala
- Design and implement distributed data systems for high availability, reliability, and performance.
- Collaborate with stakeholders and other software engineers to build robust platform features.
- Ensure data integrity, governance, and security within the infrastructure.
Technical Skills & Qualifications:
- Strong programming skills in Scala
- Deep understanding of data structures, algorithms, and distributed computing principles.
- Experienced in API development
- General SQL knowledge
- Experience deploying production applications to Kubernetes
- Experience with relational databases (such as PostgreSQL).
Preferred Qualifications:
- In-depth experience with Kubernetes.
- Proficiency in Scala and IOs.
- Strong problem-solving skills with the ability to debug and optimize large-scale distributed systems.
- Experience with cloud-based data solutions (AWS).
- Familiarity with Yarn and Spark jobs