Kafka Software Engineer

Title: Kafka Engineer

Remote: Australia

Contract: 6 Months

Job Description:

What you'll bring to the role

• As an individual contributor, design and implement event streams that teams can use to deliver different business needs.
• Work with teams to ensure integration best practices and tools are rolled out in every service across the whole organisation.
• Foster a culture that puts reliability first and establish processes and policies that drive reliability within different teams. This includes things like SLAs, error budgets, on-call response, incident resolution, observability best practices.
• Deep investigation into production incidents followed up by applying the learning to code.
• Propose new approaches and solutions to ensure we future-proof our platform as we scale.
• Strong communication and team collaboration skills, both written and verbal. As a Kafka Engineer, you will need to share the knowledge, communicate, and coordinate changes across multiple service teams.

Experience

• Understanding Event Streaming patterns and when to apply these patterns
• Designing, building, and operating in-production Big Data, stream processing, and/or enterprise data integration solutions using Apache Kafka
• Developing solutions using Kafka Streams, Kafka Connect, Schema Registry, kSQL DB, and/or Apache Flink
• Working with different database solutions for data extraction, updates, and insertions
• Identity and Access Management space, including relevant protocols and standards such as OAuth, OIDC, SAML, LDAP etc.
• Working with languages such as Terraform, Kustomize, Bash Script, JavaScript and Java for both setting up Kafka Infrastructure and creating Streaming Apps
• Performance tuning of solutions built on Apache Kafka, from Kafka Connect, Topics, Consumers, Producers, kSQL DB, and Apache Flink
• Knowledge of networking protocols such as TCP, HTTP/2, WebSockets, etc.

Bonus Experience

• Confluent certifications in Administration and/or Development
• Using the Confluent for Kubernetes Operator
• Development of custom Kafka Connectors
• Development of Kafka Stream Apps with the Streams API
• Understanding of resiliency techniques and patterns – load balancing, throttling, back pressure, circuit breaking, etc.

Interested candidates can share their CVs at "kranthi.kumar@carecone.com.au"