Sr. Big Data Infrastructure Engineer

SUMMARY

Our client is seeking a skilled software engineer who will be an exceptional addition to their Big Data Infrastructure team. The right person for this role should have proven experience with working in mission-critical infrastructure, enjoys building and maintaining large-scale big data systems with the challenges of varied requirements for vast computation and storage capabilities. If you are someone who enjoys building large-scaled big data infrastructure, then this is a great role for you.

WHAT YOU’LL DO

• Develop, scale and improve in-house/cloud big data systems (e.g. Hadoop, Spark, Flink, Kubernates, NiFi, AWS EKS, AWS Glue, etc)
• Work as an administrator of the big data infrastructure, take responsibility for the health of the system, and improve the reliability
• Handle architectural and design considerations such as performance, scalability, reusability and flexibility issues.
• Advocate engineering best practices, including the use of design patterns, code review and automated unit/functional testing
• Work together with data processing teams to influence them on big data system design and optimization
• Experience in building big data infrastructure on the on-prem cluster or cloud
• Experience in developing and optimizing big data components (e.g. Hive, Spark, Flink, Presto, Kubernetes, NiFi, etc)

Preferred Qualifications

• BS or MS degree in CS related major
• 5+ years of professional programming and design experience.
• Familiar with one or more open-source big data systems or big data systems on AWS, including Hadoop, Hive, Spark, Flink, Kubernates, NiFi, AWS EKS, AWS Glue etc. 2+ years of big data experience.
• Willing to dive deep and become an expert in one or more big data systems, ready to open up code of software systems to fix bugs, add new features, and improve performance
• With great technical passion, terrific problem-solving skills, drive for results, and the ability to work independently.
• Good communication and collaboration skills.