Lead Data Software Engineer

We are seeking a highly skilled Lead Data Software Engineer to join our remote team, working with the largest provider of mutual funds and the second-largest provider of exchange-traded funds in the world. The Client's customers have access to personalized financial advice, high-quality investments, retirement tools, and relevant market insights that help them build future for those they love. As a Lead Data Software Engineer, you will be responsible for developing the Data Pipeline for integration of systems into/out of Data Lake, as well as leading and mentoring a team of engineers to deliver high-quality solutions.

Responsibilities

• Develop complex data pipelines and integrate systems into/out of Data Lake
• Monitor and optimize data pipelines for performance and scalability
• Develop and maintain dashboards for monitoring and reporting purposes
• Create and maintain technical documentation for data pipelines, APIs, and other relevant systems
• Lead and mentor a team of engineers, ensuring high-quality deliverables and fostering a collaborative environment
• Collaborate with cross-functional teams to design and implement data solutions that meet business requirements

Requirements

• At least 5 years of experience in Data Software Engineering, demonstrating expertise in building complex data pipelines and integrating systems
• At least 1 year of leadership experience, showcasing your ability to mentor and guide a team of engineers
• Proficiency in Python programming language, enabling you to develop Lambda functions and APIs
• Experience in Amazon Web Services, including AWS Glue, AWS EMR, and S3 Bucket
• Expertise in Query Builder/Executor using UI tools
• Experience in Grafana for dashboard creation and monitoring
• Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication

Nice to have

• Experience in Batch Ingestion
• Knowledge of Big Data technologies, such as Hadoop, Spark, and Hive

We offer

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn