Senior Data Software Engineer

We are looking for a Senior Data Software Engineer to join our dynamic team, focused on maintaining and operating existing data solutions while extending our framework to meet evolving business requirements.

This role offers the opportunity to work on critical projects involving operations, migration of workloads, and enhancements to the data ecosystem.

Responsibilities

• Manage access, onboarding workloads, and monitoring pipelines to ensure operational continuity
• Optimize costs and oversee the lifecycle management for Azure services
• Facilitate data replication processes across solutions with attention to accuracy and reliability
• Handle migrations of workloads between GTRF 1.0 and GTRF 2.0 environments
• Provide technical expertise to extend framework functionality based on business requests
• Collaborate with cross-functional teams to improve solution architecture and scalability
• Implement infrastructure and configuration changes using tools like Terraform
• Analyze performance data, troubleshoot issues, and propose improvement strategies
• Ensure system alignment with best practices in cloud and data engineering

Requirements

• 3+ years of experience in Azure DevOps, Databricks, and PySpark
• Proficiency in Python for data processing and scripting workflows
• Background in infrastructure automation and deployment using Terraform
• Understanding of pipeline creation and monitoring within cloud environments
• Capability to oversee operational aspects like access management and cost optimization

Nice to have

• Familiarity with Databricks SDK
• Showcase of practical work involving Databricks API integrations
• Background in enhancing collaborative tooling within a Databricks-based ecosystem

We offer

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn