In this role, you will leverage cloud-native technologies, including Databricks, Azure DevOps, Delta Lake tables, Spark Structured Streaming, and Lakehouse architecture, within our Microsoft Azure environment. You will play a pivotal role in processing large volumes of financial data, driving innovative solutions that enhance scalability, reduce processing latency, and improve transparency.

Responsibilities

Engineer and maintain high-performance data solutions leveraging Python, Apache Spark, and Delta Lake
Participate in the full software development lifecycle, including requirements analysis, solution design, code reviews, and documentation
Collaborate with business partners, IT teams, and architects to ensure data pipelines meet complex and evolving requirements
Optimize financial data processing pipelines to improve scalability and reduce latency
Use automated testing to ensure reliability, stability, and accuracy in data processing
Break down complex data problems into achievable solutions through strong analytical skills
Support operations teams by troubleshooting and resolving complex pipeline issues
Identify opportunities for improvement and proactively address challenges
Design and implement robust relational data models and SQL-based solutions
Partner with the product owner and team members to deliver seamless data workflows
Build systems and pipelines that align with modern cloud-native architectural principles

Requirements

3+ years of professional experience in data engineering or software engineering roles
Strong core Python software engineering experience with proficiency in Apache Spark and Delta Lake
Expertise in relational data models and SQL for designing and managing large-scale data solutions
Knowledge of Azure Cloud Ecosystem, Databricks, and Azure DevOps
Background in financial data processing and handling large-scale analytics workloads
Familiarity with Spark Structured Streaming and its application to real-time data pipelines
Capability to develop, debug, and refine end-to-end automated testing processes
Experience with architectural practices related to Lakehouse platforms and data lake solutions
Fluency in English (B2 level) to collaborate effectively across remote and in-person teams

Nice to have

Understanding of modern big data processing techniques beyond Spark Structured Streaming
Background in optimizing Delta Lake and Lakehouse architectures for complex business needs
Showcase of delivering solutions in finance-specific domains or similar industries
Familiarity with designing and implementing pipelines in distributed systems with low latency

We offer

For you:
Paid annual vacation
Paid sick leave days
Private health insurance
Stable income
Meal and home office compensation
For your comfortable work:
Remote and hybrid work opportunities
Corporate laptop
Possibility to work on your own device
Free licensed software
Relocation opportunities
Free wellbeing activities
For your growth:
Possibility to create a Personal Development Plan from the first day in the company
Free trainings for technical and soft skills
Free access to LinkedIn Learning platform
Free access to internal and external e-Libraries
Certification opportunities
Language courses
Internal technical and non-technical communities
Possibility to contribute in internal, opensource products

The remote option applies only to the Candidates who will be working from any location in Greece.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to positively impacting our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously. You will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

EPAM is committed to providing our global team of 52,800+ EPAMers with inspiring careers. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success, and we value collaboration, try always to understand our customers' business, and strive for the highest standards of excellence.