Senior Data Software Engineer (Databricks)

We are seeking a Senior Data Software Engineer skilled in Databricks to join our team in Portugal.

You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.

Responsibilities

• Design, develop and maintain scalable data pipelines and architectures
• Optimize data models and enhance ETL processes utilizing Databricks and related technologies
• Implement rigorous data quality checks and monitoring to guarantee high integrity
• Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
• Troubleshoot and resolve data-related issues promptly
• Participate in code reviews ensuring adherence to high standards of code quality

Requirements

• Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies
• Solid understanding of data architecture and data modeling skills
• Expertise in Spark, using either Scala or PySpark
• Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks
• Engineering background in AWS, Azure or GCP
• Experience with big data and performance optimization of data-intensive applications
• Proactive approach and prior client-facing experience
• Ability to navigate ambiguity and work independently
• Desire to engage in a transparent, fast-moving startup environment
• Fluent English communication skills at a B2+ level or higher

We offer

• Competitive compensation depending on experience and skills
• Variety of projects within one company
• Being a part of a project following engineering excellence standards
• Individual career path and professional growth opportunities
• Internal events and communities
• Flexible work hours