Software Engineer

About the Company

We are looking for a Software Engineer III with strong Data Engineering and MLOps experience.

About the Role

This is not a Data Scientist position — the role focuses on building production-grade data and ML pipelines and automating infrastructure on Azure Databricks. You will work at the intersection of data engineering, infrastructure automation, and machine learning, transforming prototype workflows into reliable, observable, and cost-efficient production pipelines.

Responsibilities

• Design and maintain end-to-end data and ML pipelines using Databricks Workflows, Delta Lake, and Unity Catalog.
• Build reproducible training and deployment workflows integrated with experiment tracking, model registry, and artifact management.
• Implement data quality and observability frameworks.
• Build dashboards for data quality, model performance, and operational metrics (Lakeview, Grafana, or similar).
• Automate ingestion and feature pipelines using PySpark, SQL Warehouses, and Databricks Asset Bundles under CI/CD.
• Manage security, access, and governance.
• Optimize performance and cost of compute workloads.
• Develop automated evaluation and validation pipelines triggered by new telemetry data.
• Implement monitoring for drift detection, feature stability, and prediction quality.
• Maintain reproducible environments using Infrastructure as Code and containerization (Terraform or similar).

Qualifications

• Strong Azure Databricks experience
• Strong PySpark / Data Engineering experience
• MLOps / ML pipeline automation experience
• CI/CD and Infrastructure as Code experience
• Experience with monitoring and production pipelines

Required Skills

• Strong Azure Databricks experience
• Strong PySpark / Data Engineering experience
• MLOps / ML pipeline automation experience
• CI/CD and Infrastructure as Code experience
• Experience with monitoring and production pipelines

Preferred Skills

• Experience with monitoring and production pipelines

Pay range and compensation package

Location: Madrid / Remote

Contract: Contract / Freelance

Rate: Hourly rate negotiable

Start date: Immediate or within two weeks preferred