Senior Data Engineer

Cloud Employee

Cloud Employee, is a UK-owned Philippines business established 8 years ago. We connect high-performing software engineer talent in the Philippines with some of the world’s leading and most innovative tech companies. Developers join to work from the Philippines as part of international engineering teams and grow their CV and skill-set.

We pride ourselves on being a supportive, cutting-edge workplace that continuously invests in staff development, engagement, and well-being. We provide security, career paths, individual training programs, and mentoring.

Client Overview

The client is a UK-based talent services firm that acts as an embedded extension of its clients’ HR functions, combining cutting-edge technology, expert talent strategies, and transformation services to streamline hiring processes and drive lasting impact.

Role Overview

The Senior Data Engineer will play a critical role in designing and implementing AI-driven data solutions. This position requires a highly skilled engineer with expertise in data pipeline development, AI implementation, and API integrations. The successful candidate will work closely with internal teams and clients to drive innovation in agentic systems and workflow automation.

Key Responsibilities

• Solution Architecture: Design and develop AI-based solutions, including agentic systems and workflow automation tools integrated within the data ecosystem.
• Data Pipeline Development: Build and optimize data pipelines for structured and unstructured data within the Microsoft Fabric environment.
• API Integration: Implement and maintain integrations with various APIs, ensuring reliable data flow into the data warehouse.
• AI Implementation: Develop and deploy solutions using OpenAI and similar APIs, integrating generative AI capabilities into business processes.
• Product Innovation: Lead the creation of experimental products, including AI agents for workflow automation and content marketing engines.
• Data Validation: Address and resolve data validation challenges within the medallion architecture to ensure accurate data publication to the gold layer.
• Client Collaboration: Work directly with internal teams and clients to gather requirements and present solutions.
• Documentation & Knowledge Sharing: Create comprehensive documentation and mentor junior team members to foster knowledge sharing.

Required Skills

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
• 5+ years of experience in data engineering or similar roles.
• Strong experience with Microsoft Azure data services, including Fabric, Data Factory, Azure SQL Database, and Power BI.
• Hands-on experience with agentic AI systems and automation frameworks.
• Strong programming proficiency in Python and SQL.
• Expertise in data warehouse design and implementation.
• Experience with API integration and management.
• Ability to translate business requirements into technical solutions.
• Excellent communication skills and ability to work with stakeholders at various technical levels.
• Minimum of 3 years of experience in leading cross-functional teams and managing client relationships

Nice to Have Skills

• Experience with OpenAI API and other generative AI platforms.
• Practical experience developing and deploying AI solutions, especially those utilizing LLMs.
• Knowledge of low-code tools for customized LLM orchestration and AI agent development.
• Familiarity with document processing solutions, including OCR, NLP, and AI-based text analysis.
• Experience with cloud deployment technologies, such as Azure Functions, Kubernetes, and Terraform.
• Knowledge of no-code & low-code automation tools (e.g., n8n, Make.com, Zapier).
• Familiarity with the recruitment or HR technology industry.
• Experience medallion architecture.
• Microsoft Azure certifications.