Microsoft Foundry Specialist — AI/ML Engineer (10+ Years)

Hi ,

Hope you are doing great!

We have the below urgent position with my client. Please reply if you are interested.

Job Role : Microsoft Foundry Specialist — AI/ML Engineer

Location: USA (Remote)

Fulltime

About Us

We are a small, Agile/Scrum team delivering AI and digital transformation solutions to enterprise clients, including Fortune 500 businesses. Our team thrives on collaboration, innovation, and the freedom to experiment with the latest technologies. We move fast, stay curious, and take pride in delivering expert-level work to organizations navigating the rapidly evolving AI landscape.

About the Role

We are seeking a Microsoft Foundry Specialist with deep expertise in machine learning, deep learning, and large language models, combined with extensive hands-on experience on the Microsoft Foundry platform (formerly Azure AI Foundry / Azure AI Studio). You will design, build, and deploy production-grade AI solutions leveraging Foundry's unified ecosystem of models, agents, tools, and governance capabilities for enterprise clients.

What You'll Do Day-to-Day

• Design and implement end-to-end AI solutions on the Microsoft Foundry platform, leveraging the model catalog (11,000+ models including OpenAI GPT, Anthropic Claude, Meta Llama, Mistral, and open-source options) to select, benchmark, and deploy the optimal models for each client use case.

• Build and orchestrate intelligent agents using Foundry Agent Service, including single-agent flows (Foundry Classic), multi-agent workflows with visual orchestration, and hosted agent deployments using frameworks such as LangGraph, Semantic Kernel, and AutoGen.

• Implement Retrieval-Augmented Generation (RAG) architectures using Foundry IQ (powered by Azure AI Search), including knowledge base configuration, grounding pipelines, citation-backed responses, and agentic RAG patterns with user access permission enforcement.

• Fine-tune foundation models for domain-specific tasks using Foundry's fine-tuning capabilities, including dataset preparation, hyperparameter optimization, training pipeline configuration, and evaluation of fine-tuned model performance against baseline benchmarks.

• Design and execute evaluation pipelines using Foundry's built-in evaluation tools, including automated quality loops (dataset creation, evaluation creation, evaluation comparison), red teaming exercises, and behavioral alignment assessments.

• Integrate AI solutions with enterprise systems using Foundry Tools, MCP (Model Context Protocol) servers, and Azure Logic Apps connectors to enable seamless connectivity to platforms such as SAP, Salesforce, Dynamics 365, and custom APIs.

• Implement AI governance and observability practices using Foundry Control Plane, Microsoft Defender integration, Entra ID for identity and access management, and Azure Policy for fleet-wide enforcement.

• Leverage Foundry's memory capabilities to build agents with long-term context retention, automatic extraction and consolidation, and tailored user experiences across sessions.

• Collaborate with cross-functional teams to translate business requirements into technical AI architectures, produce detailed design documentation, and guide clients from proof-of-concept through production deployment.

• Participate in Agile ceremonies including sprint planning, standups, and retrospectives with the delivery team.

• Required Qualifications

• 7+ years of experience in machine learning, deep learning, or AI engineering, with at least 2 years of hands-on experience on Azure AI Foundry or Microsoft Foundry.

• Strong theoretical and applied expertise in ML/DL fundamentals: neural network architectures (transformers, CNNs, RNNs, GANs), training methodologies, optimization algorithms, regularization techniques, and model evaluation metrics.

• Deep understanding of large language models, including transformer architecture, attention mechanisms, tokenization, prompt engineering, fine-tuning (LoRA, QLoRA, full fine-tuning), and inference optimization (quantization, distillation, speculative decoding).

• Production experience deploying models at scale using Azure ML managed endpoints, Foundry model deployments, and container-based serving infrastructure (AKS, Container Apps).

• Proficiency in Python with strong experience in ML frameworks (PyTorch, TensorFlow/Keras) and AI orchestration libraries (LangChain, LangGraph, Semantic Kernel).

• Hands-on experience with RAG architectures, including vector databases, embedding models, chunking strategies, hybrid search (keyword + semantic), and reranking pipelines.

• Solid understanding of MLOps practices: CI/CD for ML pipelines, model versioning, experiment tracking, automated retraining, and drift monitoring.

• Experience implementing responsible AI practices, including fairness assessments, content filtering, toxicity detection, and model transparency reporting.

Preferred Qualifications

• Microsoft certifications: Azure AI Engineer Associate (AI-102), Azure Data Scientist Associate (DP-100), or Azure Solutions Architect Expert (AZ-305).

• Experience with Foundry's latest capabilities: Agent-to-Agent (A2A) protocol, Foundry MCP Server, Model Router, and the unified azure-ai-projects SDK (v2).

• Background in specific industry AI applications such as financial services, healthcare, manufacturing, or energy.

• Experience with multi-modal AI systems (vision, speech, text) and generative media models.

• Contributions to open-source ML/AI projects or published research in ML/AI conferences or journals.

• Familiarity with competitive AI platforms (AWS SageMaker, Google Vertex AI) for comparative solutioning.

Education

• Bachelor's degree in Computer Science, Data Science, Mathematics, Statistics, Engineering, or a related field required.

• Master's or Ph.D. in Machine Learning, Artificial Intelligence, or a related discipline preferred.

• Equivalent professional experience, publications, or open-source contributions will be considered in lieu of formal education.

What We Offer

• Competitive salary and comprehensive benefits package

• Fully remote work environment

• Predictable Monday–Friday, 9:00 AM – 5:00 PM ET schedule with weekends off

• A small, collaborative Agile/Scrum team where your voice matters

• Work with Fortune 500 clients and cutting-edge enterprise AI challenges

• Freedom to experiment and learn with the latest technologies

• Professional development support and continuous learning opportunities

Thanks, and Regards

Saurabh Kumar | Team Lead

saurabh.yadav@ampstek.com | www.ampstek.com

https://www.linkedin.com/in/saurabh-kumar-yadav-518927a8/

Call to : +1 609-360-2671