Senior Data Scientist – GenAI | LLM | RAG | Azure

Job Title: Senior Data Scientist – GenAI | LLM | RAG | Azure

Location: Atlanta GA

Employment Type: Remote - W2

About Us

Conglomerate IT is a certified and a pioneer in providing premium end-to-end Global Workforce Solutions and IT Services to diverse clients across various domains. Visit us at http://www.conglomerateit.com

Our mission is to establish global cross culture human connections that further the careers of our employees and strengthen the businesses of our clients. We are driven to use the power of global network to connect business with the right people without bias. We provide Global Workforce Solutions with affability.

Job Summary

We're seeking a seasoned Data Scientist with proven hands-on experience in crafting and launching solutions using Generative AI (GenAI), especially focused on Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG)

Key Responsibilities

• Design and deploy GenAI solutions leveraging LLMs on Azure OpenAI and Databricks, including end-to-end RAG pipelines with document ingestion, embedding generation, and vector database integration.
• Create prototypes and proof-of-concepts demonstrating GenAI applied to real-world scenarios
• Leverage Azure AI tools such as Azure ML, Data Lake Storage, and AI Foundry for solution development
• Use tools like Streamlit or Gradio to build intuitive UIs for demonstrating AI models
• Work collaboratively across teams while being capable of managing projects without dependency on SRE or platform teams
• Integrate DevOps best practices using GitHub Actions, Azure DevOps, or similar CI/CD tools
• Analyze and articulate how transformer-based models (e.g., BERT, GPT) function in the context of RAG pipelines

Required Skills & Experience

• Proficiency in Python for developing APIs, handling data workflows, and training/deploying ML models

• Practical experience with:

• Azure OpenAI (including chat models, embeddings, and fine-tuning capabilities)

• Azure Databricks (notebook usage, model experimentation, pipeline design)

• Azure ML services and pipelines

• Azure Data Lake for scalable data storage

• DevOps pipelines using GitHub or Azure DevOps

• Solid foundation in working with vector databases such as Pinecone or Chroma within RAG frameworks

• Demonstrated experience in taking RAG systems into production

• Basic UI development skills using tools like Streamlit or Gradio to present models effectively

• Working knowledge of transformer networks like GPT and BERT

• Comfort operating in an agile, startup-style environment with evolving priorities

Preferred Qualifications

• Experience developing GenAI-based chatbots using Databricks or cloud-native platforms
• Familiarity with Azure AI Foundry and a solid grasp of prompt engineering and context management techniques for LLMs.

Founded in 2014, ConglomerateIT is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.

ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.

As a strategic extension of ConglomerateIT, Conglomerate Healthcare specializes in international healthcare recruitment. Leveraging our global reach and deep industry expertise, we connect healthcare organizations with top-tier talent, including Physicians, Nurses, and Medical Technicians. Our carefully curated talent pool includes Western-qualified Physicians, licensed Nurses, and highly skilled Medical Technicians who bring excellence and expertise to healthcare facilities worldwide.

Key Healthcare Services

• Physicians Recruitment: We connect healthcare facilities with Western-qualified physicians who deliver exceptional expertise and care.
• Nurses Recruitment: We identify and place highly qualified licensed nurses who meet the highest standards of care.
• Medical Technician Recruitment: We provide healthcare institutions with access to certified and skilled medical technicians who support critical healthcare operations.

Conglomerate Healthcare operates as an integral part of ConglomerateIT's mission to deliver excellence across multiple sectors, further solidifying our position as a global leader in recruitment and IT solutions.