Senior AI Infrastructure Developer (LangChain / Ray / FastAPI) – Distributed Cognitive System MVP

We’re building a distributed AI system that acts as a cognitive engine — capable of orchestrating multiple intelligent agents that can read, interpret, and edit data across different platforms (web apps, CRMs, and automation tools) in real time.

This project aims to create the core infrastructure for a next-generation AI operations layer, where each agent functions as an autonomous node with distributed memory and communication capabilities.

We’re looking for a Senior AI Infrastructure / Backend Developer to design and build the foundation for this architecture — scalable, modular, and ready for future integration with our existing CRM + chatbot platform.

Responsibilities

• Design and implement distributed AI nodes using Ray or Ray Serve for scalable parallel processing.
• Develop FastAPI-based microservices that allow agents to read, interpret, and modify structured data (e.g., MongoDB, APIs, Google Sheets).
• Implement multi-agent orchestration and contextual memory using LangChain or equivalent frameworks.
• Define a robust data communication layer (WebSockets, Redis, or similar) to synchronize agent activity.
• Deliver an MVP demonstrating one agent capable of autonomous reading/editing tasks, plus documentation for scalability.

Technical Stack

Core: Python, FastAPI, LangChain, Ray / Ray Serve, MongoDB
Preferred: Redis, Docker, WebSockets, REST APIs, modular microservices
Bonus: Experience with automation (Zapier, Make, or custom connectors), distributed memory systems, or event-based architectures.

Deliverables – Phase 1 (MVP)

• Working architecture of distributed agents (minimum 1 fully functional node).
• API endpoints for data reading/writing operations.
• Technical documentation + roadmap for Phase 2 scalability.

Phases and Budget

• Phase 1 (MVP): $1,800 – $2,500 USD (4–6 weeks)
  Goal: core architecture + one working agent prototype.
• Phase 2 (Expansion): $3,000 – $5,000 USD (optional next contract)
  Goal: multi-agent orchestration, CRM integration, and automation layer.

Ideal Candidate

• 5+ years of backend or AI infrastructure experience.
• Deep understanding of distributed systems, modular API design, and asynchronous workflows.
• Experience deploying intelligent agents, or enthusiasm for experimental AI infrastructure projects.
• Self-driven, curious, and able to work autonomously with minimal supervision.

Additional Info

Location: Worldwide (remote)
Work Hours: Flexible / No preference
Engagement: Project-based, with potential long-term collaboration
Compensation: $1,800 – $2,500 (Phase 1 MVP)

If you’re passionate about building distributed AI systems and want to help design the foundation for a scalable cognitive network, we’d love to collaborate.