AI Webapp Developer for Avatar Creation

Role Overview

We are seeking a skilled AI Webapp Developer to bring to life a personalized AI avatar. This project involves creating a web application that embodies the voice and personality of an individual, using advanced AI techniques and existing audio recordings. The objective is to develop an interactive avatar that provides unscripted, personalized responses based on previously recorded Q&A sessions.

Responsibilities

• Set up a vector database to store and manage cleaned Q&A transcripts efficiently using platforms such as Pinecone or Chroma.
• Develop a basic chat frontend that utilizes Retrieval-Augmented Generation (RAG) to fetch relevant documents and generate responses using a Language Model (LLM).
• Fine-tune an LLM using Q&A pairs as training data to ensure consistent and personalized responses that reflect the individual's personality and voice.
• Integrate voice cloning technology with ElevenLabs to convert text outputs into audio that authentically replicates the individual's voice.
• Sync the audio output with a visual avatar using platforms such as D-ID.
• Implement a feedback and updating process to refine and enhance the avatar's responses based on user interaction and additional data.

Required Skills

• Experience with vector databases and managing large datasets effectively.
• Proficiency in developing chat frontends and implementing retrieval-augmented generation processes.
• Skills in fine-tuning language models and working with AI training data.
• Knowledge of voice cloning technologies and integration with audio models.
• Familiarity with avatar synchronization and visual presentation tools.

Nice to Have

• Experience with platforms like Pinecone, Chroma, ElevenLabs, and D-ID.
• Background in AI personalization and understanding of maintaining personality consistency in AI outputs.