3D Conversational Avatar
Autonomous and intelligent 3D conversational virtual assistant. Developed for LotoStudios to innovate customer support.
Company context: Development of a scalable 3D conversational avatar platform for multi-client adoption.
Project Sheet & Impact
Orchestration Pipeline
From the user's voice to the avatar's spoken reply, in a single low-latency real-time flow.
User Speech
User speaks to the avatar directly in the browser
Speech-to-Text
Real-time transcription of audio into text
Knowledge Retrieval (RAG)
Pulls verified answers from the client's continuously updated site content
LLM Reasoning
OpenAI crafts contextual replies and guides the conversation
Cloud Orchestration
High-concurrency, low-latency Node.js backend
Natural Voice (Polly)
AWS Polly turns the reply into natural speech
Live 3D Avatar
Drop-in web component on the client site: the 3D avatar speaks in lip-sync
Sample Conversation
Infrastructure & Integrations
As the Backend AI Engineer for LotoStudios, I developed the entire intelligence layer and backend infrastructure from scratch. The main challenge was engineering a low-latency real-time experience, pairing LLM reasoning with user tracking, and orchestrating dynamically generated audiovisual streaming.
Tech & Infrastructure
Key Contributions
Lead backend, integrations, AI services, and DevOps with end-to-end ownership of architecture, implementation, and deployment.
Design and maintain a modular Node.js integration layer deployable across websites with different tech stacks.
Built backend workflows for automated scraping, text chunking, embedding generation, retrieval logic, and dynamic speech synthesis.
Implemented voice generation workflows with Amazon Polly and managed multi-tenant asset delivery on AWS S3.
Operate CI/CD, environment configuration, and infrastructure optimization to support scalability and maintainability.