ArchivedPythonGemini LiveYOLOv11OSC

Project Gabriel

Open-source Python framework originally built for Gabriel, an AI that hangs out in VRChat. Now it's a general-purpose framework anyone can use. Gemini Live handles vision, YOLOv11 does player following and detection.

View on GitHubWatch Tutorial

This repo was archived on January 7, 2026. Code's still there if you want to look at it or fork it.

What it does

Project Gabriel Framework is the Python framework behind Gabriel, a live AI that hangs out in VRChat. It handles audio routing, OSC, vision stuff, and memories so the AI can remember people and conversations.

Originally built specifically for Gabriel, then cleaned up into something anyone can use for their own VRChat AI projects.

Capabilities

Live Audio

Two-way audio streaming so the AI can actually talk to people in VRChat.

Vision & Detection

Uses Gemini Live for vision. YOLOv11 handles following players around and spotting things.

OSC

Moves around, does gestures, and types in the chatbox through OSC.

Memory System

Can remember people and past conversations for more natural interactions.

Getting started

There's a setup script that handles environment creation and deps on Windows. Just clone and run:

# Clone and install
git clone https://github.com/HoppouAI/ProjectGabriel-Framework.git
cd ProjectGabriel-Framework
setup.bat
All projects