What it does
Gabriel is a live AI that hangs out in VRChat. This is the 2026 rebuild from scratch. Same concept as the original but way more features, cleaner code, and a lot more stable. He walks around worlds, talks to people, remembers who they are, and has his own personality system.
Everything runs through a supervisor that auto-restarts on crashes. There's a web dashboard for monitoring, a Discord bot with its own Gemini session, and a bunch of tools the AI can use like web search, music, soundboard, and VRChat API stuff.
What's new vs the original
The original was getting messy and hard to maintain. This version is a full rewrite with a cleaner architecture. Added face tracking, Discord integration, switchable personalities, autonomous wandering, emotion animations, and proper context window compression so sessions can run as long as you want.
Capabilities
Gemini Live
Real-time bidirectional audio streaming. Session resumption and context compression for unlimited session length.
Tracking
YOLOv8 for person tracking and a separate YOLOv8-face model for faces. Follows people around worlds.
VRChat
OSC for movement, gestures, chatbox, and emotions. REST API for avatar switching, friend info, and world search.
Memory
Persistent memory backed by MongoDB Atlas or SQLite. Remembers people and past conversations across sessions.
Discord Bot
Runs its own separate Gemini Live session. Can chat in Discord channels independently from the VRChat side.
Extra Stuff
Web dashboard, switchable personalities, autonomous wandering, multiple TTS providers (Gemini, Qwen3, Chirp 3 HD), API key rotation, soundboard, music.
Getting started
Once the repo is public, just clone and run the setup script. It grabs uv, creates a venv, installs everything, and copies the config files. You'll need a Gemini API key and two virtual audio cables.