Experimental — Work in Progress

Your virtual world,
powered by Agentic AI

A Docker stack for OpenSimulator that integrates MCP servers, a bot client, Blender, Opencode and pretty much any AI provider or model you want to use.

You can build, manage, and explore your grid, all aided by a voice capable bot. Your assistant can spawn other more specialised bots. You can even create new 3D assets and import them into the world, and iterate in-world from natural-language workflows.

OpenSimulator Chat

Features

Everything you need to run an AI-enabled OpenSimulator grid in one Docker stack.

Agentic Behaviour

The AI doesn't just answer questions — it plans, decides, and acts. It can chain together console commands, in-world actions, and external tools to complete multi-step goals on its own.

Natural Language Control

Manage regions, users, and configuration through conversation. Anything the OpenSimulator console can do, your AI can do.

Web Interface

Use the web interface to manage the stack, including users, simulators, and bots. It also includes a simple user approval system and an easy setup wizard.

In-World AI Bot

A bot avatar logs in and accepts IM instructions. It can walk, run, fly, teleport, build prims, and manage inventory.

Voice-Ready Bot

Give your AI bot a voice and let it speak in-world with low-latency Piper synthesis streamed via Janus WebRTC.

Support for speech-to-text is planned.

Build & Create

Create, position, scale, rotate, and texture prims. Configure environment settings and upload media — all through the bot.

MCP Bridges

Three MCP servers power the stack: REST console admin, in-world bot control, and Blender authoring tools. The spawner adds bot lifecycle control on top.

Docker Simplicity

One compose file brings up OpenSimulator, MariaDB, MCP sidecars, Opencode, and opensim-spawner. Bots run in their own containers with resource limits.

Flexible AI Providers

Switch models and providers at runtime with star commands. Use GitHub Copilot, local models, or any provider Opencode supports.

The Stack

Open-source components wired together to create an AI-native virtual world.

Architecture Diagram

Core runtime with on-demand multi-bot containers, MCP bridges, and the voice transport path in one view.

flowchart TB
  User[Viewer user] -->|IM commands| Bot[Bot avatars in OpenSimulator]
  Blender[Blender desktop app] -->|Author and export GLB/GLTF| OpenSim[opensim container]

  subgraph MCP["MCP Bridge Side"]
    Console[opensim-console2mcp]
    BlenderMCP[opensim-blender via blender-mcp]
  end

  Spawner[opensim-spawner]
  Piper[opensim-piper]
  Janus[opensim-janus]

  subgraph BotRuntime["Per-bot runtime (0..N)"]
    MetaverseN[opensim-metaverse2mcp]
    OpencodeN[opensim-opencode]
    MetaverseN <-->|MCP tools| OpencodeN
  end

  OpenSim -->|REST console| Console
  Spawner -->|Create/delete bot runtimes| MetaverseN
  Spawner -->|Create/delete bot runtimes| OpencodeN
  MetaverseN -->|Bot login and world actions| OpenSim
  BlenderMCP -->|Drive Blender tools| Blender
  MetaverseN -->|TTS over HTTP| Piper
  MetaverseN -->|WebRTC voice session control| Janus
  Piper -->|Synthesized audio stream| Janus
  Janus <-->|WebRTC voice transport| Bot
  Bot -->|Voice replies| User

  OpencodeN <-->|MCP tools| Console
  OpencodeN <-->|MCP tools| BlenderMCP
  Provider[AI provider/model] <-->|Model calls| OpencodeN
        

Ready to deploy your own grid?

Get the stack running in minutes with Docker Compose, then log in and start talking to your AI bot.