Skip to content
b1ink0Public

About

VAssist - Local First cross-platform AI Assistant & Interactive 3D Companion

Topics

Resources

Contributing

Stars

1 star

Watchers

1 watching

Forks

Latest commit

 

History

204 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

VAssist Logo

VAssist

Chat, page tools, and a Live Assistant across desktop, Android, browser extension, web, and XR.

What VAssist Does

VAssist Overview
  • Full chat for longer conversations, saved threads, attachments, alternate replies, and voice.
  • On-page tools for rewrite, summarize, translate, dictation, writing, and image actions without leaving the page.
  • Live Assistant that stays on screen, speaks, and works with your own MMD assets.
  • Customizable stages with time of day, seasonal effects, and floating controls in experimental XR.

Choose local or remote providers for chat, speech input, and speech output. You can mix them to suit your setup.

View the full documentation ->

Full Chat

Chat Interface

The main chat view handles streaming replies, page context, attachments, voice mode, and history branching.

Live Assistant

Live Assistant

Keep the assistant visible while you work, swap models or stages on the fly, and reuse the same avatar as an Android live wallpaper.

Use the desktop assistant in an app, as a floating companion, or as a live wallpaper on Windows. Desktop and Android include built-in wallpapers, and you can choose your own images too.

XR

Use your avatar, stages, and chat in VR, independently in a browser or paired with the desktop app. XR support is experimental.

XR setup and controls →

AI Toolbar

AI Toolbar

Select text or focus an input to rewrite, summarize, translate, dictate, or run image actions in place.

Choose a Version

Version Best if you want What you get
Desktop app Everything in one desktop app On-device LLM support, on-device speech input, on-device speech output, camera and screen share, and tray integration
Android app VAssist on a phone or tablet On-device LLM support, on-device speech input, on-device speech output, shared app and wallpaper settings, and live wallpaper mode
Browser extension VAssist inside the sites you already use Page-aware chat, on-page tools, and Chrome AI support where available
Standalone web app Use VAssist in a browser without installing an app Browser storage, configurable AI and speech providers, and the shared chat and Live Assistant interface
Experimental XR Use the assistant in VR Floating controls, avatars and stages, with optional desktop pairing
Browser embed packages Embed VAssist in your own web app @vassist/react for React hosts and @vassist/embed for JavaScript hosts. Currently available only inside this Bun workspace

Embed in Your Own App

The @vassist/react and @vassist/embed packages are not published on npm yet. Their source is available as Bun workspaces in this repository. They provide the shared browser runtime, configurable UI and provider settings, and host bridges. Electron and Android native services remain specific to those apps.

Package integration docs →

Model and Voice Support

Capability On-device or built-in options Remote or hosted options
Chat and main AI Desktop: GGUF through llama-server (default) or node-llama-cpp. Android: native llama.cpp or LiteRT-LM for supported models. Browser and extension: Chrome AI where available. OpenAI, Ollama, and OpenAI-compatible servers
Speech output Desktop: GPT-SoVITS or Supertonic 3. Android: sherpa-onnx voice packs, including VITS, Kitten, and Supertonic 3. Kokoro is also available in the browser, extension, and desktop. GPT-SoVITS Remote, OpenAI TTS, and OpenAI-compatible TTS
Speech input Desktop: whisper.cpp (default) or faster-whisper. Android: sherpa-onnx Whisper, SenseVoice, or Dolphin. Browser and extension: Chrome AI speech input where supported. OpenAI Whisper and OpenAI-compatible STT

The AI and Media Stack guide goes deeper on the engines and file formats behind those options.

Installation

Install From Releases

Download artifacts from releases:

  • Desktop App: install the desktop installer package for your OS
  • Android App: install the APK on your Android device
  • Browser Extension: download vassist-extension.zip
Extension install (Chrome)
  1. Download vassist-extension.zip from releases.
  2. Extract the zip file.
  3. Open chrome://extensions.
  4. Enable Developer mode (top-right toggle).
  5. Click Load unpacked.
  6. Select the extracted folder.

If you are not sure where to start, use the installation guide.

Build From Source

Use Bun to install dependencies and run project commands. Additional requirements depend on the version you want to build.

Requirements

  • Bun 1.3.5
  • Git

Platform Requirements

Target Additional requirements
Browser extension Chrome to load and use the extension
Android Android Studio and the Android SDK
Windows desktop package Windows, Node.js, Python, Visual Studio C++ build tools with MSVC v143, and a Windows SDK

Windows desktop packaging builds a native addon for live-wallpaper support. See the native addon build guide for details.

Setup

git clone https://github.com/b1ink0/vassist.git
cd vassist
bun install

Common Commands

Goal Command
Standalone web app bun run dev
Extension watch build bun run dev:extension
Desktop renderer bun run dev:desktop
Android web build + Capacitor sync bun run dev:android
Docs site with embedded assistant bun run docs:dev
Lint bun run lint
App typecheck bun run typecheck:app

Production Builds

  • Standalone web: bun run build
  • Experimental XR: bun run build:xr
  • Extension: bun run build:extension or bun run build:extension:zip
  • Desktop renderer: bun run build:desktop:production
  • Windows desktop package: bun run build:desktop:win
  • macOS desktop package: bun run build:desktop:mac
  • Android: bun run build:android
  • Docs: bun run docs:build

Contributing

See CONTRIBUTING.md for development setup and guidelines.

Stack

  • React
  • Vite
  • Electron
  • Capacitor for Android
  • Babylon.js and babylon-mmd
  • Dexie
  • Kokoro.js
  • node-llama-cpp
  • llama.cpp
  • Express and NanoHTTPD
  • @vassist/react and @vassist/embed browser packages (Bun workspace, not yet published)

Licenses

GPL-3.0. See LICENSE.

Links

Issues • Discussions • Docs

About

VAssist - Local First cross-platform AI Assistant & Interactive 3D Companion

Topics

Resources

Contributing

Stars

1 star

Watchers

1 watching

Forks

Releases

Contributors

Languages