Skip to content

About

Multi-modal AI assistant with voice mode and research tools (React + FastAPI).

Topics

Resources

Contributing

Stars

1 star

Watchers

0 watching

Forks

Latest commit

ย 

History

726 Commits

Folders and files

NameName
Last commit message
Last commit date
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿค– AssistMe - Next-Gen AI Virtual Assistant

AssistMe Banner

A production-ready, multi-modal AI platform featuring Advanced Voice Mode, Deep Research (Grokipedia), and Neural Speed Diagnostics.

React Vite FastAPI Python Tailwind CSS License

Live Demo โ€ข Report Bug โ€ข Request Feature

Screenshots

Framed captures of the live app (current UI).

AssistMe chat home with sidebar and prompt cards Imagine Studio with a digital art prompt Grokipedia Deep Research topic explorer Gemini Live Voice idle screen

๐ŸŒŸ Overview

AssistMe isn't just a chatbot; it's a comprehensive AI workspace designed for power users. Built on a modern React + FastAPI architecture, it integrates state-of-the-art LLMs (Gemini, Claude, GPT, Grok) with custom neural modules for specific tasks like deep research, image generation, and network diagnostics.

The latest update introduces a massively reorganized codebase, enterprise-grade architecture, and powerful new "applets" within the assistant.


๐Ÿ”ฅ Key Features

๐Ÿง  Grokipedia (Deep Research)

A revolutionary "Search & Synthesis" engine that generates comprehensive, wiki-style articles on any topic.

  • Deep Web Search: Aggregates data from multiple sources.
  • AI Synthesis: Generates deep-dive articles with citations.
  • Streaming Architecture: Real-time content generation with visible thought process.

๐ŸŽ™๏ธ Advanced Voice Mode

Real-time, natural conversation with aggressively optimized latency.

  • Live Integration: Zero-latency turn-taking.
  • "Thinking" Filter: Scrubbing of internal chain-of-thought for pure speech output.
  • Visual Feedback: Dynamic audio visualizers synchronized to speech.

๐ŸŽจ Imagine Studio

A complete generative art workstation built right into the chat.

  • Multi-Model Support: Flux, DALL-E, Stable Diffusion.
  • Style Presets: One-click styles for Anime, Digital Art, Photorealism, and 3D Render.
  • Smart Prompting: Automatic prompt enhancement for better results.

โšก Speedtest Ultra

A professional-grade network diagnostic tool.

  • Neural Diagnostics: Analyzes connection quality for specific use cases (Gaming, 4K Streaming).
  • Granular Metrics: Measures Jitter, Bufferbloat, and Packet Loss alongside speed.
  • Real-time Graphs: Visualization of TCP stream stability.

๐Ÿ‡ฎ๐Ÿ‡ณ Native Multilingual Support

First-class support for Indian languages.

  • 22+ Languages: Hindi, Marathi, Tamil, Telugu, Gujarati, and more.
  • Script Handling: Correct rendering of complex Indic scripts.
  • Cultural Nuance: Localized context understanding.

๐Ÿ—๏ธ Architecture

AssistMe follows a clean, modular architecture designed for scalability.

graph TD
    User[User] --> Frontend[React + Vite Frontend]
    Frontend --> |REST/WS| Backend[FastAPI Backend]
    
    subgraph Frontend
        Components[UI Components]
        Services[Service Layer]
        Context[State Management]
    end
    
    subgraph Backend
        Router[API Router]
        ServiceLogic[Business Logic]
        Providers[LLM Integrations]
    end
    
    Backend --> OpenRouter[OpenRouter API]
    Backend --> Gemini[Google Gemini API]
    Backend --> Tavily[Tavily Search API]
Loading

Directory Structure

Directory Purpose
src/components/features Standalone feature modules (Voice, Speedtest, Grokipedia)
src/services Centralized API wrappers and data fetching logic
src/context Global state management (Theme, Auth)
backend/app/routes API endpoint definitions
backend/app/providers LLM provider abstraction layer

๐Ÿš€ Getting Started

Prerequisites

  • Node.js
  • Python
  • API Keys: OpenRouter (Required), Google Gemini & Tavily (Recommended)

Installation

  1. Clone the repo

    git clone https://github.com/mangeshraut712/AssistMe-VirtualAssistant.git
    cd AssistMe-VirtualAssistant
  2. Install Frontend

    npm install
  3. Install Backend

    cd backend
    python -m venv venv
    source venv/bin/activate  # Windows: venv\Scripts\activate
    pip install -r requirements.txt

Configuration

Create a .env file in backend/:

OPENROUTER_API_KEY=sk-or-v1-...
GOOGLE_API_KEY=AIzaSy...      # For Voice & Imagine
TAVILY_API_KEY=tvly-...       # For Grokipedia

Running the App

Development Mode (Concurrent):

# In Root
npm run dev

# In Backend/
python -m uvicorn app.main:app --reload --port 8001

๐ŸŒ Hosting

The Vite frontend is deployed to free GitHub Pages from GitHub Actions (Deploy GitHub Pages workflow). Production URL:

https://mangeshraut712.github.io/AssistMe-VirtualAssistant/

The old Vercel site (https://assist-me-virtual-assistant.vercel.app/) is paused/blocked and is no longer the production host. The repository does not overwrite third-party deployment statuses. If the Vercel GitHub App still posts a failing check, an administrator must disconnect it and update any required-status rule in GitHub repository settings.

GitHub Pages is static only. It does not run FastAPI, Node serverless functions, or environment secrets.

Backend (not on Pages)

API features (chat, TTS, images, auth) require a separate process:

  • Local / self-host: FastAPI in backend/ (uvicorn app.main:app --port 8001). See backend/README.md.
  • Former Vercel serverless: files under api/ were for Vercel and are not served by GitHub Pages. See api/README.md.

Point the frontend at a backend URL you control (for example via env / settings) if you host the API elsewhere. There is no paid hosting in this setup.


๐Ÿ› ๏ธ Tech Stack

Frontend

  • Framework: React, Vite
  • Styling: Tailwind CSS
  • Animation: Framer Motion
  • Icons: Lucide React
  • State: React Context + Hooks

Backend

  • Framework: FastAPI
  • Server: Uvicorn (ASGI)
  • Validation: Pydantic
  • Network: httpx, aiohttp

๐Ÿค Contributing

We welcome contributions! Please see our CONTRIBUTING.md for details on how to get started, our code of conduct, and submission guidelines.

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

๐Ÿ“„ License

Distributed under the MIT License. See LICENSE for more information.


Built with โค๏ธ by Mangesh Raut
GitHub Profile โ€ข Live Demo


Project Diagram

flowchart LR
    A["Browser"] --> B["Frontend App"]
    B --> C["API / Serverless"]
    C --> D["Deploy"]
Loading

High-level flow of the deployed web experience and supporting services.

About

Multi-modal AI assistant with voice mode and research tools (React + FastAPI).

Topics

Resources

Contributing

Stars

1 star

Watchers

0 watching

Forks

Releases

Sponsor this project

Packages

Used by

Contributors

Languages