β οΈ Alpha / Proof of Concept β This project is in early alpha and is not production-ready. It represents a working concept and exploration of ideas around AI-assisted development environments. Expect rough edges, missing features, and breaking changes. Contributions, feedback, and experimentation are welcome β but treat this as a starting point, not a finished product.
An AI-powered coding agent with voice-to-text capabilities, built on VS Code's open-source foundation. Beast Mode allows you to control your development environment through voice commands and leverage powerful AI models via Ollama for autonomous coding tasks.
- π€ Voice-to-Text Integration: Control your IDE with voice commands using Whisper
- π€ AI-Powered Coding Agent: Autonomous code generation, refactoring, and debugging
- π Multiple AI Models: Switch between different Ollama models on the fly
- β‘ Autonomous Execution: Execute commands without intervention based on prompts
- π― Wake Word Detection: Activate with "beast" or customize your own wake word
- π Full File System Control: Create, edit, and delete files through voice or text
- π§ Command Execution: Run terminal commands directly from voice prompts
- π Open Source: Built entirely with open-source technologies
- Node.js (v18 or higher)
- Ollama - Install from ollama.ai
- Whisper.cpp or OpenAI Whisper for speech recognition
- Sox for audio recording (macOS:
brew install sox)
- Clone and navigate to the project:
cd ~/beast_mode- Install dependencies:
npm install- Install Ollama models:
ollama pull codellama
ollama pull llama2
ollama pull mistral- Install Whisper (choose one):
Option A: Whisper.cpp (Recommended)
git clone https://github.com/ggerganov/whisper.cpp
cd whisper.cpp
make
./models/download-ggml-model.sh baseOption B: OpenAI Whisper
pip install openai-whisper- Compile the extension:
npm run compile- Open the project in VS Code
- Press
F5to launch the extension in a new VS Code window - In the new window, open a workspace/folder
- Activate Beast Mode with
Cmd+Shift+V(Mac) orCtrl+Shift+V(Windows/Linux)
- Start Voice Input:
Cmd+Shift+Vor "Beast Mode: Start Voice Input" - Select AI Model: "Beast Mode: Select AI Model"
- Execute Prompt: "Beast Mode: Execute Prompt"
Once voice input is active, say:
"Beast, create a new Python API that handles user authentication"
"Beast, refactor this function to use async/await"
"Beast, install express and create a REST API with CRUD operations"
"Beast, debug the error in app.js and fix it"
You can also use text-based prompts:
- Open Command Palette (
Cmd+Shift+P) - Select "Beast Mode: Execute Prompt"
- Enter your command
Configure Beast Mode in VS Code settings:
{
"beastMode.ollamaUrl": "http://localhost:11434",
"beastMode.defaultModel": "codellama:latest",
"beastMode.wakeWord": "beast",
"beastMode.autoExecute": true,
"beastMode.whisperModel": "base",
"beastMode.voiceLanguage": "en"
}- ollamaUrl: Ollama API endpoint (default:
http://localhost:11434) - defaultModel: Default Ollama model for coding tasks
- wakeWord: Wake word to activate voice commands (default:
beast) - autoExecute: Automatically execute commands without confirmation
- whisperModel: Whisper model size (
tiny,base,small,medium,large) - voiceLanguage: Language code for voice recognition (default:
en)
beast_mode/
βββ src/
β βββ extension.ts # Main extension entry point
β βββ agent/
β β βββ aiAgentManager.ts # AI agent orchestration
β β βββ taskParser.ts # Parse AI responses into tasks
β βββ executor/
β β βββ commandExecutor.ts # Execute file/command operations
β βββ ollama/
β β βββ ollamaClient.ts # Ollama API client
β βββ voice/
β βββ voiceInputManager.ts # Voice input coordination
β βββ whisperTranscriber.ts # Speech-to-text transcription
βββ package.json
βββ tsconfig.json
npm run compilenpm run watchnpm testContributions are welcome! This project is built on open-source principles.
- Fork the repository
- Create a feature branch
- Make your changes
- Submit a pull request
- Enhanced wake word detection with custom training
- Multi-language support for voice commands
- Integration with additional AI providers
- Visual feedback for AI agent actions
- Conversation history and context management
- Plugin system for custom commands
- Web-based UI for configuration
- Docker containerization
- Cloud deployment options
Ensure Ollama is running:
ollama serveCheck available models:
ollama list- Verify Sox is installed:
sox --version - Check microphone permissions in System Preferences
- Test Whisper installation:
whisper --help
- Check VS Code version compatibility (requires 1.85.0+)
- Rebuild the extension:
npm run compile - Check the Output panel for errors
GNU Affero General Public License v3.0 (AGPL-3.0)
Beast Mode is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.
This means: if you run a modified version of Beast Mode over a network (e.g. as a hosted service), you must release the complete corresponding source code to users of that service. See the LICENSE file for full terms.
- Built on VS Code OSS
- Powered by Ollama
- Speech recognition via Whisper
- Inspired by Windsurf
For issues, questions, or suggestions:
- Open an issue on GitHub
- Check the troubleshooting section
- Review the configuration options
Beast Mode - Unleash the power of AI-driven development! π¦