From 93ab062861d9cb8b16f1f45267b6dcca9ec6c2ce Mon Sep 17 00:00:00 2001 From: "copilot-swe-agent[bot]" <198982749+Copilot@users.noreply.github.com> Date: Mon, 12 Jan 2026 08:08:54 +0000 Subject: [PATCH 1/6] Initial plan From 0385235273e9567079868de23c47fbe512d32b33 Mon Sep 17 00:00:00 2001 From: "copilot-swe-agent[bot]" <198982749+Copilot@users.noreply.github.com> Date: Mon, 12 Jan 2026 08:11:43 +0000 Subject: [PATCH 2/6] Add KaiROS AI as an example application Co-authored-by: avikeid2007 <11132795+avikeid2007@users.noreply.github.com> --- README.md | 1 + docs/Examples/KairosAI.md | 53 +++++++++++++++++++++++++++++++++++++++ mkdocs.yml | 1 + 3 files changed, 55 insertions(+) create mode 100644 docs/Examples/KairosAI.md diff --git a/README.md b/README.md index 69f84ee47..4bc0e81d7 100644 --- a/README.md +++ b/README.md @@ -77,6 +77,7 @@ The following examples show how to build APPs with LLamaSharp. - [ASP.NET Demo](./LLama.Web/) - [LLamaWorker (ASP.NET Web API like OAI and Function Calling Support)](https://github.com/sangyuxiaowu/LLamaWorker) - [VirtualPet (Desktop Application)](https://github.com/AcoranGonzalezMoray/VirtualPet-WindowsEdition) +- [KaiROS AI (Windows WPF Desktop Application)](https://github.com/avikeid2007/Kairos.local) ![LLamaSharp-Integrations](./Assets/LLamaSharp-Integrations.png) diff --git a/docs/Examples/KairosAI.md b/docs/Examples/KairosAI.md new file mode 100644 index 000000000..b465937be --- /dev/null +++ b/docs/Examples/KairosAI.md @@ -0,0 +1,53 @@ +# KaiROS AI - Windows Desktop Application + +**KaiROS AI** is a powerful local AI assistant for Windows that demonstrates how to build a production-ready desktop application using LLamaSharp. + +## Overview + +KaiROS AI is a WPF desktop application that runs LLMs (Large Language Models) locally on Windows with GPU acceleration. It showcases a complete implementation of LLamaSharp in a modern, user-friendly Windows application. + +## Key Features + +- 🤖 **Run LLMs Locally** - No internet required after model download +- 🚀 **GPU Acceleration** - CUDA 12 support for NVIDIA GPUs (RTX 50/40/30/20 series) +- 📦 **Model Catalog** - 31 pre-configured models from 9 organizations +- ⬇️ **Download Manager** - Pause, resume, and manage model downloads +- 💬 **Chat Interface** - Clean, modern UI with streaming responses +- 📊 **Performance Stats** - Real-time tokens/sec and memory usage +- 🎨 **Modern WPF UI** - Clean, responsive interface built with .NET 9 + +## Technology Stack + +- **.NET 9.0** - Latest .NET framework +- **WPF** - Windows Presentation Foundation for desktop UI +- **LLamaSharp** - Core LLM inference library +- **CUDA 12** - GPU acceleration support + +## Use Cases + +KaiROS AI demonstrates how to: + +- Build a complete desktop application with LLamaSharp +- Implement model catalog and download management +- Create a chat interface with streaming responses +- Monitor and display performance metrics +- Support GPU acceleration with CUDA +- Provide a privacy-first, offline AI experience + +## Repository + +**GitHub**: [https://github.com/avikeid2007/Kairos.local](https://github.com/avikeid2007/Kairos.local) + +## Download + +- [Download Latest Release](https://github.com/avikeid2007/Kairos.local/releases/latest) - Self-contained Windows installer +- No .NET installation required +- Supports Windows 10/11 (x64) + +## Screenshots and Documentation + +Visit the [KaiROS AI repository](https://github.com/avikeid2007/Kairos.local) for screenshots, detailed documentation, and installation instructions. + +## License + +KaiROS AI is licensed under the MIT License. diff --git a/mkdocs.yml b/mkdocs.yml index 09cb3b96b..7647a84ad 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -42,6 +42,7 @@ nav: - ChatSession - load & save: Examples/LoadAndSaveSession.md - Executor - save/load state: Examples/LoadAndSaveState.md - Quantization: Examples/QuantizeModel.md + - KaiROS AI - Windows Desktop Application: Examples/KairosAI.md - Semantic-kernel - chat: Examples/SemanticKernelChat.md - Semantic-kernel - with kernel-memory: Examples/SemanticKernelMemory.md - Semantic-kernel - basic: Examples/SemanticKernelPrompt.md From 5ef48767e06067b25140ffed67c3b45b803c2585 Mon Sep 17 00:00:00 2001 From: "copilot-swe-agent[bot]" <198982749+Copilot@users.noreply.github.com> Date: Mon, 12 Jan 2026 09:00:22 +0000 Subject: [PATCH 3/6] Initial plan From 90d7e47c5ba1f5a2456247e333a164b89d870dc1 Mon Sep 17 00:00:00 2001 From: "copilot-swe-agent[bot]" <198982749+Copilot@users.noreply.github.com> Date: Mon, 12 Jan 2026 09:02:09 +0000 Subject: [PATCH 4/6] Add new features to KairosAI.md documentation Co-authored-by: avikeid2007 <11132795+avikeid2007@users.noreply.github.com> --- docs/Examples/KairosAI.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/Examples/KairosAI.md b/docs/Examples/KairosAI.md index b465937be..e21bd4725 100644 --- a/docs/Examples/KairosAI.md +++ b/docs/Examples/KairosAI.md @@ -15,6 +15,10 @@ KaiROS AI is a WPF desktop application that runs LLMs (Large Language Models) lo - 💬 **Chat Interface** - Clean, modern UI with streaming responses - 📊 **Performance Stats** - Real-time tokens/sec and memory usage - 🎨 **Modern WPF UI** - Clean, responsive interface built with .NET 9 +- 🔌 **Built-in REST API Server** - HTTP API for integration with other applications +- 🖥️ **System Tray** - Minimize to system tray for background operation +- 🧠 **Smart Layer Allocation** - Intelligent GPU/CPU layer distribution for optimal performance +- 📁 **Custom Models** - Add your own GGUF models from local files or URLs ## Technology Stack @@ -33,6 +37,10 @@ KaiROS AI demonstrates how to: - Monitor and display performance metrics - Support GPU acceleration with CUDA - Provide a privacy-first, offline AI experience +- Expose REST API endpoints for integration with external tools +- Run in background with system tray integration +- Optimize layer allocation between GPU and CPU for best performance +- Import and manage custom GGUF models from local storage or remote URLs ## Repository From 1505e744bca3383613a1a6502f45fdc9e2819124 Mon Sep 17 00:00:00 2001 From: Avnish Kumar Date: Mon, 12 Jan 2026 21:47:56 +0530 Subject: [PATCH 5/6] Remove KaiROS AI doc, add Semantic-kernel chat example Removed the KaiROS AI Windows Desktop Application documentation page and its navigation entry. Added a new "Semantic-kernel - chat" example to the documentation navigation. --- docs/Examples/KairosAI.md | 61 --------------------------------------- mkdocs.yml | 2 +- 2 files changed, 1 insertion(+), 62 deletions(-) delete mode 100644 docs/Examples/KairosAI.md diff --git a/docs/Examples/KairosAI.md b/docs/Examples/KairosAI.md deleted file mode 100644 index e21bd4725..000000000 --- a/docs/Examples/KairosAI.md +++ /dev/null @@ -1,61 +0,0 @@ -# KaiROS AI - Windows Desktop Application - -**KaiROS AI** is a powerful local AI assistant for Windows that demonstrates how to build a production-ready desktop application using LLamaSharp. - -## Overview - -KaiROS AI is a WPF desktop application that runs LLMs (Large Language Models) locally on Windows with GPU acceleration. It showcases a complete implementation of LLamaSharp in a modern, user-friendly Windows application. - -## Key Features - -- 🤖 **Run LLMs Locally** - No internet required after model download -- 🚀 **GPU Acceleration** - CUDA 12 support for NVIDIA GPUs (RTX 50/40/30/20 series) -- 📦 **Model Catalog** - 31 pre-configured models from 9 organizations -- ⬇️ **Download Manager** - Pause, resume, and manage model downloads -- 💬 **Chat Interface** - Clean, modern UI with streaming responses -- 📊 **Performance Stats** - Real-time tokens/sec and memory usage -- 🎨 **Modern WPF UI** - Clean, responsive interface built with .NET 9 -- 🔌 **Built-in REST API Server** - HTTP API for integration with other applications -- 🖥️ **System Tray** - Minimize to system tray for background operation -- 🧠 **Smart Layer Allocation** - Intelligent GPU/CPU layer distribution for optimal performance -- 📁 **Custom Models** - Add your own GGUF models from local files or URLs - -## Technology Stack - -- **.NET 9.0** - Latest .NET framework -- **WPF** - Windows Presentation Foundation for desktop UI -- **LLamaSharp** - Core LLM inference library -- **CUDA 12** - GPU acceleration support - -## Use Cases - -KaiROS AI demonstrates how to: - -- Build a complete desktop application with LLamaSharp -- Implement model catalog and download management -- Create a chat interface with streaming responses -- Monitor and display performance metrics -- Support GPU acceleration with CUDA -- Provide a privacy-first, offline AI experience -- Expose REST API endpoints for integration with external tools -- Run in background with system tray integration -- Optimize layer allocation between GPU and CPU for best performance -- Import and manage custom GGUF models from local storage or remote URLs - -## Repository - -**GitHub**: [https://github.com/avikeid2007/Kairos.local](https://github.com/avikeid2007/Kairos.local) - -## Download - -- [Download Latest Release](https://github.com/avikeid2007/Kairos.local/releases/latest) - Self-contained Windows installer -- No .NET installation required -- Supports Windows 10/11 (x64) - -## Screenshots and Documentation - -Visit the [KaiROS AI repository](https://github.com/avikeid2007/Kairos.local) for screenshots, detailed documentation, and installation instructions. - -## License - -KaiROS AI is licensed under the MIT License. diff --git a/mkdocs.yml b/mkdocs.yml index 7647a84ad..7c1a6c3f3 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -42,7 +42,7 @@ nav: - ChatSession - load & save: Examples/LoadAndSaveSession.md - Executor - save/load state: Examples/LoadAndSaveState.md - Quantization: Examples/QuantizeModel.md - - KaiROS AI - Windows Desktop Application: Examples/KairosAI.md + - Semantic-kernel - chat: Examples/SemanticKernelChat.md - Semantic-kernel - with kernel-memory: Examples/SemanticKernelMemory.md - Semantic-kernel - basic: Examples/SemanticKernelPrompt.md From b55cbb0c0ac5d74e35c8efb60e977390647b2795 Mon Sep 17 00:00:00 2001 From: Avnish Kumar Date: Mon, 12 Jan 2026 21:52:08 +0530 Subject: [PATCH 6/6] Remove Semantic-kernel chat example from mkdocs nav The "Semantic-kernel - chat" entry was deleted from the navigation section in mkdocs.yml. No other changes were made. --- mkdocs.yml | 1 - 1 file changed, 1 deletion(-) diff --git a/mkdocs.yml b/mkdocs.yml index 7c1a6c3f3..09cb3b96b 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -42,7 +42,6 @@ nav: - ChatSession - load & save: Examples/LoadAndSaveSession.md - Executor - save/load state: Examples/LoadAndSaveState.md - Quantization: Examples/QuantizeModel.md - - Semantic-kernel - chat: Examples/SemanticKernelChat.md - Semantic-kernel - with kernel-memory: Examples/SemanticKernelMemory.md - Semantic-kernel - basic: Examples/SemanticKernelPrompt.md