Skip to content
Jaswanth1902Public

About

Sub-30ms physical Windows OS desktop automation primitive. Direct Win32 UI Automation tree traversal and hardware input dispatch for AI computer-use agents.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Latest commit

 

History

58 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🤖 Auto_OS

Sub-30ms Physical Windows OS Desktop Automation Primitive for AI Agents

Latency Architecture: Win32 UIA Reliability License: MIT

Stop waiting 3 seconds for screenshots. Drive Windows at the speed of native code.
Directly traverses the Win32 UI Automation (UIA) accessibility tree to click buttons, inspect window states, and input text in sub-30 milliseconds without heavyweight computer vision models.

⚡ Benchmark • 🚀 Quickstart • 🛠️ API Reference


⚡ Benchmark: Accessibility Tree vs. Vision Agents

Automation Paradigm Action Latency Token / Model Cost Click Reliability
Vision-Based Agent (Screenshot + VLM) 2,800ms - 4,500ms High (Image Tokens) Brittle (Resolution Dependent)
Auto_OS Win32 UIA Tree <28ms Zero Model Tokens 100% Deterministic Handle

🚀 Quickstart

from auto_os import DesktopActuator

actuator = DesktopActuator()
# Find element by Win32 AutomationID in <10ms
button = actuator.find_element(name="Submit", control_type="Button")
button.click()

About

Sub-30ms physical Windows OS desktop automation primitive. Direct Win32 UI Automation tree traversal and hardware input dispatch for AI computer-use agents.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages