k4cper-g/agent-ctrl

If it's on the screen, it's an API. Control any desktop app via REST + MCP. Rust.

Agent Desktop gives any agent reliable computer use on the desktop. Built with Rust, it sees any app's real UI structure through OS accessibility trees and operates it — refs stay stable and actions stay safe to retry, instead of guessing from pixels.

Let AI agents control Windows applications. Click buttons, type text, toggle settings — all by name, not coordinates. Uses the Windows UI Automation API to find UI elements reliably, regardless of DPI, theme, resolution, or window position.

This is the official website for TuriX Computer-use-Agent

Advancing Foundation GUI Agents with In-Context Demonstrations

Computer use CLI for AI agents

Open-source Computer Use Agent that works for Any App (GUI or CLI) by Any Model (Vision or Text).

Give any AI agent a full desktop — it sees the screen, clicks, types, and runs apps like a human. Automate anything with a UI: browsers, legacy software, internal tools. No API needed. One Docker command.

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra