JohnXu22786/computer-control

Desktop (native) control for dsh as a stdio JSON-RPC bridge over a Python core: capture the screen, inject pointer/keyboard input, drive accessibility-tree actions, and gate high-risk operations behind required confirmations.

Lets an agent operate the desktop directly: screenshot observation (screen.capture), mouse/keyboard injection (pointer., keyboard.), semantic actions via the accessibility tree (a11y.*, UIA first with bounding-box pixel fallback), batched actions (batch.execute) and wait.pause, with built-in safety guards — emergency stop, allow/deny rules, a confirmation flow and idle standby. It speaks line-delimited JSON-RPC 2.0 over stdio.

Tools & Capabilities ★ 1 updated 2026-08-17
View on GitHub ↗

Install

dsh plugin --profile demo add github:JohnXu22786/computer-control

README-documented install into the demo profile from GitHub (replace demo with your profile). The repo ships a Cordis bundle whose index.js spawns python -m computer_control serve and re-exposes every tool from manifest.json over stdio. The Python core needs a Python 3.9+ interpreter with the package installed (pip install -r requirements.txt). Remove with dsh plugin --profile demo remove computer-control.

Compatibility

Bridge needs Node >= 18 and Python 3.9+. Full functionality is Windows 10/11; other platforms see reduced support per the README.

Details

Recent updates

README documents a rehearsal option: the patch row's config can pin a dry-run platform (platform.name: dry-run) so the plugin is installed without enabling live input injection.

FAQ

How do I install computer-control?
Run: dsh plugin --profile demo add github:JohnXu22786/computer-control, then install the Python core requirements (pip install -r requirements.txt) with a Python 3.9+ interpreter on PATH.
Which platforms are supported?
Windows 10/11 for full functionality; other platforms get reduced support per the README.
Are there safety controls?
Yes — an emergency stop, allow/deny rules, a confirmation flow and idle standby, plus a dry-run install option for rehearsing without live input injection.

Alternatives

zhaoolee/notes · Vladimir-Human/ru-marketplace-mcp#dsh · DDDMUC/dsh-free-search

More plugins in Tools & Capabilities

Browse more in Tools & Capabilities

Guides for Tools & Capabilities plugins