qingying012/dsh-desktop-control
Gives the DeepSeek Harness model a native desktop tool on Windows: screenshot the screen, move and click the mouse, type text and key combos — wrapping a battle-tested gui.ps1 script as a typed DSH tool.
The typical loop is screenshot → read_image → click/type → screenshot again. The model calls the desktop tool instead of assembling PowerShell commands each turn: screenshot saves a PNG and returns its path (window/region/print variants); windows lists visible windows with HWND, PID, rect and title; click moves and clicks with configurable button and count; drag press-move-release between two points; scroll the wheel; type pastes via clipboard; key sends combos like ctrl+s or alt+f4; activate brings a window to front. The package bundles the script so it is always consistent with the plugin version.
Install
dsh plugin --profile web add dsh-desktop-controlThe npm line from the README (dsh-desktop-control 0.1.0). Also installable via Plugins → + Add plugin in the Electron app. Windows only — the package ships its own assets/gui.ps1 (UTF-8 with BOM) and does not depend on a workspace script. Enable Now after installing in the GUI.
Compatibility
Windows only for the desktop-control actions. The PowerShell script enables per-monitor DPI awareness v2, so all coordinates are physical pixels matching the saved screenshot one-to-one. Configurable: powershellPath, timeoutMs, and screenshotDir (defaults to $DSH_HOME/desktop-control). The tool is called 'desktop' and accepts ten actions: screenshot, windows list, click, move, drag, scroll, type (clipboard-paste), key combo, activate, pos, and wait.
Details
- Repo: qingying012/dsh-desktop-control
- Category: Tools & Capabilities
- Stars: 0
- Version: 0.1.0 (npm)
Alternatives
ningbonb/dsh-web-desktop · XUFENGCHINA/dsh-sidebar-browser-control · Isanti2016/dsh-console