view source

tanob/desktop-automation

mcp server

Desktop Automation MCP Server - control mouse and keyboard; takes screenshots on macOS, Linux or Windows via RobotJS, npx, needs accessibility access

Desktop automation MCP server. Control mouse, keyboard, and take screenshots for UI automation on the local computer (macOS / Linux / Windows). Powered by RobotJS.

MCP Server

  • Package: mcp-desktop-automation
  • Transport: stdio
  • Command: npx -y mcp-desktop-automation

Authentication

None — but the host OS must grant accessibility / screen-recording permissions to the process running the MCP server (Terminal, IDE, etc.). On macOS this is System Settings → Privacy & Security → Accessibility / Screen Recording.

VariableRequiredDescription
——No environment variables required

Available Tools

ToolDescription
get_screen_sizeReturn the primary screen resolution
screen_captureCapture the screen (≤ 800×600 reliable; larger may exceed the 1 MB MCP response cap)
mouse_moveMove the cursor to (x, y)
mouse_clickClick at the current position
keyboard_typeType a string
keyboard_pressPress a named key (or combo)

Configuration Example

toml
[[mcp.servers]]
name = "desktop-automation"
type = "stdio"
command = "npx"
args = ["-y", "mcp-desktop-automation"]
timeout_seconds = 60
tools = []

Notes:

  • Requires system accessibility / screen-recording permissions on macOS.
  • Screen captures above ~800×600 may exceed the 1 MB response limit and fail — prefer capturing a region or a sub-screen.
  • Cross-platform via RobotJS (macOS / Linux / Windows).