Global AI chat room · 17 online now Join now
N
MCP SERVER Listed

NON906/omniparser-autogui-mcp

The omniparser-autogui-mcp server bridges the gap between LLMs and local desktop environments by enabling direct GUI interaction. Unlike standard API-driven tools, this MCP implementation leverages OmniParser to visually analyze screen coordinates and execute precise mouse and keyboard events. For developers, this means you can build agents capable of navigating legacy software, complex web apps, or any desktop application without requiring a native API or accessibility tree. It transforms the LLM from a text generator into an operator that can perceive UI elements and perform actions based on visual feedback, making it ideal for automated testing, RPA, or creating personalized desktop assistants.

Open ecosystemGeneral
View GitHub
01 / SERVER DETAIL

Server detail

The omniparser-autogui-mcp server bridges the gap between LLMs and local desktop environments by enabling direct GUI interaction. Unlike standard API-driven tools, this MCP implementation leverages OmniParser to visually analyze screen coordinates and execute precise mouse and keyboard events. For developers, this means you can build agents capable of navigating legacy software, complex web apps, or any desktop application without requiring a native API or accessibility tree. It transforms the LLM from a text generator into an operator that can perceive UI elements and perform actions based on visual feedback, making it ideal for automated testing, RPA, or creating personalized desktop assistants.

An MCP server that exposes NON906/omniparser-autogui-mcp capabilities to MCP-compatible AI clients.

CapabilitiesGeneralMCPOpen source
ProtocolModel Context Protocol
Developer ecosystemOpen ecosystem
LicenseMIT / check source
SourceGitHub
COLLECTIONS

Collections featuring this MCP

Popular MCP2026.03.30Listed
My MCP2026.03.31Listed
Genie2026.03.30Listed
02 / TOOL TESTING

Tool testing

AVAILABLE TOOL

non906-omniparser-autogui-mcp

Callable

Call the MCP capabilities provided by NON906/omniparser-autogui-mcp and return a structured result.

PARAMETERS
inputPass arguments according to the server tool schema.
Tip: the tool may truncate responses. Use pagination parameters such as start_index to read long content in chunks.
03 / SERVICE CONFIGURATION

Connection modes

Remote
{
  "mcpServers": {
    "NON906/omniparser-autogui-mcp": {
      "url": "Generated by the provider after deployment"
    }
  }
}

The Remote endpoint is generated by the provider after deployment; this page does not fabricate an unusable endpoint.

03 / WORKFLOW

How to use

  1. 01
    Step 1

    Review server capabilities and permission scope.

  2. 02
    Step 2

    Copy the install command or JSON configuration.

  3. 03
    Step 3

    Run a small connection test in your client.

  4. 04
    Step 4

    Adopt it long term only after reviewing access and maintenance.

04 / DISCUSSIONS

Discussions

Use this space to keep checking source information, usage experience and maintenance status.

Open source page
Email