open-codex-computer-use: Automate Desktop Interfaces Through MCP

Overview

open-codex-computer-use provides computer-use actions as an MCP service, letting compatible AI agents interact with desktop applications. It aims to make desktop automation available across macOS, Linux, and Windows without requiring a client-specific integration.

The project is a fit for developers who want to connect an agent such as Codex, Claude Code, Gemini CLI, or opencode to desktop workflows. Its interface includes MCP tools as well as CLI commands for individual calls and JavaScript-based automation.

Key Features

• Exposes computer-use capabilities through the Model Context Protocol (MCP).
• Supports desktop automation on macOS, Linux, and Windows.
• Provides installation commands for configuring several MCP clients.
• Includes CLI commands for calling tools, running sequences, and checking runtime capabilities.
• Offers ocu js and a terminal REPL for JavaScript automation with cua bindings.
• Provides an installable skill for Codex and Claude Code.

Use Cases

• Agent developers can give Codex or another MCP-compatible client access to desktop applications.
• Automation builders can run repeatable sequences of desktop actions from the CLI.
• Teams working across operating systems can try a shared computer-use interface on macOS, Linux, and Windows.
• Developers prototyping agent workflows can use the JavaScript command or REPL to explore and test actions interactively.

Project Facts

• Language: Swift
• License: MIT
• Stars: 2.3k
• Forks: 204
• Topics: accessibility, ai-agent, ai-agents, claude-code, codex, codex-computer-use, computer-use, computer-use-agent, cross-platform, cua, desktop-automation, gemini-cli, gui-automation, macos, mcp, model-context-protocol, open-computer-use, open-computer-use-mcp, openai-codex, opencode
• Archived: No

Getting Started

Install the npm package:

npm i -g open-computer-use

Run open-computer-use or its ocu alias. On macOS, grant Accessibility and Screen Recording permissions. See the README for MCP client setup and further instructions.

Alternatives

• Open-Interface: Open-Interface uses screenshots and an LLM to guide simulated mouse and keyboard actions, while open-codex-computer-use exposes accessibility-based controls through MCP.

Considerations

• The macOS runtime requires macOS 14.0 or later and Accessibility and Screen Recording permissions.
• The npm launcher requires Node.js 18 or newer.
• While the project supports Windows and Linux as well as macOS, the README calls out additional permission setup specifically for macOS.
• The repository is MIT-licensed. Check the repository for current releases and platform-specific details.