BeClaude

computer-vision

New
1Community RegistryDevelopmentby Southlab AI · MIT

Desktop computer vision and input control for Claude Code on Windows. 24 tools: screenshots, scene analysis, human-like mouse movement, action recording, UIA-based element invocation (cv_click_ui — works on WinUI 3 apps where SendInput fails), deep UI tree search, click, drag-and-drop, type, scroll, OCR, element finder, text extraction. Background mode via PostMessage.

Community PluginView Source

Overview

Claude Code plugin marketplace by Southlab AI.

Available Plugins

PluginDescriptionVersionCategory
upwork-scraperScrape Upwork jobs, analyze market demand, write proposals, optimize rates, and build portfolios. 5 slash commands + 5 AI agents.0.2.0Freelance
the-councilCatch blind spots in architecture decisions with multi-perspective analysis. 4 auto-routed modes, configurable roles, /council:build pipeline, /council:value analysis, memory attribution, progressive hints.3.2.0Productivity
computer-visionDesktop computer vision and input control for Windows. 28 tools: screenshots, click, type, scroll, OCR, element finder, text extraction, UI trees, app-specific adapters, action verification, and 9 sandbox tools for parallel automation (Claude works in isolated Windows Sandbox while you keep working).2.0.0Utilities

Installation

1. Add the marketplace

Inside Claude Code:

code
/plugin marketplace add southlab-ai/Claude-Plugin-Marketplace

2. Install a plugin

code
/plugin install upwork-scraper@southlab-marketplace
/plugin install the-council@southlab-marketplace
/plugin install computer-vision@southlab-marketplace

3. Restart Claude Code

Close and reopen Claude Code for the MCP server to connect.

4. Run setup

Each plugin has a setup command:

code
/upwork-scraper:setup
/council:setup
/cv-setup

Commands

Upwork Scraper

CommandDescription
/upwork-scraper:setupInstall dependencies
/upwork-scraper:best-matchesFetch personalized Best Matches
/upwork-scraper:search <query>Search jobs with filters
/upwork-scraper:analyze <skill>Analyze market demand
/upwork-scraper:portfolio <skills>Get portfolio project ideas

The Council (v3.2.0)

CommandDescription
/council:setupInstall dependencies (auto-offers init)
/council:initInitialize .council/ in your project
/council:consult <goal>Multi-perspective consultation (auto-routed: default, debate, plan, reflect)
/council:value <goal>Value-realization analysis: scores 4 dimensions (clarity, timeline, perception, discovery)
/council:build <goal>Full build pipeline: PRD + tech deck + backlog + feature gate + implementation
/council:statusView decisions, memory health, staleness warnings, compaction recommendations
/council:maintainCompact memory using the curator agent
/council:updateMigrate council data after a plugin update
/council:resetClear session data (add --all to also clear memory)

Computer Vision (v2.0.0)

ToolDescription
cv_list_windowsList all visible windows with HWND, title, process, rect
cv_screenshot_windowCapture a window
cv_screenshot_desktopCapture the desktop
cv_screenshot_regionCapture a region
cv_focus_windowBring a window to the foreground
cv_mouse_clickClick at screen coordinates
cv_type_textType text with optional hwnd for atomic focus+type
cv_send_keysSend key combinations
cv_scrollScroll a window
cv_move_windowMove/resize a window
cv_ocrExtract text with bounding boxes and confidence
cv_findFind elements by natural language (UIA + OCR)
cv_get_textExtract all visible text
cv_list_monitorsList monitors with resolution and DPI
cv_read_uiRead the UI accessibility tree
cv_wait_for_windowWait for a window to appear
cv_waitSimple delay (max 30 seconds)
cv_sandbox_startLaunch Windows Sandbox for isolated automation
cv_sandbox_stopStop the sandbox session
cv_sandbox_clickClick inside sandbox (doesn't move your cursor)
cv_sandbox_typeType inside sandbox (doesn't affect your keyboard)
cv_sandbox_screenshotCapture screenshot from sandbox
cv_sandbox_sceneGet UI element tree from sandbox
cv_sandbox_batchExecute multiple actions in one call (reduces latency)
cv_sandbox_checkCheck if sandbox is available on your system
cv_session_statusGet sandbox session health and action history
CommandDescription
/cv-setupVerify setup and dependencies
/cv-helpUsage guide and examples

Updating

code
/plugin marketplace update southlab-marketplace

Team Configuration

Add to your project's .claude/settings.json to auto-prompt teammates:

json
{
  "extraKnownMarketplaces": {
    "southlab-marketplace": {
      "source": {
        "source": "github",
        "repo": "southlab-ai/Claude-Plugin-Marketplace"
      }
    }
  },
  "enabledPlugins": {
    "the-council@southlab-marketplace": true,
    "computer-vision@southlab-marketplace": true
  }
}

Requirements

  • Claude Code v1.0.33+
  • Agent teams enabled: CLAUDE_CODE_EXPERIMENTAL_AGENT_TEAMS=1
  • Python 3.11+
  • uv
  • Windows 10 21H2+ or Windows 11 (for computer-vision)

Repository Structure

This is a monorepo. All plugins live as subdirectories under plugins/:

code
Claude-Plugin-Marketplace/
├── .claude-plugin/
│   └── marketplace.json      # Plugin registry
├── plugins/
│   ├── upwork-scraper/       # Upwork scraping & market analysis
│   ├── the-council/          # Multi-agent consultation
│   └── computer-vision/      # Desktop vision & automation
└── README.md

Updating a plugin and the marketplace is a single commit.

License

MIT

Install & Usage

1
Create the skills directory
mkdir -p .claude/skills
2
Download the skill file
mkdir -p .claude/skills && curl -o .claude/skills/computer-vision.md https://raw.githubusercontent.com/southlab-ai/Claude-Plugin-Marketplace/main/SKILL.md
3
Invoke in Claude Code
/computer-vision
View source on GitHub
computer-visionwindowsdesktopautomationmcpscreenshotocraccessibility

Frequently Asked Questions

What is computer-vision?

Desktop computer vision and input control for Claude Code on Windows. 24 tools: screenshots, scene analysis, human-like mouse movement, action recording, UIA-based element invocation (cv_click_ui — works on WinUI 3 apps where SendInput fails), deep UI tree search, click, drag-and-drop, type, scroll, OCR, element finder, text extraction. Background mode via PostMessage.

How to install computer-vision?

To install computer-vision, create the .claude/skills directory in your project, then run the curl command to download the skill file. Once installed, invoke it in Claude Code with /computer-vision.

What is computer-vision best for?

computer-vision is a community categorized under Development. It is designed for: computer-vision, windows, desktop, automation, mcp, screenshot, ocr, accessibility. Created by Southlab AI.