Bring your own agent to Labelme

Ask ChatGPT or Claude to label the image open in Labelme. It asks before each change, and one ⌘Z undoes it.

Free 3-day trial · One-time purchase from $49

Works with

  • ChatGPT desktop app
  • Claude desktop app

Also Claude Code, Codex and Cursor.

Labelme with outlines around a tennis-ball dog toy, a pack of index cards and a pack of sticky notes, all three selected.
Your agentConnected to Labelme
Outline every object on this shelf.
Looked at the open image.

Allow your agent to add 3 shapes in Labelme?

AllowDeny
Added 3 outlines.
Done. They're selected in Labelme. ⌘Z undoes all three.

Ask for the tedious part

Real Labelme windows, one request each.

Example request

Set it up once, with no terminal

One button in Labelme adds it to your app.

Your app
Use Claude Code, Codex, Cursor or another app?

Connect AI Agent… adds Labelme to Claude Code in one click. For Codex, Cursor and other apps, it copies the config to paste. That includes apps that run a model on your computer.

Example config

Example for macOS. Labelme fills in its own path when you copy the config. Using another app? Tell us at support@labelme.io.

You stay in charge

  • Asks before editing
  • Selects what changed
  • ⌘Z undoes a whole request
  • Can't delete locked shapes
  • Labelme uploads nothing
After the request
⌘Z
After one undo

Questions

Do I need to use a terminal?

No. The ChatGPT and Claude desktop apps connect with a button in Labelme. Only coding agents like Claude Code take a command.

Which ChatGPT or Claude plan do I need?

Any Claude account works in the Claude desktop app. In the ChatGPT desktop app, Labelme works through Codex, which OpenAI includes on every plan, Free included. ChatGPT in a web browser can't reach apps on your computer.

Where do my images go?

Labelme sends the open image only to the app you connect, and only when your agent asks to see it. That app sends it to its model. To keep everything on your computer, connect an app that runs its model locally.

Which Labelme plan includes it?

Every plan, and the free trial too.

Does it work on Windows and Linux?

Labelme does. The ChatGPT and Claude desktop apps run on macOS and Windows. On Linux, connect Claude Code, Codex or Cursor.

Does Labelme need to be open?

Yes, your agent works in the open Labelme window. If Labelme is closed, your agent asks you to open it.

Try it on your own images

Download Labelme, turn on Connect AI Agent…, and ask your agent about the image you have open.

Free 3-day trial · One-time purchase from $49