What's new in LabelMe v6.2

LabelMe v6.2 is out. (Download or upgrade from here).

The headline feature is oriented rectangle, a rotated bounding box you can draw by hand or get straight from a SAM prediction. AI-Points and AI-Box also gained rectangle and circle outputs.

Oriented rectangle

A new shape type that represents a rotated bounding box. Available in the toolbar and via keyboard shortcut, with full create/edit support on the canvas.

Useful when axis-aligned boxes waste a lot of area: parking lots from above, ships, packaged goods, text in scanned documents, anything photographed off-angle.

LabelMe v6.2 annotating cars in an aerial parking lot image with oriented rectangles, each box rotated to match the car's heading

More AI output shapes

AI-Points and AI-Box can now output oriented_rectangle, rectangle (axis-aligned), and circle in addition to the existing polygon and mask. Pick whichever shape your downstream model expects.

LabelMe v6.2 AI-Assisted Annotation dropdown showing Polygon, Mask, Rectangle, Oriented Rectangle, and Circle output options

oriented_rectangle fits a minimum-area rotated bounding box to the predicted SAM mask, so the box hugs rotated objects instead of wasting area.

LabelMe canvas of cars in a parking lot annotated with oriented rectangles, with an inset showing the AI-Box drawn around a single car

circle fits a circle to the mask, useful for round objects like tanks, cells, or wells.

LabelMe canvas of round tanks at an industrial site annotated with circles, with an inset showing the AI-Box drawn around a single tank

Other improvements

Right-click on a shape edge to insert a vertex at the cursor with Add Point to Edge
Toggling shape visibility now goes through the undo stack
Hide/show on a multi-selection propagates to every selected shape
Shift+wheel scrolls horizontally on Linux and Windows, matching macOS
Ctrl/Cmd+A on the canvas selects all shapes

Fixes

AI-Box bbox points are normalized before being sent to the model, so boxes drawn right-to-left or bottom-to-top no longer return wrong predictions (thanks to @kimchioverfit)
Editing a label's group_id no longer drops the color indicator from its annotation list row
Cancelling the label dialog after drawing an oriented rectangle no longer discards the shape
The first-vertex snap highlight is correctly restored when closing a polygon and cleared after every paint
validate_label: null skips validation as documented (the short-circuit was lost; now restored)

Get v6.2

Available for Windows, macOS, and Linux from the downloads page. See the installation docs if you need help.

If something breaks, open a GitHub issue or ask on Discord.