THE TASK VIEW
...
Workflows
Annotation copilot

Bounding Box Copilot

10min

Predictions

The predictions are marked with dashed white outlines in the image. They can be selected by clicking on them. To deselect, press escape.

Prediction bounding boxes
Prediction bounding boxes
ο»Ώ

The drawing process

There are two ways of drawing a new object using the predictions and the cuboid copilot.

Class before prediction

  1. Select a class you wish to annotate,
    • This will automatically activate the bounding box copilot drawing tool
  2. Click on a prediction to create an object
The bounding box copilot drawing tool
The bounding box copilot drawing tool
ο»Ώ
Drawing using the bounding box copilot drawing tool
Drawing using the bounding box copilot drawing tool
ο»Ώ

Prediction before class

  1. Select a prediction by clicking on it
  2. Select a class,
    • an object should've been created at the location without any further action. See gif below.
Drawing when selecting the prediction first
Drawing when selecting the prediction first
ο»Ώ

The editing process

While editing and you wish to update the object's location with that of the prediction you have two options.

Option one

Shift + click on the prediction

Option two

Select a prediciton and press the 'copilot accept' shortcut (R by default).

Holding shift and clicking on a prediction to update
Holding shift and clicking on a prediction to update
ο»Ώ

Copilot step

When you have a prediction selected at the same time as editing an object you will be able to use the 'copilot step' feature.

The shortcut is Enter and will assist you in guiding you to where your attention is needed the most. It will guide you a bit differently depending if you are in a single frame task or a sequence task.

Single frame

Using the 'copilot step' function in a single frame task will select the next prediction that is the closest to the current selected object. If it's an actual object then you can simply select a class and an object will be created, as the drawing process describes.

Using the copilot stepping in single frame
Using the copilot stepping in single frame
ο»Ώ

However if it's a false positive detection or something that should not be annotated, you can simply press the 'copilot step' shortcut to skip the prediction.

A skipped prediction is indicated by a transparent gray color, barely visible to not be a distraction. You are still able to interact with skipped predictions if it was done by mistake.

Using the copilot stepping and skipping predictions
Using the copilot stepping and skipping predictions
ο»Ώ

Sequence

Coming soon!

The copilot eraser

Sometimes you will encounter predictions that should not be annotated or are false positives from the object detection system. These prediction can be erased so that they are less distracting, they will also not be included in the 'copilot stepping'.

To use the eraser, activate the eraser copilot eraser tool and click and hold the left mouse button and mouse over the predictions that should be erased.

Erasing predictions
Erasing predictions
ο»Ώ

ο»Ώ