Copilot
Predictions
The predictions are marked with white boxes in the point cloud. They can be selected by clicking on them. To deselect, press escape
Stationary predictions
The pink prediction boxes are considered stationary. An object is deemed stationary if it moves less than 0.5 meters horizontally across all frames it appears in.
Prediction trajectory
If the required data is available, the trajectory of the prediction over its lifetime will also be visualized to guide how the object is moving in the scene.
The drawing process
There are two ways of 'drawing' a new object using the predictions and the cuboid copilot. The first way is that you select the class you wish to create, which activates the cuboid drawing tool. Afterwards, you can click on a prediction to create an object at its location.
The second method in which you can create a new object from a prediction is that you select the prediction first by clicking on it. As soon as you select a class, an object will be created at the location without any further action. See the GIF below. Select prediction, select class
Beware! The object detection model often struggles with heading. It is commonly rotated 180 degrees. So be mindful of this, simply use the 90-degree rotation twice. Transformation controls
The editing process
While editing, if you wish to update the object's location to match the prediction, you have two options. This will update the heading and position. The size, as well as pitch and roll, will not change.
Option one
Shift + click on the prediction
Option two
Select a prediction and press the Copilot accept shortcut (R by default). You can also interact with the prediction when working in grid-view if you prefer that over the main-view.
Show the best frame
When a prediction is selected, the ‘show best frame’ feature will be available to you in sequences. It will find the frame that contains the most information to help you estimate the object's size. This frame will be indicated with a ☆ in the videobar. The copilot will navigate to this frame for you and zoom in on the prediction.
The copilot eraser
Sometimes you will encounter predictions that should not be annotated or are false positives from the object detection system. These predictions can be erased to reduce distraction, and they will also not be included in "copilot stepping".
To use the eraser, activate the copilot eraser tool, click and hold the left mouse button, and mouse over the predictions that should be erased.
Predictions
The predictions are marked with dashed white outlines in the image. They can be selected by clicking on them. To deselect, press escape.
The drawing process
There are two ways of drawing a new object using the predictions and the cuboid copilot.
Class before prediction
Select a class you wish to annotate,
Click on a prediction to create an object
Prediction before class
Select a prediction by clicking on it
Select a class - an object should've been created at the location without any further action. See gif below.
The editing process
While editing and you wish to update the object's location with that of the prediction you have two options.
Option one - Shift + click on the prediction. Option two - Select a prediciton and press the 'copilot accept' shortcut (R by default).
The copilot eraser
Sometimes you will encounter predictions that should not be annotated or are false positives from the object detection system. These prediction can be erased so that they are less distracting, they will also not be included in the 'copilot stepping'.
To use the eraser, activate the eraser copilot eraser tool and click and hold the left mouse button and mouse over the predictions that should be erased.
