--- title: Copilot slug: task-view-guide/copilot docTags: createdAt: 2024-01-04T18:26:25.613Z --- ::::ExpandableHeading ## Cuboids (3D) ### Predictions The predictions are marked with white boxes in the point cloud. They can be selected by clicking on them. To deselect, press `escape` ![](https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/OK0yKAQWXgtm_zuDxLfb7_image.png "Prediction cuboids") ### Stationary predictions The **pink** prediction boxes are considered stationary. An object is deemed stationary if it moves less than 0.5 meters horizontally across all frames it appears in. ::Image[]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/ddAgQfO4C7Pf1XtPxzGMn-20260305-155532.png" size="50" width="780" height="1050" position="center" caption="A stationary prediction of a pedestrian" showCaption="true"} ### Prediction trajectory If the required data is available, the trajectory of the prediction over its lifetime will also be visualized to guide how the object is moving in the scene. ::Image[]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/I4K6HForyK98UA5a95vIg_select-pred.gif" size="80" width="890" height="607" position="center" caption="The trajectory of a prediction" showCaption="true"} ## The drawing process There are two ways of 'drawing' a new object using the predictions and the cuboid copilot. The first way is that you select the class you wish to create, which activates the cuboid drawing tool. Afterwards, you can click on a prediction to create an object at its location. The second method in which you can create a new object from a prediction is that you select the prediction first by clicking on it. As soon as you select a class, an object will be created at the location without any further action. See the GIF below. Select prediction, select class ::Image[]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/JfhkTOPI3FAwWD4yz5Xnq_draw-2.gif" size="70" width="814" height="607" position="center" showCaption="false"} :::hint{type="warning"} Beware! The object detection model often struggles with heading. It is commonly rotated 180 degrees. So be mindful of this, simply use the 90-degree rotation twice. [Transformation controls](docId\:AI1c20I3hoU_BEXm8fFMX) ::: ## The editing process While editing, if you wish to update the object's location to match the prediction, you have two options. This will update the heading and position. The size, as well as pitch and roll, will not change. ### Option one `Shift + click` on the prediction ### Option two Select a prediction and press the **Copilot accept** shortcut (`R` by default). You can also interact with the prediction when working in grid-view if you prefer that over the main-view. ::Image[]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/yi-fxwZgr1WBfO0GeZxrb_update-pred.gif" size="80" width="837" height="607" position="center" caption="Holding shift and clicking on a prediction to update" showCaption="true"} ### Show the best frame When a prediction is selected, the ‘show best frame’ feature will be available to you in **sequences**. It will find the frame that contains the most information to help you estimate the object's size. This frame will be indicated with a **☆** in the videobar. The copilot will navigate to this frame for you and zoom in on the prediction. ::Image[]{src="https://lh7-eu.googleusercontent.com/2NqBAg3rJWDuJ-gmDzyJFUtW_iwKENT_yXr-r4vRj75iQplIyC0G7xj05D9bIayyyeV1qLE166Y2zfw-wmy4MOdREqhIWEnQfShLN1NU1i2cUDeAXvxdjEx6arPGt5C4XkrxcvoQ1-2GVybnBHA9l776BQ=s2048" size="58" width="386" height="156" position="center" caption="The best frame indicated by a star" showCaption="true"} ### The copilot eraser Sometimes you will encounter predictions that should not be annotated or are false positives from the object detection system. These predictions can be erased to reduce distraction, and they will also not be included in "copilot stepping". To use the eraser, activate **the copilot eraser tool,** click and hold the left mouse button, and mouse over the predictions that should be erased. ::Image[]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/BYlynS7g1Sw_BBaorZRFB_image.png" size="28" width="230" height="195" position="center" caption="The eraser tool in the left side menu" showCaption="true"} ::Image[**INSERT GIF(s)**]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/lutjVA25iF83znES-qqfd_cuboidcopiloteraser.gif" size="90" width="936" height="449" position="center" caption="Erasing predictions" showCaption="true"} :::: :::::ExpandableHeading ## Bounding boxes (2D) ### Predictions The predictions are marked with dashed white outlines in the image. They can be selected by clicking on them. To deselect, press `escape`. ::Image[**INSERT IMAGE**]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/8_OHL5D3hEflNq6qL1g41_image.png" size="90" width="634" height="334" position="center" caption="Prediction bounding boxes" showCaption="true"} ## The drawing process There are two ways of drawing a new object using the predictions and the cuboid copilot. ### Class before prediction ::::WorkflowBlock :::WorkflowBlockItem Select a class you wish to annotate, ::: :::WorkflowBlockItem Click on a prediction to create an object ::: :::: ### Prediction before class ::::WorkflowBlock :::WorkflowBlockItem Select a prediction by clicking on it ::: :::WorkflowBlockItem Select a class - an object should've been created at the location without any further action. See gif below. ::: :::: ## The editing process While editing and you wish to update the object's location with that of the prediction you have two options. **Option one **- `Shift + click` on the prediction. **Option two **- Select a prediciton and press the 'copilot accept' shortcut (`R` by default). ::Image[**INSERT GIF(s)**]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/fFL2g3h6IwiKFolAjZbQs_bboxcopiloteditshift.gif" size="90" width="800" height="400" position="center" caption="Holding shift and clicking on a prediction to update" showCaption="true"} ### The copilot eraser Sometimes you will encounter predictions that should not be annotated or are false positives from the object detection system. These prediction can be erased so that they are less distracting, they will also not be included in the 'copilot stepping'. To use the eraser, activate **the eraser copilot eraser tool** and click and hold the left mouse button and mouse over the predictions that should be erased. ::Image[**INSERT GIF(s)**]{src="https://api.archbee.com/api/optimize/wLEz_RbWP6nIMpY-prjlm/3lkzxSsVjyjriYL2zqDH7_bboxcopiloteraser.gif" size="90" width="723" height="501" position="center" caption="Erasing predictions" showCaption="true"} :::::