Add feedback
As a reviewer, your task is to determine whether a task is of acceptable or unacceptable quality. If the task is of unacceptable quality, you are also expected to provide correction requests or advice to the annotators so that they can improve the quality.
There are two ways to add a feedback item today.
- Click on the speaking bubble with a plus sign
- Go to the bottom of the expandable right-side menu.
When adding feedback, you must define its type: a correction request or advice. Depending on the type, you will be presented with different options to fill in.
Correction requests are always connected to errors, so they are usually categorized with an error type (some exceptions exist). This makes it easier for us to organize the mistakes and provide you with statistics on the most common errors in an annotation request/project.
Advice allows you to write encouraging words and general tips on improving. An advice item does not tell the person to fix anything in the current task.
You can connect a correction request or advice item to a single object in two ways:
You can open the feedback form with the object selected, and the object is automatically linked to the feedback item.
- Open the feedback form and click on "Select object."
- Select an object in the main view or object list.
Time (Required) You can select between the Current frame or the Entire sequence.
Sensor (Required) You can select between the Current sensor or all sensors.
If you'd like to refer to specific frames or sensors, you can clarify that in the comment field.
Error type (Required for correction requests, not available for Advice items) The available error types are specific to the project.
You will be asked to specify the correct answers when selecting error types related to incorrect classes or property values.
Comment A place to write feedback or clarifications when needed.
Using pins, you can tie a correction request or advice to a location in a sensor and frame.
- Open the feedback form and click on the button "Place pin."
- Click where you want to place the pin.
- In 3D, highlighting points in the point cloud will guide you to where the feedback pin should be placed.
Time Current frame.
Sensor Current sensor.
If you'd like to refer to specific frames or sensors, you can clarify that in the comment field.
Error type (Required for correction requests, not available on Advice items) The available error types are specific to the project. These are selected in a drop-down.
Comment A place to write feedback or clarifications when needed.
