User productivity
This page provides an overview of your overall performance.
Inside the parenthesis, the actual number of produced annotation points is displayed.
We use annotation points to help you measure the value of your work and ensure that you are performing as expected.
Example one
If a user works 2 hours in a selected time period and produces 100APs in this period, and the target is 100AP/h, the user's productivity will be 50%.
Example two
Let's say you get points for each
- Task: 10p
- Cuboid object: 4p
- 2D Bounding box object: 2p
If you annotate 10 cuboid objects and 7 2D Bounding box objects in a task, the annotation points will be 10p * 1 + 4p * 10 + 2p * 7 = 64.
Points are not generated for review tasks but only when objects are added in correction tasks. This is by design.
A target that you are expected to reach is needed to measure your or someone on your team's productivity.
The target you see in the app is your hourly target.
The hourly target has already taken into account that you only spend about 80% of your working time actively annotating. For example, if we think a reasonable hourly target is 300, we set the daily target to 1800 (300*6).
We know there are differences between tasks (some are trickier than others), and we are most interested in average performance over time.
It is important to remember that productivity needs to be balanced with quality.
In this column we display how much time has been reported from Stopwatch during the selected timespan.
If no time has been reported, we will show the time spent annotating. In this case, a red asterisk will indicate that no stopwatch time is available, and no productivity metric will be available.
