Peer productivity
This page provides an overview of your teamβs overall performance.
Path: Team Management βΆοΈ Productivity Insights βΆοΈ Peer Productivity
1. Controls & Filters
- Time Interval Select any date range. By default, shows the last 7Β days (daily granularity).
- Projects Filter metrics to one or more projects.
- Request Type Filter by request category.
- Task Type Choose between Annotate, Correct, Review, or All.
- Task Category Choose between Production, Training, or Demo.
2. Annotate speed
Note: βAnnotation Pointsβ is a project-level metric. See our Annotation Points & Targets guide for details.
The speed of which the user producers Annotation points while active in a annotation task.
Points are not generated for review tasks but only when objects are added in correction tasks. This is by design.
ο»Ώ
Points are only generated during annotation/correction, not in pure review tasks.
2.1 Target
The speed target accounts for the fact that annotators don't spend all their tool time on annotation β approximately 10% goes to review tasks and 5% to corrections. The effective target is adjusted by a factor of 1.3Γ so that 100% productivity reflects realistic performance given this workload mix.
2.2 Average Performance Over Time
Focus on your long-term averageβtasks vary in complexity, so balance productivity with quality.
3. Quality
Estimate data quality (%) in the Quality column: Quality = 100 β (feedback items / reviewed objects Γ 100)
Higher Tasks Reviewed increases confidence in the estimate.
Example 100 objects produced, 20 issues found β Quality = 80%
Use Quality only to monitor sustainable paceβitβs not a precise QA metric.
This is a metric that will not be used for purposes other than ensuring that you are working at a sustainable pace.
4. Working Time
4.1 Working Time Column
Shows Stopwatch-reported time. If no Stopwatch data, displays annotation time with a red * and disables productivity %.
4.2 Time Allocation
Ratio of annotation time to total working time:
Ratio | Indicator |
|---|---|
β€ 0.70 | π΄ Too Low |
0.70β0.75 | π‘ Border |
0.75β0.85 | βͺοΈ Optimal |
0.85β0.90 | π‘ Border |
β₯ 0.90 | π΄ Too High |
5. Objects and Shapes Produced
These columns show how many objects the user has created during the selected timespan. This might be a negative number if:
- The user is doing Correction tasks and removing objects
- The user is doing Review Tasks and is removing objects
- The user started the day by removing objects from a scene started on a previous day, and the timespan only accounts for today.
See Objects and Shapes for details.
ο»Ώ