Project Metrics
The metrics page is under active development and the components below may evolve.
The Metrics tab is split into five sub-tabs, selectable from the chip row at the top. Each chip writes a ?metricsTab=β¦ parameter to the URL, so individual tabs can be deep-linked or shared. The default tab is Productivity.
Productivity
The Productivity tab is the default landing view. It surfaces a 7-card KPI row in playbook diagnostic order: when productivity is below target, you walk these ratios left-to-right to find where to look first.
The cards, in order:
- Productivity Ratio β AP Γ· (APT Γ reported hours)
- Time Allocation Ratio β annotation tool time Γ· reported time
- Annotate Speed (AP/h) β annotation points per hour in annotate tasks, compared with the project's annotate speed target (see Annotation Points and TargetAnnotation Points and Target).
- Correction Ratio β time spent on corrections relative to total
- Review Ratio β time spent on reviews relative to total
- Reported Time β total hours reported
- Active Users β annotators active in the period
When productivity is below target, walk these ratios left to right to find where to look first.
Each card displays the headline value, a comparison against the previous 7 days (with a coloured chevron indicating whether the change is good or bad for that metric), and a 5-week graph with per-dot tooltips. The most recent graph point may differ slightly from the headline number, because the headline is a rolling 7-day value while the graph shows weekly buckets.
APT calibration warning
A banner appears above the KPI row when the project's effective AP target looks miscalibrated β for example, when no annotator has reached 100% productivity in the available data. The playbook is: when nobody is hitting target, the target itself is likely wrong β recalibrate the project's APT before reading the diagnostic ratios, since they all assume a realistic benchmark.
Productivity vs Target
A weekly distribution chart showing how the team splits across three fixed bands: above target, approaching target, and below target.
Weekly AP Produced
A bar chart of total annotation points produced per week, with value labels on each bar.
Tables
Below the charts: a weekly summary table and a per-user breakdown table. Clicking a user opens their full productivity report; the originating project is preserved via ?projectId=<id> so the breadcrumb back-button returns to this metrics view.
Efficiency
The Efficiency tab focuses on the drivers behind the Productivity headline. It contains:
- Efficiency Drivers table β per-user efficiency breakdown.
- AP/h trend β weekly AP/h over time.
- Productivity spread β distribution of productivity across the team.
- QA ratio trend β review + correction time as a share of tool time, over time.
- Active users trend β weekly active user counts.
- Productivity-vs-Target bucket trend β how the distribution across the three target bands has shifted week over week.
Delivery
Delivery groups the throughput-oriented charts:
- Weekly Counts β inputs delivered per week.
- Weekly Detailed Counts β same data broken down by phase or status.
- Turnaround Time β average time from request creation to delivery.
Composition
Composition tracks what is in the data β shapes per input, objects per input, and geometry-type density across requests. The data-source toggle and shape-prediction overlay still apply here.
Quality
Quality KPIs are split out into their own tab. The headline cards cover Review Quality (share of annotated objects accepted by Quality Reviewers without changes) and Expert Verification (share of QR-approved objects also accepted by Experts). A sub-metric breakdown table covers precision, recall, geometry accuracy, property accuracy, and the count of reviewed scenes.
Learning Curve
The Learning Curve tab tracks how quickly new annotators ramp up their annotation speed during their first weeks in a project. Each user's timeline is aligned so that Week 0 is their first day in the project, making it easy to compare onboarding progress regardless of start date.
Chart
The main chart displays one line per user, plotting annotation speed (AP/hour) against onboarding weeks. Reference lines provide context:
- Annotation speed target β the project's annotate speed target (by default APT Γ 1.3).
- P90 and P50 β percentile lines across all displayed users.
- Expected learning curve β a shaded band showing the configured min/max range per week, as a percentage of the annotate speed target (see Annotation Points and TargetAnnotation Points and Target for configuration).
You can brush-select a region on the chart to filter the summary table to only the users whose lines pass through the selection.
KPI Cards
Three KPI cards summarize onboarding health:
- Above expected learning curve β percentage of onboarding users performing above the configured learning curve band.
- Reached target speed β number of users who have reached the annotation speed target.
- Avg. days to target β average number of active days it took users to reach the target (among those who have).
If the expected learning curve is not yet configured, the first KPI card displays a link to project settings where it can be set up.
Filters
- Max active weeks β slider to limit the chart to users with at most N active weeks.
- Hide users above annotation speed target β checkbox to focus on users still ramping up.
- User filter β search by name or email. Supports pasting comma-separated email lists.
Summary Table
Displays a row per onboarding user with columns for days active, current speed, speed delta (weekly and bi-weekly), productivity percentage, and curve deviation.
Actions:
- CSV export β download the table data.
- Copy emails β copy selected user emails to clipboard.
Who sees what
Access controls are applied per tab:
- Productivity, Quality and Learning curve require the team-overview permission. Productivity is also hidden when time-spent is hidden.
- Efficiency requires the team-overview permission.
- Delivery and Composition are visible to all users with access to the metrics tab.
When a user lacks permission to see a tab, the chip is hidden from the row.