Summary

within the summary tab, you find information with the intention to help you get a good overview of the request and its current progress kpi cards the summary tab displays two kpi cards at the top of the page, visible to request producers only each card provides a high level metric with a link to its detailed analytics page productivity shows the overall productivity ratio as a percentage, comparing expected annotation time (based on ap target rates) to actual reported time for annotate and correct tasks the score is color coded green when productivity is at or above 99 5%, red when below a subtitle shows the productivity ratio for the most recent rolling period (e g "past 30 days 82%") hover the score to see a breakdown of reported time, ap produced, ap targets, and expected time click view details to open the page, pre filtered to this request note the "view details" link is only visible to users with team overview permissions quality estimation shows a weighted estimation of annotation quality across all inputs in the request, expressed as a percentage score the score is color coded green at 95% or above, red below 90%, and neutral in between when available, a 95% confidence interval is shown below the score (e g "91 5%–96 8%") a warning icon appears if any inputs could not be estimated hover the score to see a breakdown by precision, recall, geometry, and properties click view details to open the page for this request note quality estimation is based on producer phases only and does not include client phases input progress in this card, you can monitor the progress of the request on an input level the information is intended to help you answer questions such as in which state are the majority of the inputs? are there any delivery ready annotations that i could download already? do we need to review more data? what is an input? an input is a set of sensor data that you want to be annotated as a single entity it usually consists of at least one image/frame it can also contain images from several cameras, a point cloud, a video or a sequence of images the input is a part of an input batch i e a dataset inputs with delivery ready annotations shows the percentage and the absolute number of inputs that have a delivery ready annotation workflow stage distribution this bar chart shows the distribution of inputs between the request's different workflow stages on the input's way toward getting a delivery ready annotation, it goes through a series of workflow stages each stage corresponds to one action in one of the workflow's different phases, such as the action “correct” in the phase “review” which stages the input goes through depends on the workflow used in the request an input can only be in one workflow stage at a time generally, inputs "move forward" in the workflow except that they can circle between the actions inside a phase so, for example, an input can move in between the actions review and correct in the review phase before moving forward to the next phase which stages do i see? which stages the input goes through depends on the workflow used in the request some stages are only visible to the organization being producer for the request an input can only be in one stage at a time you can read more about the stages below what do the workflow stages mean? production not started inputs that are waiting to be annotated annotation annotate inputs that are being annotated using annotate tasks correction correct annotated inputs waiting to be or currently being quality assured using correction tasks review review annotated inputs that are waiting to be or currently are being reviewed review correct annotated inputs that got rejected in review and now either are waiting to be or currently are being corrected delivery delivery ready annotated inputs that have gotten their final annotations and thus are ready for delivery delivery review delivery ready inputs that are waiting for or currently being reviewed in the delivery phase delivery correct delivery ready inputs that are waiting for or currently being corrected in the delivery phase, either due to being rejected in delivery review or being quick rejected