PROJECT MANAGEMENT
Annotation Workflows
Kognic Standard Workflow π
5 min
limited access this workflow is currently under development and is only available to a limited number of organizations the kognic standard workflow (ksw) is a workflow template that streamlines the process of producing and delivering labels to clients we aim to establish a standardized production line to provide better monitoring and oversight for managing personnel the core principle is that maintaining high performance at the individual level will collectively result in quality labels phases like all workflows, ksw consists of a set of phases, each with a specific purpose in the production and qa process annotate in phases of the type "annotate", all inputs that enter the phase will be annotated by a labeler this is done in tasks with the action "annotate" when a task is completed and the input has been annotated, it moves to the next phase quality review the main goal of this phase is to ensure that the quality of labels produced by annotators aligns with the expectations of quality managers (qms) working on the request expert verification in this phase, lead quality managers (lqms) review annotations previously examined by quality managers (qms) during the quality review phase lqms compare errors they identify with those originally found by qms the main goal of this phase is to verify that qms are performing their duties adequately client qa (optional) delivery when entering this last phase of the workflow, the annotated inputs become delivery ready and have completed the request π