PROJECT MANAGEMENT
Annotation Workflows
Kognic Standard Workflow
5 min
limited access this workflow is currently under development and is only available to a limited number of organizations the kognic standard workflow (ksw) is a workflow template that streamlines the process of producing and delivering labels to clients we aim to establish a standardized production line to provide better monitoring and oversight for managing personnel the core principle is that maintaining high performance at the individual level will collectively result in quality labels phases like all workflows, ksw consists of a set of phases, each with a specific purpose in the production and qa process annotate in phases of the type "annotate", all inputs that enter the phase will be annotated by a labeler this is done in tasks with the action "annotate" when a task is completed and the input has been annotated, it moves to the next phase quality review the main goal of this phase is to ensure that the quality of labels produced by annotators aligns with the expectations of quality managers (qms) working on the request read more about docid\ f6zspdjlhc7qaubqovp3l expert verification in this phase, lead quality managers (lqms) review annotations previously examined by quality managers (qms) during the quality review phase lqms compare errors they identify with those originally found by qms the main goal of this phase is to verify that qms are performing their duties adequately read more about docid\ g0xuqwbiziyojw7jyhayj client qa client qa is an optional phase in which the client reviews a sample of the produced annotations and submits a quality verdict if the quality meets the acceptance criteria, any errors found during review are corrected before final delivery if rejected, the producer and client align on the issues before rework begins, ensuring only agreed upon corrections are made the phase repeats until the quality is accepted read more about docid\ wrc okywzeq0kdyskb0mh delivery when entering this last phase of the workflow, the annotated inputs become delivery ready and have completed the request π
