The Kognic Standard Workflow (KSW) is a workflow template that streamlines the process of producing and delivering labels to clients. We aim to establish a standardized production line to provide better monitoring and oversight for managing personnel.

The core principle is that maintaining high performance at the individual level will collectively result in quality labels.

Like all workflows, KSW consists of a set of phases, each with a specific purpose in the production and QA process.

In phases of the type "Annotate", all inputs that enter the phase will be annotated by a labeler. This is done in tasks with the action "Annotate". When a task is completed and the input has been annotated, it moves to the next phase.

The main goal of this phase is to ensure that the quality of labels produced by Annotators aligns with the expectations of Quality Managers (QMs) working on the request.

Read more about Quality Review.

In this phase, Lead Quality Managers (LQMs) review annotations previously examined by Quality Managers (QMs) during the Quality Review phase. LQMs compare errors they identify with those originally found by QMs.

The main goal of this phase is to verify that QMs are performing their duties adequately.

Read more about Expert Verification.

Client QA is an optional phase in which the client reviews a sample of the produced annotations and submits a quality verdict. If the quality meets the acceptance criteria, any errors found during review are corrected before final delivery. If rejected, the producer and client align on the issues before rework begins, ensuring only agreed-upon corrections are made. The phase repeats until the quality is accepted.

Read more about Client QA.

When entering this last phase of the workflow, the annotated inputs become Delivery: Ready and have completed the request. 🎉