PROJECT MANAGEMENT
...
Annotation Requests
Guides
Guide: Review management
15min
when responsible for the review of a request your organization gets access to review management tooling the main benefit of this tooling is that it allows you to manage your own review team as well as how the review tasks are distributed your organization could be only responsible for the review step of the delivery or the full production process in both situations, you would have access to our review management tooling, either as the only management tooling or as a part of the full management offering the review team in the tab team you can determine which users that should work on the request as well as monitor and manage them you can always see all team members from your organization as well as organizations that your organization has workforce access to read more details in the team docid\ fiopd5ytqela7kyahrpyl tab's documentation add review team members you add team members by clicking the "add team members" button you find the button at the top right corner of the team members table the button opens a dialog in which you select which users to add, which responsibility, and which task allocation type they should have for team members that should do review you select the review responsibility this ensures the team member gets access to review tasks automatically when there are such tasks available if your organization does not have the request role producer you will only be able to select the review responsibility or the option none selecting users can be done by searching and selecting users in the dropdown menu or by pasting emails for the users you want to add to the team when pasting multiple emails, they should be comma separated if you add a team member with the task allocation type automatic they will have access to tasks immediately after being added to the team (if tasks are available) if they have manual allocation you will have to assign them to tasks manually before they can start working manage review team you will be able to see all team members from your organization as well as organizations that your organization has workforce access to for these users you will be able to see their last task activity, how many tasks they currently are assigned, their responsibility and their task allocation type you can read more about this on the team page change responsibility the responsibility of a team member can be changed by clicking on their responsibility in the team members table and then selecting another option in the menu when changing responsibility all new tasks that become available for the team member will be determined based on the new responsibility any not started tasks (in the to do state) will be expired if your organization has the request capability review you will only be able to change between/to the responsibility review or the option none changing task allocation type the task allocation type can be changed by interacting with the buttons in the "task allocation type" column this action only affects how tasks will be assigned going forward any already assigned tasks will remain assigned to the user if you want to affect what tasks remain assigned to the user, you can do that from the tasks docid\ nzjynohsym97 hqecnq4w tab remove a team member to remove a team member you first find the team member which you want to remove from the request and click the 3 dots next to the responsibility of the team member to reveal the option to remove when you remove a team member all of their assigned tasks in the request will be expired, including ongoing ones managing review tasks in the tab tasks you can see all tasks that we deem relevant to you based on your request capabilty if your organization has the request capability review your will only see review tasks on the tasks page meaning that other tasks exists but you don't have access to view or manage them what is a task? a task is what ties an input to a team member and what type of action the team member should take with the input there are three types of tasks annotate , correct and review on its way from original input to a delivery ready (or final ) annotation, the input spawns one or multiple tasks, and even multiple tasks of the same type the number of tasks depends on the workflow used in the request and/or if tasks expire and get assigned to new users in a review task the team member is asked to determine if an annotation is of acceptable or unacceptable quality if the task quality is unacceptable the team member is expected to provide correction requests and feedback to the annotator read more about the other task types in the tasks docid\ nzjynohsym97 hqecnq4w tab documentation task information for each task you will be able to see information about its assignment status, workflow stage, type, time spent, status and if it is the final task that lead to the input becoming delivery ready your will also see its id as well as the inputs external id this information is there to help you answer questions such as how is a certain task progressing? what task are a specific team member working on and which other tasks have they been assigned? are there any not assigned tasks that i could assign to available team members? task actions depending on the task's state you can do different actions with it the main actions you need to know about are expire and assign these will be described further below expire the purpose of the expire action is to make a task available for another team member when expiring a task a new task will be created, with the same initial states as the original one this means that work done on the expired task wonβt be transferred to the new tasks nor become part of the final annotation work done on the expired task wonβt be transferred to the new tasks nor become part of the final annotation assigned tasks that are in state to do or ongoing can be expired at expiry, the assigned user will lose access to the task and if the assigned user is currently working on the expired task they will be notified assign tasks that aren't assigned can be assigned to a team member manually if you want to assign an ongoing task to a different team member than the currently assigned one, you need to expire and assign the task how to conduct task actions you can conduct task actions per task or for multiple tasks at once where and how to do it will be described below actions for individual tasks from the context menu ( ) of one task, you can for each assigned task which is to do or ongoing expire it expire & assign it for each unassigned task (which are all to do) assign it batch actions for batch actions you can use the selection box in the header, the drop down next to it or the selection boxes on each row to select tasks for batch actions each batch action only works on certain task selections, so pay attention to the notification bar in the bottom batch expiration of non completed tasks assigned to a single team member when you have selected tasks, that are to do or ongoing, and are assigned to a single team member, you can expire all of them with a single action from the bar at the bottom monitoring the review process you can read about our review monitoring in detail on the page review docid\ chszfp4bverygs2 jn0rf