Guide: Plan a round of P2P sessions
5 min
the planner composes coaching groups across a whole project and creates a study for each of them in one go use it when several groups need to run in parallel β for a single group, creating one study by hand is quicker 1\ find the projects that need a session open team management βΈ p2p sessions the coverage tab lists every active project in your workspaces, with the ones needing attention first look for rows reading above threshold in status β the gap between the fastest and slowest fifth of annotators exceeds the trigger β together with a state of never run or inactive since a date some weeks back click a row first to see what has already run there a project that looks untouched may have a session booked for next week 2\ open the planner select auto suggest on the project's row the dialog opens with groups already suggested it groups the candidates the table has already loaded, so nothing needs fetching first groups are built from people of similar annotate speed and never span two annotator organizations, so no group needs a coach who cannot work with it 3\ set who the session is for under coach , choose how far down the distribution the session reaches below project median β the default more groups usually run in parallel when a large share of a project needs coaching bottom 20% β only the slowest fifth everyone β includes people with no measurable annotate speed, who no speed rule can rank reviewers are left out by default tick include reviewers to bring back anyone whose review time is at least five hours and at least matches their annotate time β likely a reviewer or qm rather than an annotator people with too little annotation work in the last four weeks to read β under five days with output, or under five annotate hours β are never grouped that is a hard floor, not a filter, and it is a statement about how much data exists, not about performance the planner reports how many were held back for it 4\ shape the groups target group size defaults to 6 max groups is optional; leave it empty for no limit change either and select suggest again to re roll the plan everyone excluded is reported under the groups rather than silently dropped, with the reason already in a study that is running or booked coached in the last 10 days, with the date they are eligible again too little annotation work to place not a coaching target under the current coach setting held back because a filter is unticked left over because the plan hit its group cap each group gets a suggested coach from the 30β40 percentage point band above the group's average β the process document's trainer guideline a coach outside the band is still offered, with a note saying so; a larger gap is acceptable when nobody sits in the band, a smaller one is worth avoiding 5\ override anything remove a group, remove a member, or use add member to add anyone by hand adding by hand is how every suggestion rule gets overridden β including the cooldown, so someone you want to coach again sooner is still available a group needs at least 2 members one that falls below asks you to add someone or remove it 6\ create the studies enter a study name and the session dates , then select create n studies one study is created per group, named after your prefix and the group number each group reports its own outcome if some fail, the plan stays on screen and retry failed groups resubmits only those β the ones already created are not touched while the batch runs, both create and close are held, so a group cannot be submitted twice and a half finished run cannot be walked away from 7\ follow the round back on p2p sessions , the projects you just planned move to ongoing in state , with the number of sessions running or booked reviews due then tells you when each reports the first review on the first monday after the session, the second on the monday the two weeks end impact carries what the round changed once the readings are in