Guide: Run a P2P coaching study

a p2p coaching study pairs one fast annotator with a small group — typically 3 to 6 people — for a couple of weeks, and measures whether the group's annotate speed moves this guide walks the whole round 1\ shortlist the people to coach open your project and go to metrics ▸ productivity the user breakdown table at the bottom carries the numbers the choice is made on annotate speed, correction ratio, time allocation, days worked and training sessions in advanced filters , narrow to the people worth coaching — for example training sessions "less than 2 sessions" to skip anyone who has been coached recently, and reported time "more than 8 hours" to skip anyone with too little activity to judge sort by annotate speed to find the slowest of what is left hover a training sessions count to see which rounds someone was already in, and whether they are booked into one that hasn't started yet, shown as (+n) 2\ create the study from the selection tick the users you picked the batch bar reads "n users selected" and offers create study — click it and the create dialog opens with those people already added as members fill in study type p2p coaching name period two weeks by default coach the list is ordered by annotate speed, fastest first, and shows the number each candidate was ranked on pick someone clearly faster than the group select create you can also start from the study tab with create new study and pick members by name there 3\ follow the study open the study from the study tab the cards at the top show each metric and how far it has moved since the study started; annotate speed is the one to watch, and it also has a chart per member the charts plot the group against the project baseline — everyone else in the project — so a project wide change doesn't read as coaching a study needs at least 2 working days of data before it shows a change, and a change only gets a colour when it is bigger than the group's normal day to day movement 4\ adjust the group use manage members to add or remove people while the study runs the same training sessions column is shown there, excluding the study you opened it from 5\ plan the next round back on metrics ▸ productivity , everyone from the finished study now counts one session higher, so the "less than 2 sessions" shortlist moves on to the next group by itself on the study tab, filter the list by type , coach or status to find earlier rounds and compare