Project Studies

a study tracks how a group of members improves over a set period you pick the members and set a start and end date the page then compares their work against the rest of the project use a study to follow a coaching effort or any group whose progress you want to measure over time available as a tab inside your project study types p2p coaching one coach and their students pick the coach, then add the students as members group tracking a group of members with no coach use this to follow any group you choose p2p coaching is the default create a study open a project, go to study in the left menu, and select create new study then fill in study type p2p coaching or group tracking name period the start and end date new studies default to two weeks, which is the usual length — change either date if you need a different window a study that starts today is already running coach p2p coaching only candidates are ordered by annotate speed , fastest first, and each option shows the speed it was ranked on members with no annotation work in the last 7 days sit at the bottom without a number a coach needs to be fast enough to have something to teach, so this ordering is the shortlist members search by name, or paste a list of emails each option also shows the member's annotate speed, but the list keeps its normal order — these are the people being coached, not the coach a study needs at least one member if a pasted address is not a member of the project it is named back to you rather than dropped, so you can correct it before creating the study you can only add members you have workforce access to you can change the members later under manage members members you are about to add stay highlighted until you save metrics every study tracks four metrics annotate speed is the main one annotate speed how fast members annotate, as a percentage of target 100% means they reach the target pace only annotation work counts it leaves out review and correction time higher is better quality score the quality from review sampling, from 0 to 100% higher is better time allocation ratio the share of reported working time spent in the task view (annotate, review, and correction) a healthy range is 75 to 90% correction ratio the share of task view time spent on corrections lower is better, because it means less rework training sessions training sessions counts how many p2p coaching studies in this project a user has already taken part in, so you can spread coaching around instead of picking the same people every round it shows up in two places the manage members panel of a study, and the user breakdown table on the metrics ▸ productivity tab how the count is built only p2p coaching studies count group tracking studies are left out, and a coach is not counted as having been coached only studies that have started count someone booked into a round that hasn't started yet is shown after the count as (+n) — for example 2 (+1), or — (+1) for someone who has never been coached bookings are deliberately kept out of the number, which is a statement about the past hover a count to list the sessions behind it the studies the user was coached in with the date each ended, and, under their own heading, the rounds they are booked into with the start date opening the column from inside a study excludes that study, so its own members do not appear as already coached by it the column is only shown when the project's studies can be read without study access, or if the studies fail to load, the column and its filter are left out rather than showing a dash, which would read as "never coached" reading a study the cards at the top show the current value of each metric and how much it has changed since the study started the color shows how sure we are about the change green a clear improvement red a clear drop grey the change is small and could just be normal day to day movement, so we do not call it good or bad time allocation is green when it sits in the healthy 75 to 90% range how the change is measured the change does not compare two single days instead it draws a line through the group's daily values during the study to find the overall direction it then takes where that line sits over the last 3 working days and compares it to the 3 working days before the study started using every day makes the number stable, so it does not jump around if you move the start or end date by one day the study skips days with no reported time, so a day off does not count against the group after a study ends, it only uses days up to the end date a study needs at least 2 working days of data before it shows a change one day is not enough to see a direction, so until then the change stays grey the change only gets a color when it is larger than the group's normal day to day movement before the study if the group already went up and down a lot, a small change stays grey and shows "within normal range", because it may just be noise a larger and steadier change is more likely to show as a real improvement or drop charts and header the charts plot the study group against the project baseline, which is the average of everyone else in the project annotate speed also has a chart per member, so you can see each person switch between daily and weekly , and turn on hide days without reported time to drop idle days a line marks the study start the header shows the status ( not started , ongoing , or completed ), how many days are left or how long since the study ended, and the coach for a p2p study the studies list the project's study page lists every study, with a column for the study type (p2p coaching or group tracking) and, for coaching studies, the coach group tracking studies show a dash for coach narrow the list with the filter bar at the top status , type and coach — pick any number of values in each every option shows how many studies it covers, for example ongoing (3) selecting nothing and selecting everything both show all studies the coach filter includes a no coach option for group tracking studies, and is hidden entirely on projects with no coaching studies search — filter by study name sort by any column studies that tie on the column you sorted by are ordered by name, so the list stays in the same readable order when you flip the sort direction the speed change column shows each study's annotate speed change since it started, in percentage points it uses the same colors as the cards green or red for a clear move, grey when the change is within the group's normal range who sees what anyone with access to the project can use studies you only see and add members you have workforce access to the person who created a study can edit or delete it