Respond to 50% of Meta posts from across the network, to which status-review was added during this period. [met, got to ~68% (no change from previous period); see below for details]
Respond to 75% of Meta posts from across the network, where status-review was added to it in a previous period. [not met, only got to ~45% (14% drop from previous period); see below for details]
As a follow-up to last quarter's ticket smash, we've been going through outstanding requests on a weekly basis, with the intention of reducing the Public Platform team's backlog. We plan to continue doing this during this quarter. [partially met; while we continued to go through the backlog, we failed to meet the 75% goal as seen above]
Review Queues: last quarter, we overhauled the Review Queue interface and refreshed each queue to provide reviewers with more context to make deliberate decisions on review tasks. This quarter, we'll be releasing an onboarding experience to provide reviewers with better guidance to make their reviewing experience more successful, and we'll also be working on optimizing review queue workflows to address some long standing pain points with how effectively posts pass through various queues. Please highlight posts that are relevant to that project. See the post for more details.
Outdated Answers: last quarter, we kicked off a project to begin tackling the issue of outdated answers, and we ran a survey to better understand the various use cases that might cause an answer to be out of date. This quarter we plan to release a temporary flagging mechanism that will allow users to flag and classify out-of-date or less-than-optimal answers, so that we can collect a data set to analyze. The data we gather will allow us to quantify how pervasive the issue of outdated answers is on Stack Overflow. If you have posts that are relevant to that discovery, we'd like to see 'em. See this post for more details.
New User Onboarding: we're kicking off discovery on onboarding, so if you have posts surrounding issues of educating new users about the platform and guiding them through their first critical experiences and setting them up for success, please escalate them.
Requests to test 3-vote close and reopen on sites: we're currently running tests to change the number of votes needed to close or reopen a post from 5 to 3 on 13 sites. Sites interested in testing this should have moderators status-review a request that has the support of the community.
Stats for the period:
Overall numbers:
A total of 236 questions had status-review on them at some point during this period, and made their way into the process:
- 165 (~70%) got the tag added during this period; of these 113 (~68%) got a staff response (89 [~54%] within 2 weeks of the tag getting added), and 118 (~72%) got status-review removed.
- 71 (~30%) already had the tag on them; of these 32 (~45%) got a staff response, and 31 (~44%) got status-review removed.
New this period:
A total of 165 questions across all Meta sites got status-review added to them. The tag was added by a staff member on 61 (~37%) of these, and the other 104 (~63%) had the tag added by a moderator.
This means there was a larger amount of posts escalated when compared to the previous period (+71 posts; ~+76%).
The majority of questions came from the various Metas from all over the network, followed by MSE, and MSO:
- 51 (~31%) from MSE.
- 30 (~18%) from MSO.
- 84 (~51%) from other child Metas.
Most of the questions escalated were bug reports or feature requests, but there were posts of all types escalated to staff (note that tags are not mutually exclusive):
A total of 113 questions (~68%) got some sort of response from staff after the tag was added, and 89 (~54% of total; 79% of responded) got a response within 2 weeks of status-review getting added. The average time elapsed between the tag getting added and any sort of response was ~9d 13h (min. of ~0.1h; max. of ~82d 16h; median of ~50h). Of these:
- 26 questions (~23% of responded; ~16% of total) had their first response from staff in the form of an answer. The average time elapsed between the tag getting added and that answer getting posted was ~9d (min. of ~0.1h; max. of ~45d 15h; median of ~2d 15h). 21 (19% of responded; 13% of total) of these questions got an answer within 2 weeks of the tag getting added to them.
- 35 questions (~31% of responded; ~21% of total) had their first response from staff in the form of a comment. The average time elapsed between the tag getting added and that comment getting posted was ~2d 20h (min. of ~1min; max. of ~16d 9h; median of ~5h). 33 (29% of responded; ~20% of total) of these questions got a comment within 2 weeks of the tag getting added to them.
- 52 questions (~51% of responded; ~38% of total) had their first response from staff in the form of an edit (to remove the status-review tag and/or add another status tag, for the most part). The average time elapsed between the tag getting added and that edit getting submitted was ~14d 15h (min. of ~0.1h; max. of ~82d 16h; median of ~5d 18h). 35 (31% of responded; 21% of total) of these questions got an edit within 2 weeks of the tag getting added to them.
Most responses ended up resulting in a corresponding tag edit, and 118 (~72%) questions got status-review removed. 103 of these got removed by staff, and the other 15 by a moderator. Of these:
- 62 questions (~53% of untagged; ~38% of total) got status-completed added to them.
- 3 question (~3% of untagged; ~2% of total) got status-bydesign added to them.
- 14 questions (~12% of untagged; ~8% of total) got status-declined added to them.
- 2 questions (~2% of untagged; ~1% of total) got status-norepro added to them.
- 18 questions (~15% of untagged; ~11% of total) got status-deferred added to them.
- 10 questions (~8% of untagged; ~6% of total) got status-planned added to them.
- 1 question (~1% of untagged; ~1% of total) got status-reproduced added to them.
- 8 questions (~7% of untagged; ~5% of total) didn’t get a new status tag added.
1 question that had been tagged status-review during this reporting period was also deleted over the reporting period.
It’s also worth noting that of the 113 posts that got a response from staff, 61 had status-review added by staff, and the other 104 by mods:
- 61 tagged by staff, 51 responded, 10 unresponded
- 104 tagged by mods, 62 responded, 42 unresponded
From previous periods:
A total of 711 questions across all Meta sites still had status-review on them at some point during this period. The tag had been added by a staff member on 26 (~37%) of these, and the other 45 (~63%) had the tag previously added by a moderator.
The majority of questions came from network Metas, followed by MSE, and MSO:
- 27 (~38%) from MSE.
- 15 (~21%) from MSO.
- 29 (~41%) from other child Metas.
Most of the questions escalated were bug reports or feature requests, but there were posts of all types escalated to staff (note that tags are not mutually exclusive):
A total of 32 of these questions (~45%) got some sort of response from staff during this period, and after the tag was added. The average time elapsed between the tag getting added and any sort of response was ~214d (min. of ~8d 19h; max. of ~415d 2h; median of ~233d 3h). Of these:
- 9 questions (~28% of responded; ~13% of total) had their first response from staff in the form of an answer. The average time elapsed between the tag getting added and that answer getting posted was ~132d 19h (min. of ~8d 19h; max. of ~308d 6h; median of ~79d 9h).
- 23 questions (~72% of responded; ~32% of total) had their first response from staff in the form of an edit (to remove the status-review tag and/or add another status tag, for the most part). The average time elapsed between the tag getting added and that edit getting submitted was ~245d 19h (min. of ~11d 14h; max. of ~415d 2h; median of ~262d 4h).
Most responses ended up resulting in a corresponding tag edit, and 31 (~44%) questions got status-review removed. 29 of these got removed by staff, and the remaining 2 by a moderator. Of these:
- 12 questions (~39% of untagged; ~17% of total) got status-completed added to them.
- 2 questions (~6% of untagged; ~3% of total) got status-declined added to them.
- 1 question (~3% of untagged; ~1% of total) got status-norepro added to them.
- 7 questions (~23% of untagged; ~10% of total) got status-deferred added to them.
- 9 questions (~29% of untagged; ~13% of total) got status-planned added to them.
1 question that had been tagged status-review during previous reporting periods was deleted over this reporting period.
It’s also worth noting that of the 32 posts that got a response from staff, 13 had status-review added by staff, and the other 19 by mods:
- 26 tagged by staff, 13 responded, 13 unresponded
- 45 tagged by mods, 19 responded, 26 unresponded
Footnotes:
1 If you're paying attention to previous posts, you maybe expected this number to be 78. Some posts have since been deleted, though, so I just removed them from the total count, instead of counting them as "responded" in some way. Furthermore, we tweaked the query used to pull the data for these reports, so reports from here on are actually more accurate than previous ones... which is to say that between Q1 and Q2 numbers, Q2's (and any future quarters') numbers are more accurate.
