19

Back when beta evaluations were conducted by meta post, people could see how other members of the community felt about the site. Each question under review had a net score indicating it was considered good, "meh", or bad and underneath was a discussion in the comments where people could justify their vote and propose ideas on how to make the site better.

This was useful because you could see on what types of questions the community was in agreement on and where they disagreed. The latter often pointed to areas where maybe the quality expectations were unclear, or there was a lack of clarity on site scope, or a number of other things that might merit further discussion.

Now that everything is done in the review queues, most of that is now gone (unless you're a moderator). You can manually go through the profiles of everyone on the recently reviewed list and tabulate votes to figure out what people thought about each question, but that's pretty inefficient once a site becomes big enough to have a lot of people vote. The comments are also completely gone unless someone starts up a meta post.

Can we make the moderator summary visible to all users who are eligible to participate in the community evaluation? That would help the site's community see if everyone is on the same page or identify areas we need to work on to do better on the next review.

15
  • 8
    There is a mod only summary, that's more or less what you want. Perhaps you could update your request to make that summary available to all users (or users over a certain rep threshold). It's a bit silly that reviewers can see each others' evaluations, but not the summary.
    – yannis
    Commented Feb 6, 2013 at 18:17
  • @Yannis: Mods are allowed to share the summary, though. Commented Feb 6, 2013 at 21:57
  • Just ask your mod... there is no need to make a big deal of it. Jeff has said several times in the past that stuff is hidden to avoid dumping info on unsuspecting users (mods are fairly used to it) and all that the user/community needs to do is ask the mod and they can give a summary/post it as long as sensitive information (in this case, none) is withheld. Commented Feb 6, 2013 at 21:57
  • 1
    @Manishearth I wouldn't share without checking with SE first, as with any mod only piece of information. And if there's no reason for the summary to be mod only, then "ask a mod" is a waste of time for everyone involved.
    – yannis
    Commented Feb 6, 2013 at 21:58
  • 1
    I for one intend to post on meta with the results from the site I'm a moderator on. Hopefully that will also be the place to gather the sorts of comments you miss (as do I). FYI: having created my own self-evaluation, the old way was a pain in the neck and a fully automated eval is totally worthwhile. (@Yannis: I already asked if we can share it and got the necessary permission.) Commented Feb 6, 2013 at 22:00
  • @Yannis: SE gave permission. Lemme look for it.. Commented Feb 6, 2013 at 22:02
  • 1
    @Manishearth I'm not doubting that you talked about this with SE prior to sharing the summary, what I'm saying is that it's a waste of time and the summary should be publicly available.
    – yannis
    Commented Feb 6, 2013 at 22:03
  • @JonEricson Yeah, I agree doing the evaluation itself is smoother now. But I'm a little concerned we get less out of the evaluation with the review queues.
    – Troyen
    Commented Feb 6, 2013 at 22:04
  • @Yannis: Ah. I agree with that part :) Though I guess the point is to keep the results secret till the eval gets over. Publishing the general trend may skew voting (I doubt it though) Commented Feb 6, 2013 at 22:05
  • 1
    @Manishearth But... but... but... you can already see how other people are voting, if skewing voting was a concern, voting histories wouldn't be public.
    – yannis
    Commented Feb 6, 2013 at 22:07
  • @Yannis: Ah, but you can't see how all the users are voting at once (that happens in the review history for mods only, IIRC). You can only pick a certain user and check out their eval. Again, I agree with the feature req. Just thinking out loud why SE would make the feature like this :S Commented Feb 6, 2013 at 22:11
  • @Manishearth Besides, in the process of the eval, about half the questions in there I ended up editing, which surely skewed the voting results anyway for people voting later.
    – Troyen
    Commented Feb 6, 2013 at 22:12
  • @Manishearth It's only 10 questions, I got the general feeling of how people are voting in less than a minute in all three sites I care enough to vote in comm. evals. And since I got a diamond on the one site and can see both the vote history and the summary, there's really no difference.
    – yannis
    Commented Feb 6, 2013 at 22:16
  • @Troyen: Yeah.. on the Chem.SE eval (in the old, meta post style), I held off on my urges to fix things, and then did so after it got over. Commented Feb 6, 2013 at 22:18
  • 2
    We are going to address the commenting issue with an automated meta post. I agree that showing the final results makes sense... and I'll try to find a good spot for that. (Maybe added to that meta post, or linked from it, or something.)
    – Adam Lear StaffMod
    Commented Feb 7, 2013 at 3:22

1 Answer 1

10

When an evaluation completes, we now post the result summary as an answer on the automated meta post that will be created at the start of the evaluation.

You can see an example of one here, though for convenience, here's a picture of what it looks like:

Image of a review, the same one linked earlier

3
  • Wow, "Community♦" is getting more and more involved in the, urr, community!.
    – Matt
    Commented Jul 30, 2013 at 14:23
  • @Grace why picture and not quote? I was going to edit but then stopped wondering if there was a reason behind this. Commented Jul 30, 2013 at 14:25
  • @ShaWiz No real reason. But it gives me a solid image that I can link in any context I want, unlike text that is subject to the medium it is presented in.
    – Grace Note StaffMod
    Commented Jul 30, 2013 at 14:28

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .