Return to Question

So, what now?

Based on what we saw, we have decided to graduate the inbox notifications. The following is now live, network wide:

As far as whether or not to graduate the email, we are going to open a new experiment (that will run for approximately one month), in which we will have three groups:

We will make a final decision about the email based on the results of this experiment. We welcome your feedback below and questions on the experiment and new features.

Experiment, take 2

Based on what we saw, we decided to graduate the inbox notifications. The following is now live, network wide:

As far as whether or not to graduate the email, we opened a new experiment in mid-November (that ran for approximately two months), in which we had three groups:

Final Result: Closed emails after one day

The second round of the experiment included over 87,000 closed posts.

Findings:

• The email sent one hour after the post CloseDate had no significant effect on edit rates for those posts by post owner (8.50% edited with inbox only versus 8.64% with email).
• The email sent after one day did have a significant effect on the edit rates by post owner: 3.86% (versus 2.08% of posts edited after one day in the inbox-only control group).

Based on these results, we have graduated the closed email experiment, sending emails to users one day after post close. This excludes posts where the post owner has already edited the post, where the post is deleted or reopened, or where the post owner has indicated that they do not want to receive emails of this nature.