SlideShare a Scribd company logo
Take Your Blue Email Notifications
to the Next Level
Gaurav Gupta
Virginia Commonwealth University
About Virginia Commonwealth University
Urban university with two campuses
13 schools and one college
31,000 students
17,500 courses per year
6% short courses
History of course evaluation at VCU
Paper and pencil
evaluations until 2009
Switched to Online
evaluations in 2009
Switched to Blue
in 2013
Course evaluation by the numbers
225,000 evaluations per year
200,000 emails per year
We have learned a lot
in last 6 years
Goals of our
communication strategy
Goal 1
Increase response rate
Goal 2
Get quality feedback
Goal 3
Increase transparency,
reduce confusion and
improve satisfaction
Goal 4
Reduce the need for
troubleshooting
Lessons we have learned…
1. We are salespeople
2. Email is our best
marketing tool
E-mail remains a significantly more effective way
to acquire customers than social media – nearly
40 times that of Facebook and Twitter
combined.”
- McKinsey & Company
Source: http://www.mckinsey.com/insights/marketing_sales/why_marketers_should_keep_sending_you_emails
“
After trying for a few semesters we stopped
using posters, postcards, Twitter, Facebook,
campus TV and raffle prizes
3. Content is king
Content we include in our emails
Emails to students include
Introduction
List of open evaluations and their due dates
Link to evaluation forms
Importance of their feedback and how it will be
used
Confidentiality
Contact information
Unsubscribe link
Emails to faculty include
Introduction
List of evaluations
Start and end dates, report availability
Link to check response rates
How to improve response rate and get better
feedback
Contact information
Unsubscribe link
A/B testing
A/B testing basics
Create two versions of an email
Divide email recipients into two groups
Send different versions of email to each group
Measure completion rate
Subject line:
It’s Time to Give Feedback
to Your Instructors
Subject line:
It’s Time to Evaluate Your
Instructors
A B
✓
13% more responses
Subject line:
Reminder: Please
Evaluate Your Courses
and Your Instructors
Subject line:
Need a Study Break? Take
a Few Minutes to
Evaluate Your Professors
A B
✓30% more responses
Faculty testimonials
With testimonial Without testimonial
A B
No significant difference
A
B
✓
6% more
responses
Subject line:
Your Course Evaluations
are Still Pending
Subject line:
Reminder: Your Course
Evaluations are Still
Pending
A B
✓12% more responses
Subject line:
Only 3 Days Left to
Evaluate Your Professors!
Subject line:
Your Course Evaluations
are Due in 3 Days
A B
No significant difference
Dear eXplorance,
Can you please bring A/B testing to Blue
Tips for writing great content
Pay attention to subject line
A well designed subject line can make big impact
Put yourself in their shoes
If you were a student or instructor,
what information would be helpful to you
Are they asking you the
same questions repeatedly?
Consider including this information in the email
Be conversational
Keep it to-the-point
Avoid being clever, using puns
Sound official, authoritative
Don’t beg, make them care instead
Create a sense of urgency
instead of
“please complete your evaluations”
say
“evaluations are due in 2 days”
Divide up content into small sections
Use headings
Without headings
With headings
4. Personalize to the right extent
Two banks
Two very different emails
Take Your Blue Email Notifications to the Next Level
Take Your Blue Email Notifications to the Next Level
Which email would you rather receive?
0	
  
200	
  
400	
  
600	
  
800	
  
1000	
  
04/21/2011	
  00	
  
04/22/2011	
  00	
  
04/23/2011	
  00	
  
04/24/2011	
  00	
  
04/25/2011	
  00	
  
04/26/2011	
  00	
  
04/27/2011	
  00	
  
04/28/2011	
  00	
  
04/29/2011	
  00	
  
04/30/2011	
  00	
  
05/01/2011	
  00	
  
05/02/2011	
  00	
  
05/03/2011	
  00	
  
05/04/2011	
  00	
  
Evals	
  Completed/Hour	
   Generic	
  email	
   Personalized	
  email	
  
Personalized email improved our response rate (Spring 2011)
Personalized data used at VCU
Name
List of courses
Instructor names
Due dates
Personalized subject line
Take Your Blue Email Notifications to the Next Level
Almost any data can be included
5. Formatting the email
Unformatted
Formatted
Find a web designer
Tips for your web designer
Use call to action buttons instead of links
Minimize use of images
Use inline CSS
Responsive design
Resources for your web designer
Responsive email tutorial
http://webdesign.tutsplus.com/articles/creating-a-simple-responsive-html-email--webdesign-12978
BeeFree
https://beefree.io/
Zurb CSS Inliner
http://zurb.com/ink/inliner.php
6. Getting the timing right
Typical course evaluation cycle
(14 days)
Course duration ExamsEvals Reports
Typical communication cycle
ExamsEvals Reports
Email to students
Email to instructors
We analyzed data from
last four semesters
Evaluations completed/hour – Fall 2013
0	
  
200	
  
400	
  
600	
  
800	
  
Sun	
   Mon	
   Tue	
   Wed	
   Thu	
   Fri	
   Sat	
   Sun	
   Mon	
   Tue	
   Wed	
   Thu	
   Fri	
   Sat	
  
Emails
sent
Evaluations completed/hour – Spring 2014
0	
  
200	
  
400	
  
600	
  
800	
  
1000	
  
Thu	
   Fri	
   Sat	
   Sun	
   Mon	
   Tue	
   Wed	
   Thu	
   Fri	
   Sat	
   Sun	
   Mon	
   Tue	
   Wed	
  
Emails
sent
Evaluations completed/hour – Fall 2014
0	
  
200	
  
400	
  
600	
  
800	
  
1000	
  
1200	
  
Sun	
   Mon	
   Tue	
   Wed	
   Thu	
   Fri	
   Sat	
   Sun	
   Mon	
   Tue	
   Wed	
   Thu	
   Fri	
   Sat	
  
Emails
sent
Evaluations completed/hour – Spring 2015
0	
  
200	
  
400	
  
600	
  
800	
  
1000	
  
Thu	
   Fri	
   Sat	
   Sun	
   Mon	
   Tue	
   Wed	
   Thu	
   Fri	
   Sat	
   Sun	
   Mon	
   Tue	
   Wed	
  
Emails
sent
Best days to send emails
Monday – Thursday
First and last day of evals
> Friday – Sunday
> Thanksgiving / long weekends
Evaluations completed/hour in a single day – Spring 2015
0	
  
150	
  
300	
  
450	
  
12	
  AM	
   3	
  AM	
   6	
  AM	
   9	
  AM	
   12	
  PM	
   3	
  PM	
   6	
  PM	
   9	
  PM	
  
Tue	
   Wed	
   Mon	
  
Best time to send emails
10am
time required to
send all emails
(3-6 hours for us)
minus
7. Testing
Testing process
Create a test project with 4-6 courses
Add yourself and student and instructor to each
course
Compose email and send it
Test after every edit, even if it is a minor one
Take Your Blue Email Notifications to the Next Level
Another feature request:
Easier way to send test emails
Thanks!
I would love to hear from you
guptag@vcu.edu
@FrshBakedPixels

More Related Content

Take Your Blue Email Notifications to the Next Level