SlideShare a Scribd company logo

Testing

•
•
A
Anu_Thanedar

The document summarizes the results of a usability test conducted on the Xerox PrintBack mobile printing solution. 6 participants tested the setup and installation of PrintBack on various phone and computer platforms. The test aimed to evaluate the installation process and printing/saving functionality. Results found the mobile app installation was easy but the computer version needed clarification. Feedback suggested making the download easier to find on websites and clarifying steps after installation. In general, saving documents and printing from mobile were difficult to use. Recommendations included simplifying language, explaining saving benefits, and improving system feedback and status visibility across devices.

Related slideshows

Modern Usability Tools & Techniques
Modern Usability Tools & TechniquesModern Usability Tools & Techniques
Modern Usability Tools & Techniques
 
How many tasks is too many
How many tasks is too manyHow many tasks is too many
How many tasks is too many
 
Real world dev ops
Real world dev opsReal world dev ops
Real world dev ops
 
1 of 35
Download to read offline
Usability Testing : XEROX PrintBack Brianna Slutsky Master of Science, Applied Experimental & Engineering Psychology at RIT Nicholas Iuliucci Master of Science, Applied Experimental & Engineering Psychology at RIT Anushri Thanedar Master of Science, Human Computer Interaction at RIT Erroyl Rolle Master of Science, Human Computer Interaction at RIT Sunday, May 27, 12
Agenda 1. What is the product 2. Target Audience 3. Evaluation Goals 4. How we ran the test 5. Methods and Procedures (How we set it up) a. Setup b. Actual test 6. Findings Data Analysis a. Qualitative data b. Quantitative data c. Recommendation Sunday, May 27, 12
PRODUCT • XEROX PrintBack • Client: XEROX •What is PrintBack: “ A Mobile Printing Solution” Sunday, May 27, 12
PRODUCT Smartphone Default Printer Computer Dropbox/ Email +_____________ PrintBack Sunday, May 27, 12
BENEFITS TO THE USERS • Print Intelligent, Go Mobile • No more wait, print anywhere, anytime • Print Document and Photos • Un-compromised print quality Sunday, May 27, 12
TARGET USER & AUDIENCE Sunday, May 27, 12
TESTING GOALS • Test PrintBack app & installation on IOS device • Test PrintBack app & installation on Android device • Test PrintBack installation on Windows 7 PC • Test PrintBack installation on Mac OS Sunday, May 27, 12
CLIENT FOCUS • Setup and installation on the phone and computer A. Windows7 + iPhone preferred combination • Ease of downloading PrintBack • Printing from Dropbox and email • Saving Documents On computer/phone Sunday, May 27, 12
PLATFORM Users Platform User 1 PC-Android User 2 Mac-iPhone User 3 PC-Android User 4 PC-iPhone User 5 Mac-Android User 6 PC-iPhone Sunday, May 27, 12
TESTING PARTICIPANTS 1 2 1 2 PC-Android Mac-iPhone PC-iPhone Mac-Android Sunday, May 27, 12
TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
TESTING SETUP Sunday, May 27, 12
TESTING SETUP Sunday, May 27, 12
TESTING SETUP Sunday, May 27, 12
TESTING SETUP Sunday, May 27, 12
TEST PROCEDURES • Participant greeted • Download PrintBack on the Computer • Download PrintBack on the Smartphone A. Recorded using Camtasia, USB Webcams and mobile sled • Take a picture and save it to the “Print Using” location • Print a PDF, from a mobile device Sunday, May 27, 12
TESTING TASKS 1.Pre-Test Survey 2.Task 1(Download PrintBack from the company website on computer) • Post-Test Survey 3.Task 2 (Find and Download PrintBack App on Mobile Phone) • Post-Test Survey 4.Tasks 3 + 4 Printing and Saving • Post-Test Survey 5.Interview and Debriefing Sunday, May 27, 12
Sunday, May 27, 12
QUALITATIVE RESULTS • Computer Installation: • "Make the download easier to find." • "On the page that talked about print back drivers and installers a bolded download PrintBack link perhaps." • "I was a little confused what to do once you installed the program." Sunday, May 27, 12
QUALITATIVE RESULTS • Mobile Installation: • "Once I realized that the app was not already downloaded, I downloaded it from the app store it became very easy to install and use." • “The mobile print idea is great, but it has to print from any printer. I get lost, I am not a phone tech person.” Sunday, May 27, 12
QUANTITATIVE RESULTS 3 2 1 Mobile Overall How would you rate your overall experience of installing PrintBack on your mobile device? somewhat poor very enjoyable acceptable Sunday, May 27, 12
QUANTITATIVE RESULTS 1 5 Mobile Installing (1=Very Poor to 5=Easy-to-Use) very easy-to-use easy-to-use Sunday, May 27, 12
QUANTITATIVE RESULTS 4 2 Mobile Setting-Up (1=Very Poor to 5=Easy-to-Use) easy-to-use very easy-to-use Sunday, May 27, 12
MOBILE FEEDBACK users Do you have any suggestions for the future of this system? User 2 Once I realized that the app was not already downloaded, I downloaded it from the app store it became very easy to install and use. User 5 I like it. It didn't seem as complicated as some apps I've worked with... I guess it was so easy that I thought I must have missed something. User 6 Not sure how I link it to my printer exactly... I wish that was more explicit Sunday, May 27, 12
QUANTITATIVE RESULTS 2 3 2 Computer overall How would you rate your overall experience using this system? somewhat poor acceptable neutral Sunday, May 27, 12
QUANTITATIVE RESULTS 2 3 Computer Installing (1=Very Poor to 5=Easy-to-Use) very easy-to-use easy-to-use NOTE: user 6 website connection lost Sunday, May 27, 12
COMPUTER FEEDBACK users Do you have any suggestions for the future of this system? User 1 Make the download easier to find. User 2 I was a little confused what to do once you installed the program. User 3 On the page that talked about PrintBack drivers and installers a bolded download PrintBack link perhaps. User 4 Couldn't find the xerox PrintBack download button without having to search for it on the site. A few questions I was unsure of the answers to make the correct selections. User 5 If the program could install right to my application folder... or give me a save as function. User 6 The link to the download page was not working, therefore I could not complete the full task. It was very easy to find the download, but the link to download it was broken. Hence, I don't know that I can answer most of this survey meaningfully. Sunday, May 27, 12
PRINTING & SAVING • Saving: “poor” or “somewhat poor” ease-of-use, and overall experience was “very difficult” • Printing from Mobile: majority said it was at least “somewhat difficult” in terms of usage and all said the experience was “somewhat poor” Sunday, May 27, 12
RECOMMENDATIONS • Make use of more naturalistic wording • Explain why users should make use of PrintBack for saving • Further develop user interface for PC to increase system status visibility and feedback • Increase clarity of system model • Increase error prevention Sunday, May 27, 12
BUG ON THE MAC information overlap the link to dropbox is hidden Sunday, May 27, 12
PROFESSIONAL RECOMMENDATIONS • Use less text, wherever possible • More feedback across steps • Increase visibility of system status • Increase clarity of setup process for associated programs Sunday, May 27, 12
THANK YOU! Sunday, May 27, 12

More Related Content

Testing

  • 1. Usability Testing : XEROX PrintBack Brianna Slutsky Master of Science, Applied Experimental & Engineering Psychology at RIT Nicholas Iuliucci Master of Science, Applied Experimental & Engineering Psychology at RIT Anushri Thanedar Master of Science, Human Computer Interaction at RIT Erroyl Rolle Master of Science, Human Computer Interaction at RIT Sunday, May 27, 12
  • 2. Agenda 1. What is the product 2. Target Audience 3. Evaluation Goals 4. How we ran the test 5. Methods and Procedures (How we set it up) a. Setup b. Actual test 6. Findings Data Analysis a. Qualitative data b. Quantitative data c. Recommendation Sunday, May 27, 12
  • 3. PRODUCT • XEROX PrintBack • Client: XEROX •What is PrintBack: “ A Mobile Printing Solution” Sunday, May 27, 12
  • 4. PRODUCT Smartphone Default Printer Computer Dropbox/ Email +_____________ PrintBack Sunday, May 27, 12
  • 5. BENEFITS TO THE USERS • Print Intelligent, Go Mobile • No more wait, print anywhere, anytime • Print Document and Photos • Un-compromised print quality Sunday, May 27, 12
  • 6. TARGET USER & AUDIENCE Sunday, May 27, 12
  • 7. TESTING GOALS • Test PrintBack app & installation on IOS device • Test PrintBack app & installation on Android device • Test PrintBack installation on Windows 7 PC • Test PrintBack installation on Mac OS Sunday, May 27, 12
  • 8. CLIENT FOCUS • Setup and installation on the phone and computer A. Windows7 + iPhone preferred combination • Ease of downloading PrintBack • Printing from Dropbox and email • Saving Documents On computer/phone Sunday, May 27, 12
  • 9. PLATFORM Users Platform User 1 PC-Android User 2 Mac-iPhone User 3 PC-Android User 4 PC-iPhone User 5 Mac-Android User 6 PC-iPhone Sunday, May 27, 12
  • 10. TESTING PARTICIPANTS 1 2 1 2 PC-Android Mac-iPhone PC-iPhone Mac-Android Sunday, May 27, 12
  • 11. TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
  • 12. TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
  • 13. TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
  • 14. TESTING SETUP Mobile Phone Testing Rig Sunday, May 27, 12
  • 15. TESTING SETUP Sunday, May 27, 12
  • 16. TESTING SETUP Sunday, May 27, 12
  • 17. TESTING SETUP Sunday, May 27, 12
  • 18. TESTING SETUP Sunday, May 27, 12
  • 19. TEST PROCEDURES • Participant greeted • Download PrintBack on the Computer • Download PrintBack on the Smartphone A. Recorded using Camtasia, USB Webcams and mobile sled • Take a picture and save it to the “Print Using” location • Print a PDF, from a mobile device Sunday, May 27, 12
  • 20. TESTING TASKS 1.Pre-Test Survey 2.Task 1(Download PrintBack from the company website on computer) • Post-Test Survey 3.Task 2 (Find and Download PrintBack App on Mobile Phone) • Post-Test Survey 4.Tasks 3 + 4 Printing and Saving • Post-Test Survey 5.Interview and Debriefing Sunday, May 27, 12
  • 22. QUALITATIVE RESULTS • Computer Installation: • "Make the download easier to find." • "On the page that talked about print back drivers and installers a bolded download PrintBack link perhaps." • "I was a little confused what to do once you installed the program." Sunday, May 27, 12
  • 23. QUALITATIVE RESULTS • Mobile Installation: • "Once I realized that the app was not already downloaded, I downloaded it from the app store it became very easy to install and use." • “The mobile print idea is great, but it has to print from any printer. I get lost, I am not a phone tech person.” Sunday, May 27, 12
  • 24. QUANTITATIVE RESULTS 3 2 1 Mobile Overall How would you rate your overall experience of installing PrintBack on your mobile device? somewhat poor very enjoyable acceptable Sunday, May 27, 12
  • 25. QUANTITATIVE RESULTS 1 5 Mobile Installing (1=Very Poor to 5=Easy-to-Use) very easy-to-use easy-to-use Sunday, May 27, 12
  • 26. QUANTITATIVE RESULTS 4 2 Mobile Setting-Up (1=Very Poor to 5=Easy-to-Use) easy-to-use very easy-to-use Sunday, May 27, 12
  • 27. MOBILE FEEDBACK users Do you have any suggestions for the future of this system? User 2 Once I realized that the app was not already downloaded, I downloaded it from the app store it became very easy to install and use. User 5 I like it. It didn't seem as complicated as some apps I've worked with... I guess it was so easy that I thought I must have missed something. User 6 Not sure how I link it to my printer exactly... I wish that was more explicit Sunday, May 27, 12
  • 28. QUANTITATIVE RESULTS 2 3 2 Computer overall How would you rate your overall experience using this system? somewhat poor acceptable neutral Sunday, May 27, 12
  • 29. QUANTITATIVE RESULTS 2 3 Computer Installing (1=Very Poor to 5=Easy-to-Use) very easy-to-use easy-to-use NOTE: user 6 website connection lost Sunday, May 27, 12
  • 30. COMPUTER FEEDBACK users Do you have any suggestions for the future of this system? User 1 Make the download easier to find. User 2 I was a little confused what to do once you installed the program. User 3 On the page that talked about PrintBack drivers and installers a bolded download PrintBack link perhaps. User 4 Couldn't find the xerox PrintBack download button without having to search for it on the site. A few questions I was unsure of the answers to make the correct selections. User 5 If the program could install right to my application folder... or give me a save as function. User 6 The link to the download page was not working, therefore I could not complete the full task. It was very easy to find the download, but the link to download it was broken. Hence, I don't know that I can answer most of this survey meaningfully. Sunday, May 27, 12
  • 31. PRINTING & SAVING • Saving: “poor” or “somewhat poor” ease-of-use, and overall experience was “very difficult” • Printing from Mobile: majority said it was at least “somewhat difficult” in terms of usage and all said the experience was “somewhat poor” Sunday, May 27, 12
  • 32. RECOMMENDATIONS • Make use of more naturalistic wording • Explain why users should make use of PrintBack for saving • Further develop user interface for PC to increase system status visibility and feedback • Increase clarity of system model • Increase error prevention Sunday, May 27, 12
  • 33. BUG ON THE MAC information overlap the link to dropbox is hidden Sunday, May 27, 12
  • 34. PROFESSIONAL RECOMMENDATIONS • Use less text, wherever possible • More feedback across steps • Increase visibility of system status • Increase clarity of setup process for associated programs Sunday, May 27, 12
  • 35. THANK YOU! Sunday, May 27, 12