Study: Introductory Paragraphs and Tabs Don’t Aid Reading Comprehension Online

Resource Shelf noted a study today about the effects of Web document formatting on user comprehension and behavior (PDF). The University of Washington researchers recreated several different versions of an information site, with one set lacking global navigation (Figure 1 below) and another having tabbed navigation (Figure 2). Other variations included no introductory text (1A, 2A), introductory text followed by bulleted categories (1B, 2B) and introductory text with embedded links (1C, 2C).

Variations of Big Bend Test Pages
Figure 1: Three variations of pages without global navigation.

Variations of Big Bend Test Pages With Tabbed Navigation
Figure 2: Three variations of pages containing tabbed navigation.

Some of the findings of how presentation influences reader behavior surprised the researchers:

  • Introductory text (B) without embedded links doesn’t increase factual comprehension; nor does it increase total time spent on site
  • Tabbed navigation (figure 2) doesn’t influence comprehension of the material, but it does encourage site exploration and increases user satisfaction.
  • Introductory text with embedded links (C) increases referential comprehension (understanding how the material relates to other topics), but at the cost of severely reducing satisfaction-particularly in the absence of tabbed navigation (1C vs 2C)
  • Link lists without introductions (1A, 2A) generate more page views than link lists with introductions (1B, 2B).
  • Tabbed navigation (figure 2) increases the number of pages viewed. While not mentioned in the study, there’s likely an upper limit to how many navigational tabs you can add before this works against you. Just ask Amazon.

So, users like tabs (no surprise), but that introductory text isn’t necessarily going to help comprehension (surprise). Embedded anchor text is good for SEO and reader comprehension, but bad for reader satisfaction. As the abstract states, “structural cues that promote understanding are not necessarily those that promote exploration or enjoyment.” Choose wisely.

Kathryn A. Mobrand, Elisabeth Cuddihy, Edward Galore and Jan H. Spyridakis from the University of Washington published The Effect of Structural Cues on User Comprehension, Navigational Behavior, and Perceptions. Their study involved 282 engineering undergrads from UWA who reviewed Web sites based on the U.S. National Park Service Web site for Big Bend National Park in Texas.

Advertisements

Jakob Nielsen is Looking for Church Redesign Case Studies

My inbox included the fortnightly reminder that a new Alertbox from usability guru Jakob Nielsen was online. The message also contained a request for case studies about measurable impacts of website design changes for an upcoming study. If you’ve redesigned your church’s site and have some metrics to back it up, send your data, before- and after-screenshots, and a brief explanation of the work to John Berger, metrics@nngroup.com, of the Nielsen/Norman Group. All contributors get a copy of the final study.

Possible metrics can show improvement or deterioration in areas such as:

  • Sign-up rate for newsletters
  • Conversion rates
  • Training time needed to learn a feature or system
  • Time on task and other productivity measures
  • Percentage of users who abandon a process at a particular step

You can remain anonymous in the final study if you’d like, but where’s the fun in that? The study isn’t limited to church redesigns. In fact, your entry might be the sole church featured. So, if you have some good examples then take the opportunity to contribute to the usability community and get some publicity for your parish.

Don’t Assume Users Know Logo = Home Button

While doing some B2B usability testing, it became clear that some users weren’t aware of the common design practice that clicking on the company logo in the corner will take you back to the home page. The same probably applies to your church website’s navigation. Consider adding an explicit link to your home page within the navigation. Just don’t make it active on the home page itself, of course.

Trutech T600-D DVD Player Doesn’t Work

Thinking about buying a cheap DVD unit for the church youth room? Skip the Trutech T600-D DVD player unless you don’t mind a device that can’t handle DVD menus, pixelates the picture during scene changes and generally strains to keep up with video.

For $27 I wasn’t expecting much, but at least expected playback to function reasonably well. I was using the S-video connection and tried legitmate DVDs, including Life Is Beautiful (one of my all-time faves), the first Lord of the Rings, a random Rescue Heroes and a Disney promotional DVD about planning a trip to the Magic Kingdom (my kids love this one). In each case, the video would stutter at least every couple of minutes and often had difficulty handling menus.

I liked the price and narrow size because it could squeeze into my existing cabinet, but it looks like a return to Target and some more research.

Earth Day PDFs? Must Have Been Out of Styrofoam Cups

The Catholic Diocese of Arlington, Virginia, offered a list of thoughtful Earth Day resources, but opted for print-based PDF files. Yet at best, PDFs are okay for providing forms and such that are designed exclusively for printing. Other than for that purpose, “PDFs are evil” and “unfit for human consumption” say the usability experts.

Now I understand that the diocese was repurposing material a local parish developed the year before and was looking for an easy way (for the developers, that is) to quickly post the information. But when promoting conservation, why choose a document format that encourages unnecessary printing to read instead of regular HTML and embedded links?

20 Blog Usability Tips from IRBW

Do we really need another roundup post of best practices for blogs? Not anymore because Tom Johnson of I’d Rather Be Writing has put together the definitive list of 20 principles for usable and readable blogs. The post offers good advice you may have seen before, but it’s carefully edited, includes solid examples and contains links to helpful plug-ins. What’s more, you’ll find about 30 links to the original posts that inspired the column — a step that less conscientious bloggers skip. Nice flagship content, Tom.

The only blogging point not covered that often comes up is whether or not to display social media bookmarking options, such as Digg and del.icio.us buttons, and Technorati tags. Here’s a summary of the list.

  1. Pick a topic for your blog
  2. Encourage comments
  3. Make it easy to subscribe
  4. Include an About page
  5. Present your ideas visually
  6. Keep posts short and to the point
  7. Use subheadings for long posts
  8. Link abundantly
  9. Make headlines descriptive
  10. Archive by topic
  11. Include a list of related posts beneath each post
  12. Allow users to contact you offline
  13. Present your real viewpoint
  14. Write for your future employer
  15. Include a Top Posts section
  16. Provide an index
  17. Get your own URL and match it to your blog’s title
  18. Include a Recent Posts section in your sidebar
  19. Reward commenters for commenting
  20. Post often

If you like Tom’s post, Daily Blog Tips, is another site that will give you a regular fix of similar advice.

What would you add to the list?

7 Ways Non Profits Can Measure ROI of Usability Testing

Think you can’t measure ROI for your non profit or church site? Here are seven measurements from usability guru Jakob Nielsen’s discussion of the ROI for non profit and government sites.

  1. Double your conversion rate for subscribing to your email newsletters
  2. Decrease phone calls for routine information, freeing up staff or volunteers for more meaningful tasks
  3. Recruit volunteers more effectively and in less time
  4. Help the environment by moving registration activiites online rather than through the mail or via paper forms
  5. Retain more volunteers longerer by removing processes that sap their patience
  6. Decrease abandonment rate for donor/volunteers who don’t feel your charity is trustworthy
  7. Improve your success rate for the registration and checkout process for online donations

Even if your information is “just” informational, Nielsen argues it’s there for a reason so it’s worth designing your site right. So, which of these would sway your boss, board or council to give you a few bucks for usability testing?