Category Archives: Analytics

Web Analytics for User Research: An Example

Web analytics is a good tool to add to your user research toolkit. I occasionally teach workshops on the topic of using web analytics data for UX, and I’ve found it enormously challenging to pull together a half day’s worth of material that is understandable and useful to people. For the last two workshops I’ve done, there were three exercises for workshops participants to do together. I asked them to get into groups, look at the example data, and discuss the data. I included a few starter questions. In this post, I take a look at one of the exercises and discuss how I would interpret the data.

The Data

This exercise focused on data from the All Pages report in Google Analytics, which you can see in the screenshot, and which I’ve put in a table to make it a bit easier to read if you don’t enjoy squinting at screenshots.

Screenshot from Google Analytics

Data from Google Analytics about usage of the most popular pages.
Page Pageviews (table is sorted according to this metric) Unique Pageviews Average Time on Page Entrances Bounce Rate % Exit
41,420 31,808 00:01:36 14,480 48.89% 34.96%
/ (Homepage) 13,320 10,492 00:01:44 10,122 44.63% 42.79%
/Programme.html 5,852 3,717 00:01:23 758 51.58% 26.37%
/Registration.html 5,403 4,133 00:02:27 1,158 65.46% 48.40%
/Speakers.html 3,260 2,505 00:01:18 363 64.56% 30.43%
/Workshops.html 2,688 1,349 00:01:07 138 64.21% 25.04%
/Practical.html 1,807 1,349 00:01:07 138 47.83% 20.25%
/Venue.html 1,285 1,104 00:01:16 87 62.07% 21.56%
/Videos.html 1,073 849 00:01:52 410 80.49% 55.64%
/Payment.html 516 359 00:02:43 28 10.71% 14.15%
/Invoice.html 323 226 00:02:17 0 0.00% 2.48%
/Speaker.html?n=nicolef 239 221 00:01:05 73 82.19% 31.80%
/Speaker.html?n=abbyc 231 205 00:01:02 7 28.57% 14.29%
/Speaker.html?n=adrianh 214 190 00:01:17 10 40.00% 19.63%
/Speaker.html?n=stephenh 203 182 00:00:53 8 12.50% 12.32%
Speaker.html?n=bradf 195 158 00:00:51 2 50.00% 10.28%
/Request.html 186 117 00:04:18 2 0.00% 37.63%
/Checkout.html 182 141 00:02:47 0 0.00% 3.30%
/Speaker.html?n=joshs 178 164 00:01:12 18 16.67% 14.61%
/Contact.html 177 137 00:01:50 5 20.00% 19.77%
/Speaker.html?n=stephenw 175 155 00:01:05 3 33.33% 10.86%
/Practical-tourcity.html 170 147 00:01:37 82 79.27% 52.35%

Questions and Definitions

I asked participants to look at the data and think about the following questions. They’re not necessarily the sort of thing you’d look at every time you analyze analytics data, but this is obviously a bit of an abstract situation.

  • Which pages do users tend to view multiple times? Which pages do users tend to view only once? Why might this be?
  • What are the pages where users spend the most time? What are the pages where they spend the least time? Why do you think?
  • What are common pages for users to enter the site? Why?
  • Compare the bounce rates of the most common pages for people to enter on. Why might some bounce rates be higher than others?

This isn’t at all an exhaustive list of what you’d analyze in real world situations, or even necessarily the sort of questions you would ask in every situation. Except in situations where you’re just browsing the data to look for something interesting, as in this case, the specific data you analyze and the questions you ask will be driven by what you’re trying to find out.

Before we move on to some interpretation of the data, we should probably look at some definitions.

  • Entrances:​ In the context of a single page, it means the number of people that entered the site on that specific page.
  • Exits:​ The number of people that left the website after viewing a page—that is, the number of people for whom this was the last page they viewed during their session.
  • % Exits: Exits divided by pageviews—that is, the portion of pageviews where that was the last page that a user viewed during their session.
  • Sessions: ​A session refers to an instance of a user coming to your website. If the same user comes to your website three times in one day, that counts as three separate sessions.
  • Pageviews: ​The number of times people have gone to a page. If a user views the same page multiple times during their session, each time counts as a separate pageview.
  • Unique Pageviews: Whereas a pageview counts every time a user goes to a page, regardless of how many times they do it, a unique pageview counts only the first time a user views a page. This metric gives you a sense of how many individual people have viewed a page, regardless of how many times they did it.
  • Bounce:​ When a user enters a site on a specific page, and then leaves the site without going to another page or interacting with anything on the page that you are tracking. In other words, it’s when a user makes an entrance on a page and exits from that same page, without Google Analytics recording any other data about them using the site.
  • Bounce​rate:​The portion of pageviews that are bounces. It’s important to remember that bounce rate is only calculated based on entrances, and not based on all the people that view a page.

Unfortunately, that’s a lot to take in all at once, and analytics deals with a lot of concepts that human brains were never meant to understand. That’s part of the difficulty of teaching a workshop on this topic.

Analysis

In this section, I write up a high level analysis of the numbers in this report. I don’t get too deep in this section, mostly because I don’t have a particular questions I’m trying to answer. The biggest takeaway from this section should be that analytics data is a great way of generating research questions for you to answer.

Pageviews and unique pageviews

When you compare pageviews to unique pageviews, something that stands out is that no pages have outrageous ratios, implying that none of the pages on this site are ones that people really view lots of times during their sessions. On other websites, you may find some pages that have a 2:1 ratio or more.

The home page has a ratio of about 13k:10k, which is on the higher end. This probably makes sense for a home page, since lots of people are going to treat it as a navigational hub. The “programme” and “speakers” pages, given that they’re a list of links to specific talks and specific speakers, respectively.

In comparison, pages like “venue” don’t seem to have lots of repeated viewings, implying that users get what they want out of the page and then move on to other pages.

Time on page

“Registration” and “invoice” seem to have the longest times on page, consistent with there being stuff that users have to do on those pages (filling out forms, most likely). The average time on page for “videos” feels a bit short and it’s worth exploring what’s going on with that page. Are there embedded videos? Can we look at stats on whatever service hosts the videos? Have we tagged the page to track outbound clicks?

“Request” and “checkout” also have very long times on page. What are those pages about?

The average time on page for the home page actually feels rather high. It may be worth exploring through in-person research or maybe through a heat map tool to see what things people are actually spending so much time doing on that page.

Entrances

Unsurprisingly, people enter on the home page. You may see different patterns on different kinds of websites, like ecommerce, where people predominantly enter on pages other than home.

The low number of entrances on “invoice,” “request,” and “checkout” indicates that they are probably pages from the middle of the transaction.

Pages about specific speakers also seem to have low entrances; my theory would be that this site just doesn’t rank very high in search results for people looking for information on those speakers.

Bounce rate

Three pages have bounce rates that feel quite high: “practical-tourcity,” one of the speaker pages, and the videos page. However, the first two have very few entrances, meaning that bounce rate is calculated off of a small number of people. I’d be skeptical about whether bounce rate means a lot for those pages. For videos, though, it would be worth exploring the page and how people interact with the page to see what’s up.

The most interesting pages to look at for bounce rate are the ones with the most entrances: “home,” “registration,” and “programme.” The bounce rate for these three pages doesn’t seem weird, really. It may be worth looking at how people interact with the registration page to see why it has the highest bounce rate. It could be that there is pricing information on the page and people are just trying to find that information.

Next Steps: After the Analysis

Again, this wasn’t a rigorous analysis in large part because there was no real question I was trying to answer. So, of course, one’s next steps in real life would depend heavily on what you’re trying to find out about users.

One idea would be to take a close look at the actual pages to get ideas about why people may be interacting with them the way they are. In some cases, you may want to do a path analysis to see where people are going from particular pages, particularly for pages where it looks like some people may be viewing them multiple times.

The biggest mystery pages are probably “registration” and “videos.” I’d check whether there is stuff on the page that takes people away from it—maybe the videos are hosted on another site, or the actual registration takes place on a third party site.

At a high level, the three kinds of next steps that spring to mind are:

  • More analytics data analysis
  • Looking at the actual design of the website to come up with good stories about the data
  • Research activities that don’t include analytics to fill in some qualitative answers

Whether or not you’d even do more research at this point would be a matter of what you’re trying to find out and how important it is to reduce uncertainty. There are situations where the fast answers from web analytics is good enough; in others, you want to be as sure as possible about why users are doing what they’re doing.

Hopefully this has been a modestly helpful look at the way you might approach analytics data. Technically, it’s not hard to start learning about web analytics tools, but learning about the data can be an enormous challenge.

My Magazine Article Is In!

I appeared in the October issue of Net. I guess it came out a while ago, but it took time for the physical copies to cross the Atlantic. Last week, I finally got my hands on a copy of the magazine. It was pretty cool to run into the bookstore and pick up something that I wrote.

2015-10-10 09.44.14

ConveyUX in February 2016

It looks like I’ll be going to Seattle in February 2016!

I’ll be teaching a workshop on Web Analytics for User Experience at ConveyUX. It’ll be an iteration on what I taught at UX Lisbon. Who knows what an extra year of thought will produce?

I really value these opportunities to share what I know about the topic of using web analytics for user research. It’s an important tool for us to have in our toolkits, but it’s outside the comfort zone for a lot of folks in the user experience field. However, it’s nothing we can’t handle!

This will be my first trip to Seattle, so that’s a bonus. I’ve often wondered if the Pacific Northwest is for me, so this trip will help answer that question.

UX Lisbon 2015

I’m off to Portugal!

I’m presenting a workshop, twice, called “Web Analytics for User Experience.” It’s the next generation of material I last presented at UXPA 2013. I wasn’t fully satisfied with the direction I went in for that workshop, so when I was invited to UX Lisbon, I decided early on to take the gig very seriously and to start over on the workshop.

I’m satisfied with what I put together. Web analytics is a big, complicated topic. The tools themselves are the most boring part. The magic is in thinking about quantitative data, which is something that UX people don’t necessarily get a lot of experience at. But we can be quite good at it because we tend to be pretty analytical people.

This is my first trip to Portugal and my first trip to Europe and my first time leaving the country in years! It’s going to be exciting.