User Research User Experience (UX) topic overview/definition

What is User Research?

User research is conducted so as to understand users’ characteristics, aims, and behaviors towards achieving these aims. Its purpose is to produce designs that improve their working practices and lives. User research also involves the continuous evaluation of the impact of designs on the users, not only during the design and development phase but after long-term use, too.

To conduct user research, a multidisciplinary team may employ both observational and experimental methodologies. Such a team will use these in hopes of forming a complete understanding of the users’ requirements in the context in which they might use a product or service. Most systems have a complexity that increases with the diversity of potential users, aims, and contexts of use. Because of this, a full understanding of design requirements is unlikely to be captured successfully at the initial stages. Thus, the iterative and continuous application of user research methodologies is critical to the success of the development process.

The types of user research that can be carried out include both qualitative (e.g., ethnographic studies, scenarios, personas, focus groups, prototyping) and quantitative methods (e.g., surveys, eye tracking, controlled laboratory or field testing). The chosen tools and methodologies depend on the type of system to be developed, the timeline and budget constraints, and the usage environment. User research aims to apply scientific principles not merely in order to solve design problems. It does so also in order to feed findings back to the various disciplines, so as to inform and shape current theories on underlying principles. Given that the intricacies surrounding the use context and user requirements of a product can remain hidden until far along into development, designers will tend to appreciate the time-saving—and, in some cases, project-saving—value of user research in hindsight.

Literature on User Research

Here’s the entire UX literature on User Research by the Interaction Design Foundation, collated in one place:

Featured article

Getting into the Mobile App User’s Mind – User Research for Mobile Applications

Getting into the Mobile App User’s Mind – User Research for Mobile Applications

It’s well understood that user research is what makes for the best user experiences but what are the right user research techniques for mobile apps? While, there is no doubt that any classic UX research technique may be turned to mobile app user research – there are some techniques which have already been demonstrated to show proven value. Mastering these will help you develop better mobile apps that more closely mirror your users’ expectations.

Mobile is the fastest growing way of accessing the internet in the world. Mobile apps constitute the majority of activity on the smartphone platform. This presents huge opportunities for the mobile app developer but in order to get the user experience right; it also presents a big demand for high-quality user research.

By 2017, the global app market will be worth more than $100 billion. That’s a significant chunk of change and to secure some of that market will require great user experiences from mobile apps. Mobile user research is the key weapon in the UX designer’s armoury to conquer some of that market.

Qualitative User Research Methods for Mobile Apps

Qualitative research is concerned with identifying ideas and trends. It is, by definition, not measurable research (you are not collecting numbers) but rather research which provides a flow of concepts that the researcher must analyse to gain insights for product development.

There are 3 key research methodologies for qualitative user research for mobile apps:

  • Lab Studies
  • Journal/Diary Studies
  • Observational/Field Studies

Lab Studies

Lab studies are designed to test whether the user can actually use the product. A lab study is conducted using a mobile device in an environment where the user can be observed by the research team. This will often involve the researcher remaining in a different room observing remotely while the user goes about their tasks.

Lab studies are great because they allow the moderator to interact with the subject and ask questions to gain further insights. When set up with high-end equipment the whole team is able to observe the tests and they can easily gather visual cues to the way users feel.

There are issues with conducting lab tests in that they do not bear a 100% resemblance to the real world. They may suffer both from moderator bias and the need that participants often feel to please the moderators with the way that they approach the task.

Author/Copyright holder: Nicholas Wang . Copyright terms and licence: CC BY-SA 2.0

Journal/Diary Studies

A journal/diary study poses the questions; “When do users actually use our app? In what contexts do they use our apps?” and they involve the user writing down the when, how, why and other observations each time they use the app.

Journal studies can be very good at determining how a user actually uses the app and for delivering honest feedback to the research team.

Their biggest drawback is that they rely on the user remembering to note down each use of the app (something that may not feel “pressing” for participants). They also require a lot of management to ensure that they provide the most value.

Observational/Field Studies

You use a field study to determine; “When are users using the app? What context do they use the app in?” A field study requires a researcher to observe (and usually film) a subject as they interact with the app.

This can generate a lot of useful data and is pretty easy on the participants, however, field studies offer no guarantee that the people you are observing are “typical users” who represent the whole user base and they can be intrusive and awkward to carry out.

Author/Copyright holder: visualpun.ch. Copyright terms and licence: CC BY-SA 2.0

Quantitative User Research Methods for Mobile Apps

Quantitative research results in “hard numbers” which can often be more powerful when convincing stakeholders to make a decision than the outputs of qualitative research. However, it’s worth remembering that quantitative research normally answers different questions to qualitative research and both are necessary to develop the best user experiences.

There are 4 main types of quantitative technique used in mobile app research:

  • Online Surveys (including Behavioural Tracking)
  • Behavioural Analysis
  • Automated Logging Activity
  • Experience Sample Methods

Online Surveys (including Behavioural Tracking)

Online surveys will involve using a questionnaire combined with automated data collection reflecting the user’s actual behaviour. They are designed to answer the questions; “What do users think of our product? What do they perceive the value to be?”

Online surveys are incredibly cost-effective and can create large amounts of data on a geographically diverse basis which, in turn, leads to statistically significant sample sizes and results.

The down side is that there is no direct contact with the user in large processes like this and you may find that you can identify patterns but can’t deduce the “why this should be?” from them.

Author/Copyright holder: JayWalsh. Copyright terms and licence: CC BY-SA 3.0

Behavioural Analysis

Behavioural analysis works to determine the answer to the “how do people use our app?” question. It is conducted via installed software on the users’ devices that track the way people navigate through the app and/or how they conduct the tasks on your app.

This can be very useful to be certain about what people do as opposed to what they say they do (a perennial problem for researchers) and to understand traffic patterns.

Conversely, the data will not show the user’s context or their intentions. This is why behaviour analysis is often conducted alongside a survey – to try and develop a clearer picture of “why”.

Automated Logging

Another way to answer the “how do people user our app?” question is through automated logging – that records events that are generated on the mobile device and without user input. This is a very good way to ensure that interaction data is objective and consistent. Like behavioural analysis, automated logging is limited in the ability to interrogate context or intent.

Experience Sampling Method (ESM)

This method is particularly useful in mobile user research because it consists of sending automated messages to the study participant at the point they carry out an action to ask about their experience. It helps answer two main questions; “How does the user use our app?” and “What do they think about that?”

There is a risk of introducing cognitive bias into the captured data and studies need to be well-designed to minimize this potential.

The Take Away

There’s no need to throw the baby out with the bathwater. When it comes to user research for mobile apps – all the user research techniques you currently use can be adapted to mobile. However, the tools listed above have been shown to be particularly effective for mobile user research and may be of use as you try to design stronger mobile app user experiences.

References

An interesting examination of the diary study can be found here - http://uxpamagazine.org/dear-diary-using-diaries-to-study-user-experience/

An introduction to lab testing is available here - http://teced.com/services/usability-testing-and-evaluation/lab-usability-testing/

A great starting point for field study research can seen here - http://www.allaboutux.org/field-methods

You may find this deep introduction into Experience Sampling for Building Predictive User Models valuable - http://research.microsoft.com/en-us/um/people/horvitz/experience_sampling_CHI2008.pdf

Hero Image: Author/Copyright holder: JISC. Copyright terms and licence: CC BY-NC-ND 2.0 UK

Show full article Show collapsed article

Learn more about User Research

Take a deep dive into User Research with our course User Research - Methods and Best Practices.

User experience design requires you to understand your users. If you don't know what your users want, you can only deliver what they want by accident. User research is how we come to understand what our users want—it's the largest part of user experience design. This course will give you insights into all the major UX research techniques and how to put them into practice on your projects.

User research is often the first step of a UX design process, because you cannot begin designing a product or service without first understanding what the users want. By gaining skills, and learning about the best practices in user research, you will be able to get first-hand knowledge of your users in order to design the optimal product—one that sells better than your competitors’.

Through this course, you will be introduced to the various aspects of user research, getting exposed to qualitative and quantitative user research methods. On top of that, you will also learn how to analyze the results of your research and confidently present your findings to your clients and stakeholders. User researchers play an instrumental and valuable role in any organization and, as such, receive a healthy remuneration, from an average of $81,000 to as high as more than $120,0001.

All literature

Chapter 11: Curated List of Research techniques

Ch 11: Chapter 11: Curated List of Research techniques

Since this book is intended for both designers and non-designers, we offer you a brief description of a curated list of research techniques. Our objective is not to turn our readers into expert user researchers, since we strongly recommend including a professional user experience researcher as part of the enterprise gamification team. We introdu...

Book chapter
Ethnography

Ch 31: Ethnography

The concern to balance detailed documentation of events with insights into the meaning of those events is the enduring hallmark of ethnography. (Fielding 1994: 154) [The] immortal ordinary society ... is only discoverable. It is not imaginable. It cannot be imagined but is only actually found out, and just in any actual case. The way it is done...

Book chapter