The Encyclopedia of Human-Computer Interaction, 2nd Ed.
3. User Experience and Experience Design
I open my eyes. Lush light floods the room, birds chatter. It is only 6:30 o'clock in the morning, but I feel well-rested and alive; time to get up, to brew some coffee. Are you jealous of my morning routine? Were you startled out of your sleep by a merciless alarm clock? Was it dark outside, no birds around, and did you feel groggy and bleary-eyed?
This chapter is about experiences created and shaped through technology (aka User Experience) and how to deliberately design those. The wake-up experience created by an alarm clock substantially differs from the experience created by sunrise and happy birds. The question is whether we can create technology which understands the crucial features of sunrise and birds and which succeeds in delivering a similar experience, even when the sun refuses to shine and the birds have already left for Africa.
In fact, the experience I described in the beginning was not created by sun and birds, but by Philips' Wake-Up Light. This is a crossing of an alarm clock and a bedside lamp. Half an hour before the set alarm, the lamp starts to brighten gradually, simulating sunrise. It reaches its maximum at the set wake-up time and then the electronic birds kick in to make sure that you really get up. Admittedly, it is a surrogate experience, but so are love stories and travel novels. It is artificial, but not vulgar. And more importantly, it substantially changes the way one wakes up. It changes the experience. The object itself, its form, is rather unremarkable (see Figure 1).
Author/Copyright holder: Koninklijke Philips Electronics N.V. Copyright terms and licence: All Rights Reserved. Reproduced with permission. See section "Exceptions" in the copyright terms below.
Figure 3.1: Philips' Wake-Up Light
The Philips Wake-Up Light has nevertheless the power to "transcend its encasing" because its contribution is not one to the aesthetics of things, but to the aesthetics of experiences. This is the challenge designers and vendors of interactive products face: Experience or User Experience is not about good industrial design, multi-touch, or fancy interfaces. It is about transcending the material. It is about creating an experience through a device.
Author/Copyright holder: Courtesy of Rikke Friis Dam and Mads Soegaard. Copyright terms and licence: CC-Att-ND (Creative Commons Attribution-NoDerivs 3.0 Unported)
Marc's introduction to User Experience and Experience Design
Author/Copyright holder: Courtesy of Rikke Friis Dam and Mads Soegaard. Copyright terms and licence: CC-Att-ND (Creative Commons Attribution-NoDerivs 3.0 Unported)
Marc's advice on designing with experience in mind
Author/Copyright holder: Courtesy of Rikke Friis Dam and Mads Soegaard. Copyright terms and licence: CC-Att-ND (Creative Commons Attribution-NoDerivs 3.0 Unported)
Marc's main guidelines and ethical considerations
Author/Copyright holder: Courtesy of Rikke Friis Dam and Mads Soegaard. Copyright terms and licence: CC-Att-ND (Creative Commons Attribution-NoDerivs 3.0 Unported)
I will start this chapter with a discussion of our Western societies' shift from the material to the experiential and the potential problems technology-oriented businesses have in accommodating this shift. User Experience and Experience Design can be a remedy to this by bringing experience to the fore. I then discuss Experience and User Experience to flesh out a view which has the potential to advance the way we will design future technologies. I end with some examples of Experience Design and finally offer a simple model of Why, What and How as a starting point for the enthusiastic Experience Designer.
3.1 From the material to the experiential
In Roald Dahl's Charlie and the Chocolate Factory, young Charlie faces a tough choice. He just found the last Golden Ticket in a bar of Whipple-Scrumptious Fudgemallow Delight. (Figure 2). It is one of only five invitations to visit Willy Wonka's legendary chocolate factory. Charlie is promised a day full of "mystic and marvellous surprises that will entrance, delight, intrigue, astonish, and perplex beyond measure. In your wildest dreams you could not imagine that such things happen to you!"
Author/Copyright holder: Warner Bros. Copyright terms and licence: All Rights Reserved. Reproduced with permission. See section "Exceptions" in the copyright terms below.
Figure 3.2: Charlie Bucket discovers his Golden Ticket
But Charlie is poor. It is a freezing winter and the whole family of seven is living on not more than cabbagy meals and the occasional boiled potato. People already offered as much as $500 for the ticket. Wouldn't it be more sensible to forfeit Wonka's frivolous offer and to secure the money? In the end, Charlie took the ticket and was awarded with the most extraordinary experience of his life.
Charlie chose the experience over the material. He could have had a winter coat or fire wood instead of the experience, but he already knew that only the visit to the chocolate factory has the power to add some meaning to his life. In fact, studies show that experiential purchases (i.e., the acquisition of an event to live through, such as a concert, a dinner, a journey) make people more happy than material purchases (i.e., the acquisition of tangible objects, such as clothing, jewellery, stereo equipment) of the same value (Boven and Gilovich 2003; Carter and Gilovich 2010).
In a series of studies, Leaf van Boven and colleagues (2010) further uncovered stigmatizing stereotypes: Participants characterized people with a material orientation as self-centred, insecure, or judgmental, but people with an experiential orientation as humorous, friendly, open-minded, intelligent, caring, or outgoing. The seemingly negative stance towards the materialistic is an indication of a post-materialistic culture. Ronald Inglehart (1997) argued that societies in sustained periods of material wealth become increasingly interested in values such as personal improvement. They transform into highly individual Experience Societies (Schulze 1992; Schulze 2005) whose members equate happiness with the acquisition of positive life events. Decried as superficial and consumerist in the 80ties and 90ties of the last century, we now witness a version of the Experience Society which favours meaningful engagement to earning money and begins to dissociate experience and expenditure. Experiences are no longer supposed to be available at exotic places only. They can be close by: a day out in the sun, working the garden, a barbecue with friends, or a trip to the local flea market. In the foreword to the 2005 edition of his book, Gerhard Schulze (2005, p IX) mentions some signifiers of the new millennium's Experience Society: deceleration instead of acceleration, less instead of more, uniqueness instead of standardisation, concentration instead of diversion, and making instead of consuming. All these are not necessarily associated with material wealth. Admittedly, to develop a post-materialistic (i.e., experiential) orientation may require sufficient food, clothing, and shelter (Inglehart 1997; Maslow 1954). This is the gist of Charlie Bucket's dilemma: choosing a frivolous one-day experience in a chocolate factory over supporting his family with food and clothing seems almost immoral. However, while I agree that an experiential orientation in life requires some food, clothes and shelter as a necessary precondition (Inglehart 1997), I do not believe that it needs caviar, Gucci, and a chateau in the hills of the Cote d'Azur. Most of us in the developed countries have the basis for leading a post-materialistic life.
3.2 Experience and business
Though the transformation to a post-materialistic experience society has been recognized by business, as indicated by books such as The Experience Economy (Pine & Gilmore, 1999) or Experiential Marketing (Schmitt 1999), it still struggles with making sense of it. A good example is the music industry. While the number of concerts is still rising, record sales dropped considerably from 2000 and onwards. For example, Madonna's Confessions on a Dancefloor sold only 1.6 million copies, but her world tour generated about 200 million dollars. According to Pollstar (Bongiovann 2010), in 2009 the average ticket price for a top 100 act in the US was about $64, a CD made only $13.99. Typically, illegal digital downloads are made responsible for this effect. But the missing willingness to pay for music in the form of a tangible product may also be a consequence of shifting from a materialistic to an experiential orientation. Today the music itself matters, not ownership, argues Arthur Schock (2010), a booker for independent electronic artists, in a recent interview for Spiegel-Online. He reported on record release parties with 800 raving guests but only ten records sold afterwards. "Liking bears no relation to buying the CD," he concluded. On Creative Deconstruction Rich Huxley (2010) mused: "If we can all now make, distribute and sell music, to succeed we've got to differentiate ourselves from the crowd and give people something they can't get elsewhere. If we can give people something that isn't repeatable and isn't copyable then all the better. So, what's unique and not copyable? A feeling, or an experience." Instead of complaining about declining CD sales, the music industry must develop new, more experiential formats.
Why aren't they? One of the main reasons why the music industry dislikes the shift away from the material is the limited scalability of experience. Once produced, a CD can be copied and sold in theoretically infinite quantities, while an artist can only play a limited number of concerts a year, with a limited number of paying attendants. As long as most industries and their strategies are still geared towards earning money by mass-producing and selling tangible objects, their take on the experiential is often not more than a feeble marketing strategy. For example, the German Telekom recently made "experiencing" its marketing claim ("Erleben, was verbindet"). The companion website promises to be a place for sharing memorable and unique experiences. But a close look reveals hardly more than the occasional sponsored live event interspersed with badly disguised attempts to sell standard products and services. Experience is considered a vehicle for marketing, but not understood as the very product that is sold. The transition from an economy of products and services to one of experience and transformation certainly requires more (Pine and Gilmore 1999). This is the challenge we face: Experience or User Experience is not about technology, industrial design, or interfaces. It is about creating a meaningful experience through a device.
3.3 The evasive beast called User Experience
Experience is an almost overwhelmingly rich concept, with a long history of debate and many attempts to "define" it (Jay 2004). I primarily focus on experiences as meaningful, personally encountered events (in German: "Erlebnis") and not so much on the knowledge gained through these events (in German: "Erfahrung"). These experiences are memorized stories of use and consumption and distinct from the immediate moment-by-moment experience (e.g., Forlizzi and Battarbee 2004; Kahneman 1999). While the immediate moment-by-moment experience is certainly interesting, memorized experience is of more practical relevance. This is simply because most of our waking time, we are feasting on vivid memories of the past (or anticipations) rather than on immediate pleasures.
The construction of experiences as stories from moment-by-moment experience is not straightforward. For example, experiences tend to improve over time. As van Boven (2005, p. 137) puts it: "As one forgets the incidental annoyances and distractions that detract from the online, momentary enjoyment of an experience, one's memory of an experience can be sharpened, levelled, and 'spun' so that the experience seems better in retrospect than it actually was." Who doesn't fall victim to a "rosy view" now and then. We are spinning - not necessarily consciously - our own experiences.
But what is in an experience? Psychologically, an experience emerges from the integration of perception, action, motivation, and cognition into an inseparable, meaningful whole. The intimate relation between those single concepts is reflected by, for example, Russell's (2003) model of emotions, which stresses the importance of cognitive processes, such as self-observation, attribution, and categorization, for the experience of emotions. And most action theories (e.g., Kaptelinin & Nardi, 2006; Carver & Scheier, 1989) assume close links between actions, thoughts and emotions. In sum, I argue for understanding experience as "an episode, a chunk of time that one went through [...] sights and sounds, feelings and thoughts, motives and actions [...] closely knitted together, stored in memory, labelled, relived and communicated to others. An experience is a story, emerging from the dialogue of a person with her or his world through action" (Hassenzahl 2010, pp. 8). An experience is subjective, holistic, situated, dynamic, and worthwhile.
While an experience is a complex fabric of feelings, thoughts, and actions, I believe emotions and fulfilment of universal psychological needs to have an accentuated role. Although emotions are certainly complex, they all share an inherent evaluation, pleasure and pain, which provide "the yardstick on which qualitatively different possibilities can be compared" (Russell 2003, p. 153). This evaluation is important in shaping future behaviour and - if positive - one source of happiness. But where does the pleasure come from? Sheldon and others (2001) demonstrated the intimate link between the pleasantness of an experience and the fulfilment of universal psychological needs in that experience, such as the need for autonomy or stimulation. A specific look at technology-mediated positive experiences revealed stimulation, relatedness, competence, and popularity as the salient sources of pleasure (Hassenzahl et al. 2010). Being asked for a recent positive experience with technology, a young woman provided the following example: "I was on a short trip to Dublin. In the early hours, my mobile phone woke me up. My boyfriend, who stayed at home, had just texted a sweet 'I love you'(Figure 3). This is an example of a relatedness experience, which gets its positive meaning through fulfilling a need for social relationship and intimacy.
Author/Copyright holder: Mallory Bwman. Copyright terms and licence: All Rights Reserved. Reproduced with permission. See section "Exceptions" in the copyright terms below.
Figure 3.3: A sweet 'I love you'
The mobile phone is instrumental to creating this experience, but the positive emotions and the meaning are evoked through the fulfilment of a universal psychological need. Need-fulfilment is what makes an experience pleasurable.
Usage and consumption always translate into an experience, a story of use, a story of consumption: just like a rollercoaster becomes embedded into a (hopefully) meaningful, emotion-laden story of a rollercoaster ride, full-blown with stimulation, excitement and enjoyment. Seemingly different products and situations are represented in a similar format - that of experience. Thus, as long as we focus on the experiences created and shaped by interactive products, we may not distinguish User Experience from Experience in general. User Experience is just a sub-category of experience, focusing on a particular mediator - namely interactive products. If it comes to actual Experience Design, that is the question of how to deliberately create and shape experiences, a distinction between interactive products and other mediators of experiences may be helpful, but does not seem crucial.
The perspective on Experience and User Experience developed here should not be understood as definite. It is a starting point for debate, an attempt to advance a concept of Experience and User Experience that will change the way interactive products are - hopefully to the better.
3.4 Experience Design: Designing the post-materialistic
With the sharp distinction between the experiential and the material suggested by many authors (e.g., Boven and Gilovich 2003), an "experiential interactive product" appears like a contradiction in terms. While experience is intangible, volatile, an interactive product is tangible, a mass-produced piece of technology. The "electronic gadget" is the very prototype of a material purchase. The seasoned post-materialist, though, ceases to strive for yet another novel communication device. She will rather enjoy writing a letter (Figure 4).
Author/Copyright holder: Penelope Fewster. Copyright terms and licence: All Rights Reserved. Reproduced with permission. See section "Exceptions" in the copyright terms below.
Figure 3.4: Letters to an English schoolgirl
But even the post-materialist's experience is most of the time mediated. Writing a letter requires a pen, paper, and a messenger, who in turn needs a carriage, a zeppelin, or a plane. This holds for all the typical examples of experiential purchases provided by van Boven (2003): travel requires transportation, dining requires a good kitchen, and a concert requires instruments and amplification. Things are not the opposite of experiences, but create and substantially shape them. The combination of a pen and a piece of paper, and the resulting activity of writing with one's own hand, has certain features which in turn shape the resulting experience. It is, for example, relatively slow and, thus, offers time for reflection, not provided by more efficient technologies (Lindley et al 2009). Thus, the post-materialist is not necessarily a "green luddite" (Kozinets 2007) who shuns technology in general. But she is more interested in the experience created than taking pride in the ownership of the product or technology that created it. Once created, the experience is what is owned - an immaterial, personal story. The product is only of interest as it is identified as being crucial in creating the experience (Hassenzahl et al 2010).
The challenge of designing interactive products for the post-materialist is to bring the resulting experience to the fore - to design the experience before the product. Or as Buxton (2007, p. 127) puts it: "Despite the technocratic and materialistic bias of our [US-American] culture, it is ultimately experiences we are designing, not things." But what does that mean, to design an experience? For Buxton it seems a matter of how it feels to act through a product, in the moment it is used - the moment-by-moment experience. He used different orange squeezers to highlight how different usage can "feel" even if the function remains the same. This addresses the How of product use, the Aesthetics of Interaction. This notion of Experience - as focusing on how something is done - was notably sparked by the success of Apple's iPhone, featuring a so far unique aesthetic of interaction, but basically fulfilling the same tasks as any other mobile phone.
While certainly important, reducing experience to the mere "pleasure due to the feel of the action" (Buxton 2007, p. 129) is not doing justice to its multifaceted nature. Conceptually, the broad view of Experience as meaningful stories has much more to offer than a narrow view as pleasurable, moment-by-moment feeling. Take the story of the young woman on a trip to Dublin from the preceding section. The experience gets its positive feel and meaning through the fulfilment of a need for relatedness, a need for feeling close to relevant others. The story speaks of intimacy, expressed, for example, by the liberty to send the message very early in the morning. The man was confident that his girlfriend would not be annoyed by the message. And while receiving love messages is always a wonderful thing, being in a foreign place, far away from home, certainly intensified this experience. In this example, the mobile phone was used as a tool for creating a relatedness experience. But the mobile phone is neither especially adapted to this, nor does it in any way imply the creation of this experience. It is nothing more than an awkward piece of infrastructure: even with the most elegant shell or navigational structure, it does not reflect the love put into the message. To give another example: While a telephone is certainly able to connect distant lovers, it embodies a strictly conversational model. However, feeling close is not about good conversations only, it is a about a feeling of presence and emotional expression. The telephone is not exceptionally good at this - as Peter Robinson observed in All the Colours of Darkness after a late night telephone conversation between Inspector Banks and his Sophia:
'Goodnight' said Banks. And the last thing he heard was her laughter as she puts down the phone. Banks felt more alone and further away for having just talked to Sophia than he had before the call. But it was always like that - the telephone might bring you together for a few moments, but there's nothing like it for emphasising distance.
We have all experienced the awkward silence when we have run out of stories to tell while not wanting to hang up on our loved one. This is the result of a misfit between the conversational model embodied by a telephone and the psychological requirements of a relatedness experience.
This must not necessarily be so, as the prevalent research on technology-mediated intimacy demonstrates (e.g., Vetere et al 2005). An unpublished review (Heidecker et al 2010) counted 144 published concepts of alternative communication devices, most of them much better adapted to the requirements of "feeling close" than any commercially available mobile phone. In many cases, the technological innovation embedded in those novel devices is negligible - they neither feature elaborated new algorithms nor future materials or fancy interface concepts. Their superiority is due to the intimate understanding of certain experiences, feelings, situations, boundary conditions, and how those experiences can be created and shaped through a thing.
The post-materialistic interactive product is, thus, not so much a tangible object, but a story transported or told through an object - a "material tale" or "psychosocial narrative". Dunne (2006, p. 69) explains: "[... B]ehavior is a narrative experience arising from the interaction between our desire to act through products and the social and behavioural limitations imposed [...] through [their] conceptual models. " We will inevitably act through products, a story will be told, but the product itself creates and shapes it. The designer becomes an "author" creating rather than representing experiences.
So far, there are not many commercially available products, which reflect the notion of Experience Design as the creation of meaningful stories through a product. An exception is FM3's Buddha Machine, dubbed the Anti-iPod by the Wall Street Journal in 2007 (Wagstaff 2007) - see Figure 5.
Author/Copyright holder: Zhang Jian. Copyright terms and licence: All Rights Reserved. Reproduced with permission. See section "Exceptions" in the copyright terms below.
Figure 3.5: The Buddha Machine II
The Buddha Machine is an electronic device loaded with nine ambient loops (Version 2.0) produced by FM3, an experimental music duo from China. It plays back one of those loops in 8-bit quality through an inbuilt speaker, has a button to skip through the loops, a knob to change the pitch of the playback and its volume. That's it. The Buddha Machine is a meditative experience. It tells a story of contemplation rather than restless consumption and suggests a way of doing so.
In 2007, the Buddha Machine was an unexpected commercial success with over 50.000 units sold. Joshua wrote on Resident Advisor: "With the Buddha Machine, FM3 have unwittingly unleashed a real phenomenon: [...] a personal stereo, a musical toy, a Buddhist souvenir, and a conceptual commodity offering valuable lessons for our consumption-obsessed times." He quotes Christiaan Virant, one of the creators of the Buddha Machine: "That's the beauty of the Buddha Machine, it's really ... serendipity." And Rob Walker (2007) noted for the New York Times Magazine:
And of course there's the anti-iPod factor: the relief of not having to make a choice in a world awash with entertainment and self-expression options. Moreover, at a moment when the unused abilities of feature-loaded computers, cellphones and even microwave ovens pile up faster than we can keep track of them, it's satisfying to know that once you've turned the Buddha Machine on, you are using it to its full capacity.
The Buddha Machine is an example of a device, which "manages to transcend the cheap plastic frame in which it's encased" (Heater 2008). It is a technology that offers a meaningful, valuable, and aesthetic experience and not just a bunch of functions, leaving it to the users to figure out how to incorporate them into their daily lives.
The Buddha Machine is an excellent example of a full-blown post-materialistic device. However, one may easily view it a representative of a novel product genre, which coexists with more "practical" genres, but does not affect the design of those more practical products. I disagree. A post-materialistic, experiential orientation can potentially be loaded into every product. An example is Swantje Krauß' diploma design project, which I supervised together with Olaf Barski. Krauß set out to design a new type of improved "bucket" for the grape harvest. Typically, grapes are picked by hand, gathered in a bucket, which is then emptied into a larger container. This bucket is clearly a tool; its design a tough exercise in practicality and classical ergonomics. However, Krauß added an interesting feature beyond the obvious: The bucket can be transformed into a seat (see Figure 6) which allows the vintager to take a rest from her physically demanding work.
Author/Copyright holder: Swantje Krauss. Copyright terms and licence: All Rights Reserved. Reproduced with permission. See section "Exceptions" in the copyright terms below.
Figure 3.6: From a tool to a place to rest
This seemingly small detail is interesting for at least three reasons. First, the bucket embeds both activities - gathering grapes and taking a rest - on an equal level, making clear that a rest is accepted as an integral part of the overall activity. Second, the bucket has to be empty to be transformed into a seat. This reflects upon the admittedly puritan ideal of "business before pleasure" and functions as a clear signal for the "appropriate" moment for taking a rest. Krauß' design makes sure that its users either pick grapes or rest, but resting and still doing a little bit of cleaning or sorting the grapes is impossible. This implies a clear separation between work and rest - an important psychological requirement for having a truly re-creative break. Third, the bucket suggests a particular way of taking that rest, namely in the vineyard, contemplating and enjoying the views or having a chat with colleagues.
Admittedly, a bucket is not a typical exemplar of an interactive product. Nevertheless, Krauß' example shows that understanding grape picking as more than a mere task, as an experience packed with psychological needs, emotions and meaning enables the designer to become an author of stories conveyed through the product.
3.5 Why, What and How
Let me summarize my thoughts on Experience in a simple conceptual model. I distinguish three different levels, when designing an experience through the interaction with an object: The Why, What and How level.
The What addresses the things people can do through an interactive product, such as "making a telephone call," "buying a book," or "listening to a song." Reflected by a products' functionality, the What is often intimately tied to the technology itself or a certain product genre. The How in turn addresses acting through an object on an operational, sensory-motor level: Buttons pressed, knobs turned, menus navigated, touch screens stroked, or remotes waggled. The How is even more tied to the actual object to be designed and its context of use.
The How is the typical realm of the interaction designer: to make given functionality accessible in an aesthetically pleasing way. To give an example: "Making a telephone call" (a What) requires an action to select a conversional partner, as well as to initiate and to end the call. How this is done with - let's say - a mobile phone is specified by the interaction designer. The example of the different orange squeezers, Bill Buxton (2007) provided, addresses possible differences in the quality of the interaction design, the How. Even given the same functionality (i.e., squeezing oranges), performing the action "feels" better with some products. Nowadays, the bundle of What and How is typically considered the product, and an especially sensual, aesthetic, novel, or stimulating arrangement of interaction makes this product "experiential."
This view ignores peoples' actual motivation to use a product. For the couple being separated, the SMS was not primarily an SMS, it was a love message, a way to fulfil their need for relatedness. This is the Why of product use. Telephone calls are not only - technologically speaking - telephone calls. In reality, they are the glorious beginning or the sad end of a close relationship, a surrogate good-night kiss, an act of support, a way to kill time, or a pizza order. People engage in these activities out of a need to be related, to help, to be stimulated, or to ease their appetites. The telephone just happens to be instrumental, but it does not necessarily reflect upon the underlying needs, emotions, and associated practices.
Experience Design is a remedy to this. It starts from the Why, tries to clarify the needs and emotions involved in an activity, the meaning, the experience. Only then, it determines functionality that is able to provide the experience (the What) and an appropriate way of putting the functionality to action (the How). Experience Design wants the Why, What and How to chime together, but with the Why, the needs and emotions, setting the tone (see Figure 7). This leads to products which are sensitive to the particularities of human experience. It leads to products able to tell enjoyable stories through their use or consumption.
Author/Copyright holder: Unknown (pending investigation). Copyright terms and licence: Unknown (pending investigation). See section "Exceptions" in the copyright terms below.
Figure 3.7: From the Why to the What and the How: Three levels to consider when designing technology-mediated experiences
3.6 Conclusion and future directions
The notion of (User) Experience as stories told through products has a potential to change the way we think and design. At the moment, the majority of commercially available interactive devices is either too practical or too open-ended. The practical view results in very obvious and uninspiring stories: how exciting is keeping a calendar on a mobile phone? The open-ended view on the other hand just provides functionality, such as texting, and leaves it to the user to come up with meaningful and inspiring usage scenarios, such as sending "love messages." In this case, the creation of meaningful experiences through appropriating a technology remains the responsibility of the "user". In contrast, Experience Design stands for technology, which suggests meaningful, engaging, valuable, and aesthetically pleasing experiences in itself. Thinking "communication experiences" rather than "mobile devices" opens up a huge design space for possible devices - even slippers (Chen et al 2006) or pillows (Laschke et al 2010).
Don't get me wrong, we still need all the wonderful technologies, dreamt up by engineers and computer scientists all over the world. But they are only materials - canvas, colours, and brushes - for the Experience Designer. From a business perspective, shifting attention from technological to experiential advancement makes sense, as long as the invention of new technologies and their marketing becomes increasingly difficult. Just take 3D television as an example: It is an innovation born out of a frantic need for re-inventing television to ensure future sales. The result is an expensive, hard to sell technology, without much power to impact our lives "The new movie by Darren Aronofsky now in 3D! So what?" Indeed, other technology-mediated innovations, such as improving the social experience of watching television as a family or over a distance, require less effort in terms of resources (both on the vendor and the consumer end), but at the same time offer a profound improvement of current practices and according experiences. We should definitely shift attention (and resources) from the development of new technologies to the conscious design of resulting experiences, from technology-driven innovations to human-driven innovations.
Inglehart, Ronald (1997): Modernization and Postmodernization: Cultural, Economic, and Political Change in 43 Societies. Princeton University Press
Jay, Martin (2006): Songs of Experience: Modern American and European Variations on a Universal Theme.University of California Press
Kahnemann, Daniel (2003): Objective happiness. In: Kahneman, Daniel, Diener, Ed and Schwarz, Norbert (eds.). "Well-Being: The Foundations of Hedonic Psychology". Russell Sage Foundation Publicationspp. 3-25
For years, I have struggled to understand the difference between "user experience" and "experience". I couldn't help but smile as Marc struggled with this same problem. In fact, by the penultimate paragraph, Marc had decided to place the word "user" in parenthesis. This supports the viewpoint that both Marc and I seem to share, that both of these terms mean essentially the same thing, despite the semantic bickering in the professional community. Listen to the first few minutes of Marc's first video for some very succinct remarks on this matter.
Of course, if one really feels a need to differentiate between "user experience" and "experience", Marc has some interesting comments and observations. In the introduction, he suggests that "It is about creating an experience through a device." "It" is the elusive beast in the current debate.
Later on, Marc states, "Experience or User Experience is not about technology, industrial design, or interfaces. It is about creating a meaningful experience through a device." I agree 100% with the first statement, but I question the second part; I don't think that experience is necessarily related to a device. Certainly, Charlie's experience with the chocolate factory didn't involve "experience through a device" unless you pedantically define the golden ticket as a "device". (The presence of a device or lack thereof often lies at the heart of the "user experience vs. experience" debate.)
But let's take things a step further. If I go out to greet the sunrise - not courtesy of Philips, but standing in my garden on a glorious spring day - my experience does not depend on technology, industrial design, or interfaces. Since I like sunrises, my limbic system is busy distributing dopamine - a reward chemical that affects my mood. And my body is soaking up Vitamin D, which improves my health. There are no devices involved in this interaction between me and the sun (accompanied by soft dew on the grass between my toes, birds chirping, and that undefinable smell released by vegetation as it, too, awakes and greets the sun).
As a designer, I see user experience (UX) as the perception left in someone's mind following a series of interactions between people, devices, and events - or any combination thereof. "Series" is the operative word.
Some interactions are active - clicking a button on a website, giving a waiter your order at a restaurant, getting out of the rain at a picnic.
Some interactions are passive - viewing a beautiful sunrise will trigger the release of reward chemicals in our brain. This applies to any and all of our five senses.
Some interactions are secondary to the ultimate experience - the food tastes good because the chef chose quality ingredients and prepared them well. The ingredients are good quality because the farmer tended his fields. The crop interacted well with the rain that year.
Of course, all interactions are open to subjective interpretation - some people don't like celery or sunrises. Remember, a perception is always true in the mind of the perceiver; if you think sunrises are depressing, there's little I can say or do to convince you otherwise. However, this is why designers often fall back on "best practice" - most people react favorably to sunrises.
For these reasons, I think that designing a "user experience," represents the conscious act of:
coordinating interactions that are controllable (choosing food ingredients, training waiters, designing and programming buttons)
acknowledging interactions that are beyond our control (uncomfortable seats in a 100-year-old theater, lack of fresh produce in winter, low-hanging clouds that hide the sky)
reducing negative interactions (providing tents as emergency shelters at outdoor events in case of rain; making sure restaurant seating next to the noisy kitchen door is the last to be filled, putting in an extra intermission so folks can stretch their legs)
A good user-experience designer needs to be able to see both the forest and the trees. That means user experience has implications that go far beyond usability, visual design, and physical affordances. As UX designers, we orchestrate a complex series of interactions and the emotional responses and/or physical responses that these interactions generate. To look at "experience" in terms of individual service or product touchpoints is ultimately too limiting. It is the total sum of that counts.
Another interesting point is contained in Marc's example of the "I love you" SMS. Here, the phone's designer merely facilitated an interaction between two individuals. Facilitating an experience and creating one are two very different things - designers should always consider which role they being asked to play at any given time in the design process.
Finally, the value of an experience is exceptionally subjective. I was delighted to see Marc's reference to the van Boven and Gilovich work from 2003. This ties in directly to the work of Akerlof, Spence, and Stiglitz on asymmetric information, which won them the Nobel Prize in Economics in 2001. Let me share some thoughts.
Despite any theoretical shift from a materialistic society that covets things, to a post-materialistic culture that nurtures experience, the value of physical items has always increased if they are accompanied by a good story. A vintage watch is worth more if it comes with all its original paperwork, receipts, etc. An antique chair's value can change dramatically depending on its provenance. (A chair previously owned by Winston Churchill is going to be worth more than a chair from my house). Yet neither watches nor wing chairs physically change because they come with a piece of paper.
As designers, dealing with the subjective nature of experience could well be our greatest challenge. This may also explain why experience is so difficult to define - which brings us back full circle to the beginning of this commentary.
3.8 Commentary by Donald A. Norman
Technologies migrate as they mature. In early childhood, their very existence is a marvel, even as people wonder what can be made of it. In early adolescence, they become more and more able to perform useful functions for us, and for a while, they are judged primarily on their ability to do more and more, better and better. Finally, in maturity, it is the quality of the experience provided by these technologies that matter. Adolescents thrust their technological underpinnings into our consciousness, even as we resisted. But once the technology becomes mature, it recedes into the background, supportive of the total experience it provides.
Design, it has been said (Krippendorff, 1989) is the creation of meaning, and as Hassenzahl points out, the essence of meaning to us people is our experiences.
The chapter by Marc Hassenzahl ought to be required reading in courses of design, and perhaps even more importantly, in engineering and computer science. Do the devices we design and produce work well? Do they do marvelous, mysterious operations, working invisibly across space and time? Yes, they do, but doing that is a means, not the end. The end is the experiences they engender, the stories we tell, and the way that they enriched our lives.
But this creates a problem. We know how to design things that accomplish particular, concrete actions. But how can experiences be designed? As Hassenzahl points out they can’t be: they can only be supported. To use another design term: we can design in the affordances of experiences, but in the end it is up to the people who use our products to have the experiences.
The product provides the "How" part of an experience. It is up to people to provide the "What" and the "Why." But designers can help here as well, setting the framework, providing the initiative, providing examples.
Design has moved from its origins of making things look attractive (styling), to making things that fulfill true needs in an effective understandable way (design studies and interactive design) to the enabling of experiences (experience design). Each step is more difficult than the one before each requires and builds upon what was learned before.
The first step toward experiences was to learn about and embrace emotion and products that were pleasurable. This step has just been taken, with an increasing number of books, journal articles, and conferences attesting to the interest in this topic. But these steps too were in their infancy, addressing primarily the need and desirability along with the technical difficulties of measuring the resulting emotions or pleasure.
Marc Hassenzahl throws down the gauntlet for future designs: to produce products that deliver the Why, What, and How.
Krippendorff, Klaus (1989). On the Essential Contexts of Artifacts or on the Proposition That "Design Is Making Sense (Of Things)". Design Issues, 5(2), pp. 9-39.
About the Author
Don Norman is the author of numerous books including "Emotional Design," and more recently, "Living with Complexity." He is co-founder of the Nielsen Norman group, a professor at KAIST (in Korea), and IDEO fellow, and a design theorist, studying the fundamentals of modern design. Although he invented the term "User experience" while an executive at Apple, he is pleased that people like Marc Hassenzhal have moved beyond the phrase to deep substance. Although Norman travels an inordinate amount, he can always be found at www.jnd.org
3.9 Commentary by Mark Blythe
The Hitch Hiker's Guide to Experience Design
I like the idea of Marc's alarm clock, but I suspect that with the right sort of hangover, the gentle birdsong might sound like horses galloping over a tin bridge. It is an old point now but perhaps worth repeating: no experience can be guaranteed. In McCarthy and Wright's formulation experiences cannot be designed they can only be designed for (3). It is sometimes countered that, on the contrary, experiences get designed all the time and we only have to look at film, theatre and the other arts to see how. But in some ways there couldn't be a worse example. Consider James Cameron's "Avatar". Incredibly, the person who I was with found it… boring, yes, boring, if you can believe it. As I sat in open mouthed astonishment at the technological and artistic achievement, my friend's jaw dropped only to yawn. Experience cannot be guaranteed even with Hollywood budgets. But conceding that you can't please all of the people all of the time does not necessarily mean that we cannot learn anything from understandings of literature, film and other media. Novelists, dramatists and film directors have, after all, been designing impossible things for a very long time.
Somewhere in the fourth video of the very interesting conversations with Marc he points out that the differences in how we tell stories matter. The way that we tell and understand story is crucial for experience design and for this reason there is as the saying goes "a small but growing body of work" that draws on critical theory (e.g. 1.2.3). Critical theory developed from the study of literature, drama and film. It is a catch all term that covers a very diverse range of perspectives such as psychoanalysis, feminism and deconstruction. Because its subject of study is the everyday - novels, films, TV, it is often dismissed as pretentious. It draws on specialized or high falutin' terms like "dialogical" and can seem unnecessarily abstract and difficult.
The terms "dialogical" and "monological" were key to the thought of the literary critic Mikhail Bakhtin and they are increasingly applied to experience design (e.g. 3). Such concepts can be quite confusing and are perhaps best explained with reference to the kinds of contexts Bakhtin thought about. For Bakhtin a "monological" utterance expects no answer. For instance, the order "Charge!" on a battlefield anticipates action, not debate. For Bakhtin the style of narrative in the novels of Tolstoy is also monological. The narrator of Anna Karenina for example knows the most intimate thoughts and actions of every character. How he knows what everyone is thinking is not at issue. In Dostoevsky on the other hand the narrative is dialogical. In Notes from the Underground the narrator constantly tries to anticipate and guess the reader's responses to what he is saying. "You imagine no doubt, gentlemen, that I want to amuse you. You are mistaken in that, too. I am by no means such a mirthful person as you imagine." Even where a neutral narrative voice begins the novel with omnipresent authority, as in the Brothers Karamazov, it is later revealed that this voice belongs to one of the characters with a partial perspective and sources which might or might not be reliable. Today monological authority is increasingly undermined by dialogical forms. To find examples today we might look at the anti Mubarak protests in Egypt in 2011, organized in part through Facebook and Twitter.
Unlike a paper based encyclopedia resources such as this are also dialogical in the form of commentaries and invitations for reader responses. Douglas Adams predicted this long ago when he wrote that the Hitch Hiker's Guide to the Galaxy had supplanted the older and more pedestrian Encyclopedia Galactica in many of the more relaxed civilizations on the Outer Eastern Rim of the Galaxy. This, he said, was partly because it was slightly cheaper but mostly because it had the words "Don't Panic:" inscribed in large friendly letters on the front cover. The guide's field workers like Ford Prefect, would travel the universe, write about it and send their copy to the editors. Towards the end of his life Adams became less interested in writing novels and more involved in developing new media such as the pioneering game Starship Titanic. The HG2G website which attempted to create a real hitch hiker's guide with user generated content was a precursor to wikipedia. What then might a hitch hiker's guide to experience design look like?
Experience design is complicated, really complicated. I mean, you may think planning a holiday in Centre Parks is needlessly difficult, but that's just peanuts to experience design
The style might settle down after this and go on to note that it draws on many other disciplines - psychology, sociology and yes even literary theory sometimes. Many years ago, as another new field of study formed, Roland Barthes pointed out that interdisciplinary work is not achieved by gathering a number of sciences around a new "subject": "Interdisciplinarity" he said "consists in creating a new object that belongs to no one". Or as Marc Hassenzahl puts it in conversation here, the many relevant disciplines must talk to each other to find what works.
Bardzell J & Bardzell S (2008) Interaction criticism: a proposal and
framework for a new discipline of hci Interaction Design CHI '08 extended
abstracts on Human factors in computing systems
Blythe, M. and Cairns, P. 2009. Critical methods and user generated
content: the iPhone on YouTube. CHI '09. (Boston, MA, USA, April 04 - 09,
McCarthy J., and Wright P., (2008) Technology as Experience. MIT Press
3.10 Commentary by Whitney Hess
Experience designers make a career out of alleviating people's problems and bringing them joy. To do this we remove barriers to entry; reduce the gap between current knowledge and target knowledge; make information easy to find and share; present content in digestible, understandable formats; adapt to the context of use; and above all else, maximize the potential for people to succeed.
But before we can find the right solution (the "How"), we need to carefully prioritize the features we invest in (the "What"). To determine our priorities, we need to clearly and accurately define the problem (the "Why"). To determine the problem, we need to identify the intended audience (the "Who"). And to determine the audience, we need to listen. At its core, this is the goal of experience design.
The result of a well-defined who, why, and what is an elegant how that can provide people with new dimensions of understanding, productivity, and pleasure.
Products, services and systems should improve the quality of people's lives, reduce stress, and create effeciencies that didn't previously exist. But uninformed design often yields the wrong what for the wrong who with a poorly considered how, causing pain and confusion, adding unnecessary cost, and defeating the purpose of the entire effort.
Marc Hassenzahl superbly demonstrates the power of a triumphant how, by doing what the best experience designers do: wrapping us up in a story and taking us where we need to go. His opening to this chapter illustrates the vastness of an experience designer's purview - what I am only able to convey with arms stretched wide - by making us feel what we would have felt had we been experiencing the products for ourselves.
Like with writing, just about all digital experiences are a proxy for meatspace, and that is a hurdle we must constantly overcome. Hassenzahl helps us recognize that not only do we have the responsibility to create the closest approximation of the mental, emotional and spiritual experience, but we also have the opportunity to use technology to create fulfilling experiences that would never be materially, logistically, or viably possible in the physical space.
"Experience or User Experience is not about good industrial design, multi-touch, or fancy interfaces," Hassenzahl states. "It is about transcending the material. It is about creating an experience through a device." I have chosen to read his use of "device" in its perhaps secondary but broader meaning - "a plan, scheme, or trick with a particular aim," rather than as a material object. I don't view experience design as contingent upon having an object (digital or material) with which to interact, though I can understand the argument of being device-centric given the implications of there being a user. But a user of a service might engage solely through conversation, with the designed "device" being flow. An experience designer's ultimate output is a plan itself, with all its conditions and contingencies. The success of the experience lies in the thoroughness and thoughtfulness of the plan.
Hassenzahl's guidelines on how to craft experiences as a dialog between designer and participant are insightful and well-articulated. He finally finds the common ground amongst what many practitioners have been preaching for decades: our work is a matter of ethics. We have to live with the choices we make, so let's do whatever it takes to be proud of the stories we tell and experiences we create.
I would like to see experience designers spend less time preoccupied with technology and more time exploring new environments on the hunt for new experiences. If we are bound to our chairs and screens, how will we discover new ways to create connection, meaning and purpose, and promote those learnings to the people we serve - or better yet, discover for ourselves whom we wish to serve in the first place?
3.11 Commentary by Paul Hekkert
Everything I read in Marc Hassenzahl's chapter sounds so true, so valuable, and so familiar. It comforted me, and it puzzled me. Of course, designers are there to shape experiences. Nokia, or any mobile phone manufacturer, is all about connectedness, not about these mobile devices. All design starts with a 'why', and next comes the 'what', or the 'how'. I will come back to this order in a minute.
Recently, I published a new book together with designer and colleague Matthijs van Dijk: "Vision in Design: A guidebook for innovators" (2011). It spends over 300 pages on explaining (future) designers on how to find the WHY of their designs, what we call its 'raison d'être' or 'Daseinsgrund'. The reason of existence is grounded in the future world, as the designer sees it, and reflects what the designer wants to offer people given this world. What do you want people to understand, see, be able to, feel or experience? This goal or ultimate reason is indeed often experiential1. A random example from a student: "I want passengers to experience a sense of freedom within the limited space of an aircraft, by stimulating mental travel." This experiential goal takes into account the context of an aircraft, the mental state people are in during traveling, social anxiety, and people's love of mind wandering. This ultimate experience comes first; the product is (just) instrumental in realizing it. Or as Marc puts it: it's all about bringing "... the resulting experience to the fore - to design the experience before the product." Hence the familiarity.
It is so obvious and logical and yet Marc has managed to phrase it in a way that is crisp and clear and thereby he opens it up to an audience that may not seem so aware of its logic. People who are caught up in technological advancements for their own sake? And here Marc also puzzles me. Why this emphasis on interactive products? All products are – in essence – interactive, they allow for and require interaction, and all products can contribute to, stage, shape, facilitate, or enable experiences. Think of Starck's Juicy Salif, designed to stimulate conversations between a son- and mother-in-law. Or the example of the bucket "... a bucket is not a typical exemplar of an interactive product", as Marc writes. So what?
Somewhere along the line, the 'why' must be transformed in a 'what' and a 'how' and I believe the crux is in changing the order Marc proposed. After the WHY, designers should not immediately follow with a WHAT, but first decide on the HOW. This HOW is the user experience or product experience as we have coined it (Schifferstein and Hekkert, 2008); it captures the way people will interact with and experience the to-be-designed product that is not yet defined. These qualities of the interaction are intangible and not bound to anything, and they determine whether the ultimate experiential goal will be met. The WHAT that is next to be designed is simply a carrier of these qualities and it can be any type of product, an interactive product, a service, or a web application.
Let us consider an example of how this works. Years ago, student Sanne Kistemaker defined the experiential goal (the WHY) of her design project as "I want people to experience sarcastic triumph while staring at other people". We all want this, right? Watch other people while on the train, see what habits they have composed, see how they interact each other. She could have easily solved her design goal by some augmented reality type of application on a smart phone. But before she decided on the 'carrier' of her experience, she first defined what the interaction with the product should be. This interaction, as she saw it, should be tricky, reluctant, apprehensive, and straightforward, to make the user feel guilty and hesitating, yet proud and rebellious. She designed this interaction and corresponding user experience without having a clue what product should do this. And she beautifully solved it without any technological means: a newspaper that is offered with a small hole in the middle (see Figure)2. You may hesitate to use this paper, it is a little tricky, but once you do, in a train or on a terrace, you will certainly feel guilty and probably experience a sarcastic triumph!
To sum up, Marc importantly stresses that the user experience, the experience of the (interactive) product, should never be an end in itself, but is always instrumental to some life experience. All very true. And since the final design, the product, is again instrumental to the user experience, it seems only logical to make this the order of things: ultimate experience (WHY) > user experience (HOW) > product (WHAT). Designing along these lines is exactly what Verganti (2009) means when he speaks of 'design-driven innovation', where the designer pushes a new meaning, a new experience onto the public. Marc's chapter gives us many clues on how to do this.
Hekkert, P. & van Dijk, M. (2011). Vision in Design: A Guidebook for Innovators. Amsterdam: BIS.
Schifferstein, H.N.J. & Hekkert, P. (Eds.)(2008). Product Experience. Amsterdam: Elsevier.
Verganti, R. (2009). Design Driven Innovation – Changing the Rules of Competition by Radically Innovating what Things Mean. Boston, MA: Harvard Business Press.
When we look at public products for instance, the underlying reason can also be behavioral. Designing for behavioral change is currently a popular topic in design research.
Itis crucial for the design that the whole is already there; the experience would fail if the user had to make his/her own hole.