Publication statistics

Pub. period:2006-2009
Pub. count:6
Number of co-authors:1



Co-authors

Number of publications with 3 favourite co-authors:

Wolfgang Vietze:1

 

 

Productive colleagues

Martin Schmettow's 3 most productive colleagues in number of publications:

Wolfgang Vietze:1
 
 
 

Upcoming Courses

Affordances: Designing Intuitive User Interfaces

90% booked. Starts in 5 days
 
 
 

User Experience: The Beginner's Guide

85% booked. Starts in 10 days
 
 
 
 
 

Featured chapter

Marc Hassenzahl explains the fascinating concept of User Experience and Experience Design. Commentaries by Don Norman, Eric Reiss, Mark Blythe, and Whitney Hess

User Experience and Experience Design !

 
 

Our Latest Books

Kumar and Herger 2013: Gamification at Work: Designing Engaging Business Software...
by Janaki Mythily Kumar and Mario Herger

 
Start reading

Whitworth and Ahmad 2013: The Social Design of Technical Systems: Building technologies for communities...
by Brian Whitworth and Adnan Ahmad

 
Start reading

Soegaard and Dam 2013: The Encyclopedia of Human-Computer Interaction, 2nd Ed....
by Mads Soegaard and Rikke Friis Dam

 
Start reading
 
 

Martin Schmettow

Personal Homepage:
http://schmettow.info

Current place of employment:
Passau University

Studied psychology and business computing. Worked as a scientist and consultant at a German Software Engineering research institute. Current research is on advanced statistical approaches for measuring, planning and controlling usability evaluation studies.

Edit author info
Add publication

Publications by Martin Schmettow (bibliography)

 what's this?
2009
 
Edit | Del

Schmettow, Martin (2009): Controlling the usability evaluation process under varying defect visibility. In: Proceedings of the HCI09 Conference on People and Computers XXIII 2009. pp. 188-197.

In cases where usability is a mission critical system quality it is becoming essential to know whether an evaluation study has identified the majority of existing defects. Previous work has shown that procedures for estimating the progress of evaluation studies have to account for variation in defect visibility; otherwise, harmful bias will happen. Here, a statistical model is introduced for estimating the number of not-yet-identified defects in a study. This approach also supports exact confidence intervals and can easily be adapted to estimate the required number of sessions. The method is evaluated and shown to, in most cases, provide accurate measures. A running example illustrates how practitioners may track the progress of their studies and make quantitatively informed decisions on when to finish.

© All rights reserved Schmettow and/or his/her publisher

2008
 
Edit | Del

Schmettow, Martin and Vietze, Wolfgang (2008): Introducing item response theory for measuring usability inspection processes. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008. pp. 893-902.

Usability evaluation methods have a long history of research. Latest contributions significantly raised the validity of method evaluation studies. But there is still a measurement model lacking that incorporates the relevant factors for inspection performance and accounts for the probabilistic nature of the process. This paper transfers a modern probabilistic approach from psychometric research, known as the Item Response Theory, to the domain of measuring usability evaluation processes. The basic concepts, assumptions and several advanced procedures are introduced and related to the domain of usability inspection. The practical use of the approach is exemplified in three scenarios from research and practice. These are also made available as simulation programs.

© All rights reserved Schmettow and Vietze and/or ACM Press

 
Edit | Del

Schmettow, Martin (2008): Heterogeneity in the Usability Evaluation Process. In: England, David and Beale, Russell (eds.) HCI2008 September 1-5, 2008, Liverpool, UK. pp. 89-98.

Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

© All rights reserved Schmettow and/or British Computing Society

 
Edit | Del

Schmettow, Martin (2008): Towards Industrial Strength Usability Evaluation. In: Abrahao, Sylvia, Law, Effie Lai-Chong, Stage, Jan and Hornbæk, Kaspar (eds.) International Workshop on the Interplay between Usability Evaluation and Software Development I-USED 2008 2008, Pisa, Italy. .

 
Edit | Del

Schmettow, Martin (2008): Heterogeneity in the Usability Evaluation Process. In: Proceedings of the HCI08 Conference on People and Computers XXII 2008. pp. 89-98.

Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

© All rights reserved Schmettow and/or his/her publisher

2006
 
Edit | Del

Schmettow, Martin (2006): User Interaction Design Patterns for Information Retrieval Systems. In: Hvatum, Lise and Zdun, Uwe (eds.) EuroPloP 2006 2006, Irsee, Germany. .

 
Add publication
Show list on your website
 

Join our community and advance:

Your
Skills

Your
Network

Your
Career

 
 
 
 

Changes to this page (author)

03 Nov 2010: Modified
12 Jul 2009: Modified
12 Nov 2008: Added
12 Nov 2008: Added
12 Nov 2008: Added
12 Nov 2008: Added
28 Aug 2008: Added
28 Aug 2008: Added
12 May 2008: Modified
12 May 2008: Added

Page Information

Page maintainer: The Editorial Team
URL: http://www.interaction-design.org/references/authors/martin_schmettow.html

Publication statistics

Pub. period:2006-2009
Pub. count:6
Number of co-authors:1



Co-authors

Number of publications with 3 favourite co-authors:

Wolfgang Vietze:1

 

 

Productive colleagues

Martin Schmettow's 3 most productive colleagues in number of publications:

Wolfgang Vietze:1
 
 
 

Upcoming Courses

Affordances: Designing Intuitive User Interfaces

90% booked. Starts in 5 days
 
 
 

User Experience: The Beginner's Guide

85% booked. Starts in 10 days
 
 
 
 
 

Featured chapter

Marc Hassenzahl explains the fascinating concept of User Experience and Experience Design. Commentaries by Don Norman, Eric Reiss, Mark Blythe, and Whitney Hess

User Experience and Experience Design !

 
 

Our Latest Books

Kumar and Herger 2013: Gamification at Work: Designing Engaging Business Software...
by Janaki Mythily Kumar and Mario Herger

 
Start reading

Whitworth and Ahmad 2013: The Social Design of Technical Systems: Building technologies for communities...
by Brian Whitworth and Adnan Ahmad

 
Start reading

Soegaard and Dam 2013: The Encyclopedia of Human-Computer Interaction, 2nd Ed....
by Mads Soegaard and Rikke Friis Dam

 
Start reading
 
 
 
 
This course starts in