Publication statistics

Pub. period:2006-2009
Pub. count:6
Number of co-authors:1



Co-authors

Number of publications with 3 favourite co-authors:

Wolfgang Vietze:1

 

 

Productive colleagues

Martin Schmettow's 3 most productive colleagues in number of publications:

Wolfgang Vietze:1
 
 
 

Upcoming Courses

go to course
Design Thinking: The Beginner's Guide
Starts tomorrow LAST CALL!
go to course
The Psychology of Online Sales: The Beginner's Guide
Starts the day after tomorrow !
 
 

Featured chapter

Marc Hassenzahl explains the fascinating concept of User Experience and Experience Design. Commentaries by Don Norman, Eric Reiss, Mark Blythe, and Whitney Hess

User Experience and Experience Design !

 
 

Our Latest Books

 
 
The Social Design of Technical Systems: Building technologies for communities. 2nd Edition
by Brian Whitworth and Adnan Ahmad
start reading
 
 
 
 
Gamification at Work: Designing Engaging Business Software
by Janaki Mythily Kumar and Mario Herger
start reading
 
 
 
 
The Social Design of Technical Systems: Building technologies for communities
by Brian Whitworth and Adnan Ahmad
start reading
 
 
 
 
The Encyclopedia of Human-Computer Interaction, 2nd Ed.
by Mads Soegaard and Rikke Friis Dam
start reading
 
 

Martin Schmettow

Personal Homepage:
http://schmettow.info

Current place of employment:
Passau University

Studied psychology and business computing. Worked as a scientist and consultant at a German Software Engineering research institute. Current research is on advanced statistical approaches for measuring, planning and controlling usability evaluation studies.

Edit author info
Rename / change spelling
Add publication
 

Publications by Martin Schmettow (bibliography)

 what's this?
2009
 
Edit | Del

Schmettow, Martin (2009): Controlling the usability evaluation process under varying defect visibility. In: Proceedings of the HCI09 Conference on People and Computers XXIII 2009. pp. 188-197.

In cases where usability is a mission critical system quality it is becoming essential to know whether an evaluation study has identified the majority of existing defects. Previous work has shown that procedures for estimating the progress of evaluation studies have to account for variation in defect visibility; otherwise, harmful bias will happen. Here, a statistical model is introduced for estimating the number of not-yet-identified defects in a study. This approach also supports exact confidence intervals and can easily be adapted to estimate the required number of sessions. The method is evaluated and shown to, in most cases, provide accurate measures. A running example illustrates how practitioners may track the progress of their studies and make quantitatively informed decisions on when to finish.

© All rights reserved Schmettow and/or his/her publisher

2008
 
Edit | Del

Schmettow, Martin and Vietze, Wolfgang (2008): Introducing item response theory for measuring usability inspection processes. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008. pp. 893-902.

Usability evaluation methods have a long history of research. Latest contributions significantly raised the validity of method evaluation studies. But there is still a measurement model lacking that incorporates the relevant factors for inspection performance and accounts for the probabilistic nature of the process. This paper transfers a modern probabilistic approach from psychometric research, known as the Item Response Theory, to the domain of measuring usability evaluation processes. The basic concepts, assumptions and several advanced procedures are introduced and related to the domain of usability inspection. The practical use of the approach is exemplified in three scenarios from research and practice. These are also made available as simulation programs.

© All rights reserved Schmettow and Vietze and/or ACM Press

 
Edit | Del

Schmettow, Martin (2008): Heterogeneity in the Usability Evaluation Process. In: England, David and Beale, Russell (eds.) HCI2008 September 1-5, 2008, Liverpool, UK. pp. 89-98.

Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

© All rights reserved Schmettow and/or British Computing Society

 
Edit | Del

Schmettow, Martin (2008): Towards Industrial Strength Usability Evaluation. In: Abrahao, Sylvia, Law, Effie Lai-Chong, Stage, Jan and Hornbk, Kaspar (eds.) International Workshop on the Interplay between Usability Evaluation and Software Development I-USED 2008 2008, Pisa, Italy. .

 
Edit | Del

Schmettow, Martin (2008): Heterogeneity in the Usability Evaluation Process. In: Proceedings of the HCI08 Conference on People and Computers XXII 2008. pp. 89-98.

Current prediction models for usability evaluations are based on stochastic distributions derived from series of Bernoulli processes. The underlying assumption of these models is a homogeneous detection probability despite of it being intuitively unrealistic. This paper contributes a simple statistical test for existence of heterogeneity in the process. The compound beta-binomial model is proposed to incorporate sources of heterogeneity and compared to the binomial model. Analysis of several data sets from the literature illustrates the methods and reveals that heterogeneity occurs in most situations. Finally, it is demonstrated how heterogeneity biases the prediction of evaluation processes. Open research questions are discussed and preliminary advice for practitioners for controlling their processes is given.

© All rights reserved Schmettow and/or his/her publisher

2006
 
Edit | Del

Schmettow, Martin (2006): User Interaction Design Patterns for Information Retrieval Systems. In: Hvatum, Lise and Zdun, Uwe (eds.) EuroPloP 2006 2006, Irsee, Germany. .

 
Add publication
Show list on your website
 

Join our community and advance:

Your
Skills

Your
Network

Your
Career

 
Join our community!
 
 
 

Changes to this page (author)

03 Nov 2010: Modified
12 Jul 2009: Modified
12 Nov 2008: Added
12 Nov 2008: Added
12 Nov 2008: Added
12 Nov 2008: Added
28 Aug 2008: Added
28 Aug 2008: Added
12 May 2008: Modified
12 May 2008: Added

Page Information

Page maintainer: The Editorial Team
URL: http://www.interaction-design.org/references/authors/martin_schmettow.html

Publication statistics

Pub. period:2006-2009
Pub. count:6
Number of co-authors:1



Co-authors

Number of publications with 3 favourite co-authors:

Wolfgang Vietze:1

 

 

Productive colleagues

Martin Schmettow's 3 most productive colleagues in number of publications:

Wolfgang Vietze:1
 
 
 

Upcoming Courses

go to course
Design Thinking: The Beginner's Guide
Starts tomorrow LAST CALL!
go to course
The Psychology of Online Sales: The Beginner's Guide
Starts the day after tomorrow !
 
 

Featured chapter

Marc Hassenzahl explains the fascinating concept of User Experience and Experience Design. Commentaries by Don Norman, Eric Reiss, Mark Blythe, and Whitney Hess

User Experience and Experience Design !

 
 

Our Latest Books

 
 
The Social Design of Technical Systems: Building technologies for communities. 2nd Edition
by Brian Whitworth and Adnan Ahmad
start reading
 
 
 
 
Gamification at Work: Designing Engaging Business Software
by Janaki Mythily Kumar and Mario Herger
start reading
 
 
 
 
The Social Design of Technical Systems: Building technologies for communities
by Brian Whitworth and Adnan Ahmad
start reading
 
 
 
 
The Encyclopedia of Human-Computer Interaction, 2nd Ed.
by Mads Soegaard and Rikke Friis Dam
start reading