Shumin Zhai

Author: Shumin Zhai

Ph.D

Shumin Zhai is a Human-Computer Interaction research scientist at Google Inc. Prior to joning Google Research he worked at the IBM Almaden Research Center from 1996 to 2011. He is interested in both foundational issues of user interfaces and practical product and service innovations. He originated and led the ShapeWriter project that pioneered the touch screen gesture keyboard paradigm. He has published over 100 research papers and received 30 patents. He is active in the academic community and is currently the Editor-in-Chief of ACM Transactions on Computer-Human Interaction. He has been a visiting professor and lectured at universities in the US, Europe and China. He is a Fellow of the ACM and a Member of the CHI Academy.

Publications

Publication period start: 2012
Number of co-authors: 80

Co-authors

Number of publications with favourite co-authors
Johnny Accot
7
Paul Milgram
7
Barton A. Smith
8

Productive Colleagues

Most productive colleagues in number of publications
Michel Beaudouin-Lafon
52
Andy Cockburn
68
Bill Buxton
78

Publications

Bi, Xiaojun, Smith, Barton A., Zhai, Shumin (2012): Multilingual Touchscreen Keyboard Design and Optimization. In Eminds – International Journal of Human Computer Interaction, 27 (4) pp. 352-382. https://www.tandfonline.com/doi/abs/10.1080/07370024.2012.678241

Yin, Jibin, Ren, Xiangshi, Zhai, Shumin (2010): Pen pressure control in trajectory-based interaction. In Behaviour and Information Technology, 29 (2) pp. 137-148. https://www.informaworld.com/10.1080/01449290902904733

Apitz, Georg, Guimbretiere, Francois, Zhai, Shumin (2010): Foundations for designing and evaluating user interfaces based on the crossing paradigm. In ACM Transactions on Computer-Human Interaction, 17 (2) pp. 9. https://dx.doi.org/10.1145/1746259.1746263

Zhai, Shumin, Kristensson, Per-Ola, Smith, Barton A. (2005): In search of effective text input interfaces for off the desktop computing. In Interacting with Computers, 17 (3) pp. 229-250. https://dx.doi.org/10.1016/j.intcom.2003.12.007

Ingmarsson, Magnus, Dinka, David, Zhai, Shumin (2004): TNT: a numeric keypad based text input method. In: Dykstra-Erickson, Elizabeth, Tscheligi, Manfred (eds.) Proceedings of ACM CHI 2004 Conference on Human Factors in Computing Systems April 24-29, 2004, Vienna, Austria. pp. 639-646. https://doi.acm.org/10.1145/985692.985773

Lee, Paul Ung-Joon, Zhai, Shumin (2004): Top-down learning strategies: can they facilitate stylus keyboard learning?. In International Journal of Human-Computer Studies, 60 (5) pp. 585-598.

Zhai, Shumin (2004): Characterizing computer input with Fitts\' law parameters -- the information and non-infor. In International Journal of Human-Computer Studies, 61 (6) pp. 791-809. https://dx.doi.org/10.1016/j.ijhcs.2004.09.006

Zhai, Shumin, Kong, Jing, Ren, Xiangshi (2004): Speed-accuracy tradeoff in Fitts\' law tasks -- on the equivalency of actual and nominal p. In International Journal of Human-Computer Studies, 61 (6) pp. 823-856. https://dx.doi.org/10.1016/j.ijhcs.2004.09.007

Zhai, Shumin, Accot, Johnny, Woltjer, Rogier (2004): Human Action Laws in Electronic Virtual Worlds - An Empirical Study of Path Steering Perfo. In Presence: Teleoperators and Virtual Environments, 13 (2) pp. 113-127.

Zhai, Shumin, Kristensson, Per-Ola (2003): Shorthand writing on stylus keyboard. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 97-104.

Albinsson, Par-Anders, Zhai, Shumin (2003): High precision touch screen interaction. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 105-112.

Zhai, Shumin, Conversy, Stephane, Beaudouin-Lafon, Michel, Guiard, Yves (2003): Human on-line response to target expansion. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 177-184.

Accot, Johnny, Zhai, Shumin (2003): Refining Fitts' law models for bivariate pointing. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 193-200.

Zhai, Shumin (2003): What\'s in the eyes for attentive input. In Communications of the ACM, 46 (3) pp. 34-39. https://dl.acm.org/doi/10.1145/636772.636795

Zhai, Shumin, Sue, Alison, Accot, Johnny (2002): Movement model, hits distribution and learning in virtual keyboarding. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 17-24.

Accot, Johnny, Zhai, Shumin (2002): More than dotting the i's -- foundations for crossing-based interfaces. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 73-80.

Zhai, Shumin, Hunter, Michael, Smith, Barton A. (2002): Performance Optimization of Virtual Keyboards. In Human-Computer Interaction, 17 (2) pp. 229-269.

Accot, Johnny, Zhai, Shumin (2001): Scale Effects in Steering Law Tasks. In: Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA. pp. 1-8. https://www.acm.org/pubs/articles/proceedings/chi/365024/p1-accot/p1-accot.pdf

Wang, Jingtao, Zhai, Shumin, Su, Hui (2001): Chinese Input with Keyboard and Eye-Tracking: An Anatomical Study. In: Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA. pp. 349-356. https://www.acm.org/pubs/articles/proceedings/chi/365024/p349-wang/p349-wang.pdf

Zhai, Shumin, Hunter, Michael, Smith, Barton A. (2000): The Metropolis Keyboard -- An Exploration of Quantitative Techniques for Virtual Keyboard . In: Ackerman, Mark S., Edwards, Keith (eds.) Proceedings of the 13th annual ACM symposium on User interface software and technology November 06 - 08, 2000, San Diego, California, United States. pp. 119-128. https://acm.org/pubs/articles/proceedings/uist/354401/p119-zhai/p119-zhai.pdf

Zhai, Shumin, Morimoto, Carlos, Ihde, Steven, Center, Research (1999): Manual and Gaze Input Cascaded (MAGIC) Pointing. In: Altom, Mark W., Williams, Marian G. (eds.) Proceedings of the ACM CHI 99 Human Factors in Computing Systems Conference May 15-20, 1999, Pittsburgh, Pennsylvania. pp. 246-253. https://www.acm.org/pubs/articles/proceedings/chi/302979/p246-zhai/p246-zhai.pdf

Accot, Johnny, Zhai, Shumin (1999): Performance Evaluation of Input Devices in Trajectory-Based Tasks: An Application of The S. In: Altom, Mark W., Williams, Marian G. (eds.) Proceedings of the ACM CHI 99 Human Factors in Computing Systems Conference May 15-20, 1999, Pittsburgh, Pennsylvania. pp. 466-472. https://www.acm.org/pubs/articles/proceedings/chi/302979/p466-accot/p466-accot.pdf

Zhai, Shumin, Kandogan, Eser, Smith, Barton A., Selker, Ted (1999): In Search of the 'Magic Carpet': Design and Experimentation of a Bimanual 3D Navigation In. In J. Vis. Lang. Comput., 10 (1) pp. 3-17.

Zhai, Shumin, Milgram, Paul (1998): Quantifying Coordination in Multiple DOF Movement and its Application to Evaluating 6 DOF . In: Karat, Clare-Marie, Lund, Arnold, Coutaz, Joëlle, Karat, John (eds.) Proceedings of the ACM CHI 98 Human Factors in Computing Systems Conference April 18-23, 1998, Los Angeles, California. pp. 320-327. https://www.acm.org/pubs/articles/proceedings/chi/274644/p320-zhai/p320-zhai.pdf

Ark, Wendy, Dryer, D. Christopher, Selker, Ted, Zhai, Shumin (1998): Representation Matters: The Effect of 3D Objects and a Spatial Metaphor in a Graphical Use. In: Johnson, Hilary, Nigay, Laurence, Roast, C. R. (eds.) Proceedings of the Thirteenth Conference of the British Computer Society Human Computer Interaction Specialist Group - People and Computers XIII August 1-4, 1998, Sheffield, UK. pp. 209-219.

Leganchuk, Andrea, Zhai, Shumin, Buxton, Bill (1998): Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study. In ACM Transactions on Computer-Human Interaction, 5 (4) pp. 326-359. https://www.acm.org/pubs/articles/journals/tochi/1998-5-4/p326-leganchuk/p326-leganchuk.pdf

Accot, Johnny, Zhai, Shumin (1997): Beyond Fitts' Law: Models for Trajectory-Based HCI Tasks. In: Pemberton, Steven (eds.) Proceedings of the ACM CHI 97 Human Factors in Computing Systems Conference March 22-27, 1997, Atlanta, Georgia. pp. 295-302. https://www.acm.org/pubs/articles/proceedings/chi/258549/p295-accot/p295-accot.pdf

Salem, Chris, Zhai, Shumin (1997): An Isometric Tongue Pointing Device. In: Pemberton, Steven (eds.) Proceedings of the ACM CHI 97 Human Factors in Computing Systems Conference March 22-27, 1997, Atlanta, Georgia. pp. 538-539. https://www.acm.org/pubs/articles/proceedings/chi/258549/p538-salem/p538-salem.pdf

Zhai, Shumin, Milgram, Paul, Buxton, Bill (1996): The Influence of Muscle Groups on Performance of Multiple Degree-of-Freedom Input. In: Tauber, Michael J., Bellotti, Victoria, Jeffries, Robin, Mackinlay, Jock D., Nielsen, Jakob (eds.) Proceedings of the ACM CHI 96 Human Factors in Computing Systems Conference April 14-18, 1996, Vancouver, Canada. pp. 308-315. https://www.acm.org/sigchi/chi96/proceedings/papers/Zhai/sz_txt.htm

Zhai, Shumin, Buxton, Bill, Milgram, Paul (1996): The Partial-Occlusion Effect: Utilizing Semitransparency in 3D Human-Computer Interaction. In ACM Transactions on Computer-Human Interaction, 3 (3) pp. 254-284. https://www.acm.org/pubs/articles/journals/tochi/1996-3-3/p254-zhai/p254-zhai.pdf

Zhai, Shumin, Buxton, Bill, Milgram, Paul (1994): The "Silk Cursor": Investigating Transparency for 3D Target Acquisition. In: Adelson, Beth, Dumais, Susan, Olson, Judith S. (eds.) Proceedings of the ACM CHI 94 Human Factors in Computing Systems Conference April 24-28, 1994, Boston, Massachusetts. pp. 459-464. https://www.acm.org/pubs/articles/proceedings/chi/191666/p459-zhai/p459-zhai.pdf

Drascic, David, Grodski, Julius J., Milgram, Paul, Ruffo, Ken, Wong, Peter, Zhai, Shumin (1993): ARGOS: A Display System for Augmenting Reality. In: Ashlund, Stacey, Mullet, Kevin, Henderson, Austin, Hollnagel, Erik, White, Ted (eds.) Proceedings of the ACM CHI 93 Human Factors in Computing Systems Conference April 24-29, 1993, Amsterdam, The Netherlands. pp. 521. https://www.acm.org/pubs/articles/proceedings/chi/169059/p521-drascic/p521-drascic.pdf

Waterworth, John A., Chignell, Mark, Zhai, Shumin (1993): From Icons to Interface Models: Designing Hypermedia from the Bottom Up. In International Journal of Man-Machine Studies, 39 (3) pp. 453-472.

Fitzmaurice, George W., Zhai, Shumin, Chignell, Mark (1993): Virtual Reality for Palmtop Computers. In ACM Transactions on Information Systems, 11 (3) pp. 197-218. https://www.acm.org/pubs/articles/journals/tois/1993-11-3/p197-fitzmaurice/p197-fitzmaurice.pdf

Kristensson, Per-Ola, Zhai, Shumin (2004): SHARK{sup:2}: a large vocabulary shorthand writing system for pen-based computers. In: Proceedings of the 2004 ACM Symposium on User Interface Software and Technology , 2004, . pp. 43-52. https://doi.acm.org/10.1145/1029632.1029640

Yin, Min, Zhai, Shumin (2005): Dial and see: tackling the voice menu navigation problem with cross-device user experience. In: Proceedings of the 2005 ACM Symposium on User Interface Software and Technology , 2005, . pp. 187-190. https://doi.acm.org/10.1145/1095034.1095066

Yin, Min, Zhai, Shumin (2006): The benefits of augmenting telephone voice menu navigation with visual browsing and search. In: Proceedings of ACM CHI 2006 Conference on Human Factors in Computing Systems , 2006, . pp. 319-328. https://doi.acm.org/10.1145/1124772.1124821

Kristensson, Per-Ola, Zhai, Shumin (2007): Command strokes with and without preview: using pen gestures on keyboard for command selec. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems , 2007, . pp. 1137-1146. https://doi.acm.org/10.1145/1240624.1240797

Cao, Xiang, Zhai, Shumin (2007): Modeling human performance of pen stroke gestures. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems , 2007, . pp. 1495-1504. https://doi.acm.org/10.1145/1240624.1240850

Cockburn, Andy, Kristensson, Per-Ola, Alexander, Jason, Zhai, Shumin (2007): Hard lessons: effort-inducing interfaces benefit spatial learning. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems , 2007, . pp. 1571-1580. https://doi.acm.org/10.1145/1240624.1240863

Zhai, Shumin (1993): Investigation of Feel for 6DOF Inputs: Isometric and Elastic Rate Control for Manipulation. In: Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting , 1993, . pp. 323-327.

Zhai, Shumin, Milgram, Paul (1994): Asymmetrical Spatial Accuracy in 3D Tracking. In: Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting , 1994, . pp. 245-249.

Qvarfordt, Pernilla, Zhai, Shumin (2005): Conversing with the user based on eye-gaze patterns. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 221-230. https://doi.acm.org/10.1145/1054972.1055004

Wang, Jingtao, Zhai, Shumin, Canny, John (2006): Camera phone based motion sensing: interaction techniques, applications and performance st. In: Proceedings of the ACM Symposium on User Interface Software and Technology , 2006, . pp. 101-110. https://doi.acm.org/10.1145/1166253.1166270

Smith, B. A., Zhai, Shumin (2001): Optimised Virtual Keyboards with and without Alphabetical Ordering - A Novice User Study. In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 92-99.

Fels, D. I., Waalen, J. K., Zhai, Shumin, Weiss, P. (2001): Telepresence under Exceptional Circumstances: Enriching the Connection to School for Sick . In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 617-624.

Matlock, T., Campbell, Christopher S., Maglio, Paul P., Zhai, Shumin, Smith, B. (2001): Designing Feedback for an Attentive Office. In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 721-722.

Sallnas, Eva-Lotta, Zhai, Shumin (2003): Collaboration Meets Fitts\' Law: Passing Virtual Objects with and without Haptic Force Fee. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 97.

Ren, Xiangshi, Tamura, Kinya, Kong, Jing, Zhai, Shumin (2003): Candidate Display Styles in Japanese Input. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 868.

Qvarfordt, P., Beymer, D., Zhai, Shumin (2005): RealTourist - A Study of Augmenting Human-Human and Human-Computer Dialogue with Eye-Gaze . In: Proceedings of IFIP INTERACT05: Human-Computer Interaction , 2005, . pp. 767-780. https://www.springerlink.com/openurl.asp?genre=article&id=doi:10.1007/11555261_61

Zhai, Shumin, Kristensson, Per-Ola (2008): Interlaced QWERTY: accommodating ease of visual search and input flexibility in shape writ. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 593-596. https://doi.acm.org/10.1145/1357054.1357149

Kristensson, Per Ola, Zhai, Shumin (2008): Improving word-recognizers using an interactive lexicon with active and passive words. In: Proceedings of the 2008 International Conference on Intelligent User Interfaces , 2008, . pp. 353-356. https://doi.acm.org/10.1145/1378773.1378828

Lee, Seungyon, Zhai, Shumin (2009): The performance of touch screen soft buttons. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 309-318. https://doi.acm.org/10.1145/1518701.1518750

Appert, Caroline, Zhai, Shumin (2009): Using strokes as command shortcuts: cognitive benefits and toolkit support. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2289-2298. https://doi.acm.org/10.1145/1518701.1519052

Zhai, Shumin, Kristensson, Per Ola, Gong, Pengjun, Greiner, Michael, Peng, Shilei Allen, Liu, Liang Mico, Dunnigan, Anthony (2009): Shapewriter on the iPhone: from the laboratory to the real world. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2667-2670. https://doi.acm.org/10.1145/1520340.1520380

Maglio, Paul P., Matlock, Teenie, Campbell, Christopher S., Zhai, Shumin, Smith, Barton A. (2000): Gaze and Speech in Attentive User Interfaces. In: Tan, Tieniu, Shi, Yuanchun, Gao, Wen (eds.) Advances in Multimodal Interfaces - ICMI 2000 - Third International Conference October 14-16, 2000, Beijing, China. pp. 1-7. https://link.springer.de/link/service/series/0558/bibs/1948/19480001.htm

Zhai, Shumin (2008): On the ease and efficiency of human-computer interfaces. In: Räihä, Kari-Jouko, Duchowski, Andrew T. (eds.) ETRA 2008 - Proceedings of the Eye Tracking Research and Application Symposium March 26-28, 2008, Savannah, Georgia, USA. pp. 9-10. https://doi.acm.org/10.1145/1344471.1344473

Smith, Barton A., Ho, Janet, Ark, Wendy S., Zhai, Shumin (2000): Hand eye coordination patterns in target selection. In: Duchowski, Andrew T. (eds.) ETRA 2000 - Proceedings of the Eye Tracking Research and Application Symposium November 6-8, 2000, Palm Beach Gardens, Florida, USA. pp. 117-122. https://doi.acm.org/10.1145/355017.355041

Guiard, Yves, Beaudouin-Lafon, Michel, Bastin, Julien, Pasveer, Dennis, Zhai, Shumin (2004): View size and pointing difficulty in multi-scale navigation. In: Costabile, Maria Francesca (eds.) AVI 2004 - Proceedings of the working conference on Advanced visual interfaces May 25-28, 2004, Gallipoli, Italy. pp. 117-124. https://doi.acm.org/10.1145/989863.989881

Wang, Jingtao, Zhai, Shumin, Canny, John (2010): SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with m. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 15-24. https://doi.acm.org/10.1145/1753326.1753330

Bi, Xiaojun, Smith, Barton A., Zhai, Shumin (2010): Quasi-qwerty soft keyboard optimization. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 283-286. https://doi.acm.org/10.1145/1753326.1753367

Zhai, Shumin, Milgram, Paul (1993): Human Performance Evaluation of Manipulation Schemes in Virtual Environments. In: VR 1993 , 1993, . pp. 155-161.

Zhai, Shumin, Woltjer, Rogier (2003): Human Movement Performance in Relation to Path Constraint - The Law of Steering in Locomot. In: IEEE Virtual Reality Conference 2003 VR 2003 22-26 March, 2003, Los Angeles, CA, USA. pp. 149-. https://csdl.computer.org/comp/proceedings/vr/2003/1882/00/18820149abs.htm

Weaver, Kimberly A., Yang, Huahai, Zhai, Shumin, Pierce, Jeff (2011): Understanding information preview in mobile email processing. In: Proceedings of 13th Conference on Human-computer interaction with mobile devices and services , 2011, . pp. 303-312. https://dx.doi.org/10.1145/2037373.2037420

Bao, Patti, Pierce, Jeffrey, Whittaker, Stephen, Zhai, Shumin (2011): Smart phone use by non-mobile business users. In: Proceedings of 13th Conference on Human-computer interaction with mobile devices and services , 2011, . pp. 445-454. https://dx.doi.org/10.1145/2037373.2037440

Azenkot, Shiri, Zhai, Shumin (2012): Touch behavior with different postures on soft smartphone keyboards. In: Proceedings of the 14th Conference on Human-computer interaction with mobile devices and services , 2012, . pp. 251-260. https://dx.doi.org/10.1145/2371574.2371612

Bi, Xiaojun, Chelba, Ciprian, Ouyang, Tom, Partridge, Kurt, Zhai, Shumin (2012): Bimanual gesture keyboard. In: Proceedings of the 2012 ACM Symposium on User Interface Software and Technology , 2012, . pp. 137-146. https://dx.doi.org/10.1145/2380116.2380136

New to UX Design? We're Giving You a Free eBook!

The Basics of User Experience Design

Download our free ebook “The Basics of User Experience Design” to learn about core concepts of UX design.

In 9 chapters, we’ll cover: conducting user interviews, design thinking, interaction design, mobile UX design, usability, UX research, and many more!

A valid email address is required.
315,385 designers enjoy our newsletter—sure you don’t want to receive it?

New to UX Design? We're Giving You a Free eBook!

The Basics of User Experience Design

Download our free ebook “The Basics of User Experience Design” to learn about core concepts of UX design.

In 9 chapters, we’ll cover: conducting user interviews, design thinking, interaction design, mobile UX design, usability, UX research, and many more!

A valid email address is required.
315,385 designers enjoy our newsletter—sure you don’t want to receive it?