
Author: Robert J. K. Jacob
Ph.D
Robert Jacob is a Professor of Computer Science at Tufts University, where his research interests are new interaction modes and techniques and user interface software; his current work focuses on adaptive brain-computer interfaces. He was also a visiting professor at the Universite Paris-Sud and at the MIT Media Laboratory. Before coming to Tufts, he was in the Human-Computer Interaction Lab at the Naval Research Laboratory. He received his Ph.D. from Johns Hopkins University, and he is a member of the editorial board of Human-Computer Interaction and the ACM Transactions on Computer-Human Interaction. He was Papers Co-Chair of the CHI 2001 conference, Co-Chair of UIST 2007 and TEI 2010, and Vice-President of ACM SIGCHI. He was elected to the ACM CHI Academy in 2007, an honorary group of the principal leaders of the field of HCI, whose efforts have shaped the discipline and industry, and have led research and innovation in human-computer interaction.
Publications
Co-authors
Productive Colleagues
- Albrecht Schmidt
- Hiroshi Ishii
- Brad A. Myers
- 107
- 111
- 154
Publications
Shaer, Orit, Jacob, Robert J. K. (2009): A specification paradigm for the design and implementation of tangible user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 20. https://dl.acm.org/doi/10.1145/1614390.1614395
Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2009): Introduction to the special issue on UIDL for next-generation user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 16. https://dl.acm.org/doi/10.1145/1614390.1614391
Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (3) pp. 10. https://dl.acm.org/doi/10.1145/1453152.1453153
Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): TEI goes on: Tangible and Embedded Interaction. In IEEE Pervasive Computing, 7 (2) pp. 91-96. https://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27
Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (4) pp. 14. https://dl.acm.org/doi/10.1145/1460355.1460356
Hong, Dongpyo, Hollerer, Tobias, Haller, Michael, Takemura, Haruo, Cheok, Adrian David, Kim, Gerard Jounghyun, Billinghurst, Mark, Woo, Woontack, Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): Advances in Tangible Interaction and Ubiquitous Virtual Reality. In IEEE Pervasive Computing, 7 (2) pp. 90-96. https://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27
Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael, Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2007): CHI2006: what is the next generation of human-computer interaction?. In Interactions, 14 (3) pp. 53-58. https://dl.acm.org/doi/10.1145/1242421.1242459
Shaer, Orit, Leland, Nancy, Calvillo-Gamez, Eduardo H., Jacob, Robert J. K. (2004): The TAC paradigm: specifying tangible user interfaces. In Personal and Ubiquitous Computing, 8 (5) pp. 359-369. https://dx.doi.org/10.1007/s00779-004-0298-3
Jacob, Robert J. K., Ishii, Hiroshi, Pangaro, Gian, Patten, James (2002): A tangible interface for organizing information using a grid. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 339-346.
Jacob, Robert J. K. (2001): Elements of next-generation non-WIMP user interfaces. In: Graphics Interface 2001 June 7-9, 2001, Ottawa, Ontario, Canada. pp. 235-235.
Tanriverdi, Vildan, Jacob, Robert J. K. (2000): Interacting with Eye Movements in Virtual Environments. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 265-272. https://www.acm.org/pubs/articles/proceedings/chi/332040/p265-tanriverdi/p265-tanriverdi.pdf
Sibert, Linda E., Jacob, Robert J. K. (2000): Evaluation of Eye Gaze Interaction. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 281-288. https://www.acm.org/pubs/articles/proceedings/chi/332040/p281-sibert/p281-sibert.pdf
Jacob, Robert J. K., Deligiannidis, Leonidas, Morrison, Stephen (1999): A Software Model and Specification Language for Non-WIMP User Interfaces. In ACM Computing Surveys (CSUR), 6 (1) pp. 1-46. https://www.acm.org/pubs/articles/journals/tochi/1999-6-1/p1-jacob/p1-jacob.pdf
Jacob, Robert J. K., Feiner, Steven K., Foley, James D., Mackinlay, Jock D., Olsen Jr, Dan R. (1997): UIST'007: Where Will We Be Ten Years From Now?. In: Robertson, George G., Schmandt, Chris (eds.) Proceedings of the 10th annual ACM symposium on User interface software and technology October 14 - 17, 1997, Banff, Alberta, Canada. pp. 115-118. https://www.acm.org/pubs/articles/proceedings/uist/263407/p115-jacob/p115-jacob.pdf
Jacob, Robert J. K. (1996): Human-Computer Interaction: Input Devices. In ACM Computing Surveys, 28 (0) pp. 177-179.
Hix, Deborah, Templeman, James N., Jacob, Robert J. K. (1995): Pre-Screen Projection: From Concept to Testing of a New Interaction Technique. In: Katz, Irvin R., Mack, Robert L., Marks, Linn, Rosson, Mary Beth, Nielsen, Jakob (eds.) Proceedings of the ACM CHI 95 Human Factors in Computing Systems Conference May 7-11, 1995, Denver, Colorado. pp. 226-233. https://www.acm.org/sigchi/chi95/proceedings/papers/dh_bdy.htm
Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen Jr, M. Preston (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (1) pp. 3-26. https://www.acm.org/pubs/articles/journals/tochi/1994-1-1/p3-jacob/p3-jacob.pdf
Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen, M. P. (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (0) pp. 3-26.
Durbin, Jim, Jacob, Robert J. K., Hinckley, Ken (1994): Laying the Foundation for the Information Super Highway: Human-Computer Interaction Resear. In ACM SIGCHI Bulletin, 26 (4) pp. 56-58.
Jacob, Robert J. K., Leggett, John, Myers, Brad A., Pausch, Randy (1993): Interaction Styles and Input/Output Devices. In Behaviour and Information Technology, 12 (2) pp. 69-79.
Jacob, Robert J. K., Sibert, Linda E. (1992): The Perceptual Structure of Multidimensional Input Device Selection. In: Bauersfeld, Penny, Bennett, John, Lynch, Gene (eds.) Proceedings of the ACM CHI 92 Human Factors in Computing Systems Conference June 3-7, 1992, Monterey, California. pp. 211-218. https://www.acm.org/pubs/articles/proceedings/chi/142750/p211-jacob/p211-jacob.pdf
Jacob, Robert J. K. (1991): The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is Wha. In ACM Transactions on Information Systems, 9 (2) pp. 152-169. https://www.acm.org/pubs/articles/journals/tois/1991-9-2/p152-jacob/p152-jacob.pdf
Jacob, Robert J. K. (1990): What You Look At is What You Get: Eye Movement-Based Interaction Techniques. In: Carrasco, Jane, Whiteside, John (eds.) Proceedings of the ACM CHI 90 Human Factors in Computing Systems Conference , 1990, Seattle, Washington,USA. pp. 11-18.
Jacob, Robert J. K. (1986): A Specification Language for Direct-Manipulation User Interfaces. In ACM Transactions on Graphics, 5 (4) pp. 283-317.
Jacob, Robert J. K. (1985): A State Transition Diagram Language for Visual Programming. In IEEE Computer, 18 (8) pp. 51-59.
Jacob, Robert J. K. (1983): Executable Specifications for a Human-Computer Interface. In: Smith, Raoul N., Pew, Richard W., Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 28-34.
Jacob, Robert J. K. (1983): Using Formal Specifications in the Design of a Human-Computer Interface. In Communications of the ACM, 26 (4) pp. 259-264.
Jacob, Robert J. K. (1982): Using Formal Specifications in the Design of a Human-Computer Interface. In: Nichols, Jean A., Schneider, Michael L. (eds.) Proceedings of the SIGCHI conference on Human factors in computing systems March 15-17, 1982, Gaithersburg, Maryland, United States. pp. 315-321.
Calvillo-Gamez, Eduardo H., Leland, Nancy, Shaer, Orit, Jacob, Robert J. K. (2003): The TAC paradigm: unified conceptual framework to represent Tangible User Interfaces. In: Proceedings of the 2003 Latin American conference on Human-computer interaction , 2003, . pp. 9-15. https://portal.acm.org/citation.cfm?id=944519.944521
Jacob, Robert J. K. (2001): Open syntax: improving access for all users. In: Proceedings of the 2001 EC/NSF Workshop on Universal Accessibility of Ubiquitous Computing , 2001, . pp. 84-89. https://doi.acm.org/10.1145/564526.564549
Mynatt, Elizabeth D., Jacob, Robert J. K. (eds.) Proceedings of the 11th annual ACM symposium on User interface software and technology November 01 - 04, 1998, San Francisco, California, United States.
Solovey, Erin Treacy, Lalooses, Francine, Chauncey, Krysta, Weaver, Douglas, Parasi, Margarita, Scheutz, Matthias, Sassaroli, Angelo, Fantini, Sergio, Schermerhorn, Paul, Girouard, Audrey, Jacob, Robert J. K. (2011): Sensing cognitive multitasking for a brain-based adaptive user interface. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 383-392. https://dx.doi.org/10.1145/1978942.1978997
Christou, Georgios, Jacob, Robert J. K. (2003): Evaluating and Comparing Interaction Styles. In: Jorge, Joaquim A., Nunes, Nuno Jardim, Cunha, Joao Falcao e (eds.) DSV-IS 2003 - Interactive Systems. Design, Specification, and Verification, 10th International Workshop June 11-13, 2003, Funchal, Madeira Island, Portugal. pp. 406-409. https://link.springer.de/link/service/series/0558/bibs/2844/28440406.htm
Christou, Georgios, Jacob, Robert J. K., Cheng, Pericles Leng (2006): Modeling the Task - Leveraging Knowledge-in-the-Head at Design Time. In: Manolopoulos, Yannis, Filipe, Joaquim, Constantopoulos, Panos, Cordeiro, José (eds.) ICEIS 2006 - Proceedings of the Eighth International Conference on Enterprise Information Systems Databases and Information Systems Integration May 23-27, 2006, Paphos, Cyprus. pp. 131-134.
Girouard, Audrey, Solovey, Erin Treacy, Mandryk, Regan, Tan, Desney, Nacke, Lennart, Jacob, Robert J. K. (2010): Brain, body and bytes: psychophysiological user interaction. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 4433-4436. https://doi.acm.org/10.1145/1753846.1754167
Solovey, Erin Treacy, Girouard, Audrey, Chauncey, Krysta, Hirshfield, Leanne M., Sassaroli, Angelo, Zheng, Feng, Fantini, Sergio, Jacob, Robert J. K. (2009): Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. In: Proceedings of the ACM Symposium on User Interface Software and Technology , 2009, . pp. 157-166. https://doi.acm.org/10.1145/1622176.1622207
Deligiannidis, Leonidas, Jacob, Robert J. K. (2002): DLoVe: Using Constraints to Allow Parallel Processing in Multi-User Virtual Reality. In: VR 2002 , 2002, . pp. 49-. https://csdl.computer.org/comp/proceedings/vr/2002/1492/00/14920049abs.htm
Shaer, Orit, Jacob, Robert J. K. (2006): A Visual Language for Programming Reality-Based Interaction. In: VL-HCC 2006 - IEEE Symposium on Visual Languages and Human-Centric Computing 4-8 September, 2006, Brighton, UK. pp. 244-245. https://doi.ieeecomputersociety.org/10.1109/VLHCC.2006.6
Diep, Ellen, Jacob, Robert J. K. (2004): Visualizing E-mail with a Semantically Zoomable Interface. In: InfoVis 2004 - 10th IEEE Symposium on Information Visualization 10-12 October, 2004, Austin, TX, USA. https://doi.ieeecomputersociety.org/10.1109/INFOVIS.2004.75
Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael S., Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2008): Reality-based interaction: a framework for post-WIMP interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 201-210. https://doi.acm.org/10.1145/1357054.1357089
Jacob, Robert J. K. (1996): A Visual Language for Non-WIMP User Interfaces. In: VL 1996 , 1996, . pp. 231-238.
Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 279.
Chang, Angela, O\'Modhrain, Sile, Jacob, Robert J. K., Gunther, Eric, Ishii, Hiroshi (2002): ComTouch: design of a vibrotactile communication device. In: Proceedings of DIS02: Designing Interactive Systems: Processes, Practices, Methods, & Techniques , 2002, . pp. 312-320. https://doi.acm.org/10.1145/778712.778755
Shiaw, Horn-yeu, Jacob, Robert J. K., Crane, Gregory (2004): The 3D vase museum: a new approach to context in a digital library. In: JCDL04: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries , 2004, . pp. 125-134. https://doi.acm.org/10.1145/996350.996381
Bahna, Eric, Jacob, Robert J. K. (2005): Augmented reading: presenting additional information without penalty. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 1909-1912. https://doi.acm.org/10.1145/1056808.1057054
Zigelbaum, Jamie, Horn, Michael S., Shaer, Orit, Jacob, Robert J. K. (2007): The tangible video editor: collaborative video editing with active tokens. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 43-46. https://doi.acm.org/10.1145/1226969.1226978
Horn, Michael S., Jacob, Robert J. K. (2007): Designing tangible programming languages for classroom use. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 159-162. https://doi.acm.org/10.1145/1226969.1227003
Girouard, Audrey, Solovey, Erin Treacy, Hirshfield, Leanne M., Ecott, Stacey, Shaer, Orit, Jacob, Robert J. K. (2007): Smart Blocks: a tangible mathematical manipulative. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 183-186. https://doi.acm.org/10.1145/1226969.1227007
Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 1004?.
Tanriverdi, Vildan, Jacob, Robert J. K. (2001): VRID: a design model and methodology for developing virtual reality interfaces. In: VRST 2001 , 2001, . pp. 175-182. https://doi.acm.org/10.1145/505008.505042
Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA.
Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2008): User interface description languages for next generation user interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 3949-3952. https://doi.acm.org/10.1145/1358628.1358964
Horn, Michael S., Solovey, Erin Treacy, Jacob, Robert J. K. (2008): Tangible programming and informal science learning: making TUIs work for museums. In: Proceedings of ACM IDC08 Interaction Design and Children , 2008, . pp. 194-201. https://doi.acm.org/10.1145/1463689.1463756
Horn, Michael S., Solovey, Erin Treacy, Crouser, R. Jordan, Jacob, Robert J. K. (2009): Comparing the use of tangible and graphical programming languages for informal science edu. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 975-984. https://doi.acm.org/10.1145/1518701.1518851
Hirshfield, Leanne M., Solovey, Erin Treacy, Girouard, Audrey, Kebinger, James, Jacob, Robert J. K., Sassaroli, Angelo, Fantini, Sergio (2009): Brain measurement for usability testing and adaptive interfaces: an example of uncovering . In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2185-2194. https://doi.acm.org/10.1145/1518701.1519035
Bean, Alex, Siddiqi, Sabina, Chowdhury, Anila, Whited, Billy, Shaer, Orit, Jacob, Robert J. K. (2008): Marble track audio manipulator (MTAM): a tangible user interface for audio composition. In: Schmidt, Albrecht, Gellersen, Hans-Werner, Hoven, Elise van den, Mazalek, Ali, Holleis, Paul, Villar, Nicolas (eds.) TEI 2008 - Proceedings of the 2nd International Conference on Tangible and Embedded Interaction February 18-20, 2008, Bonn, Germany. pp. 27-30. https://doi.acm.org/10.1145/1347390.1347398
Jacob, Robert J. K. (2012): Engineering next generation interfaces: past and future. In: ACM SIGCHI 2012 Symposium on Engineering Interactive Computing Systems , 2012, . pp. 1-2. https://dx.doi.org/10.1145/2305484.2305486