Author: Robert J. K. Jacob

Ph.D

http://www.cs.tufts.edu/~jacob/

Robert Jacob is a Professor of Computer Science at Tufts University, where his research interests are new interaction modes and techniques and user interface software; his current work focuses on adaptive brain-computer interfaces. He was also a visiting professor at the Universite Paris-Sud and at the MIT Media Laboratory. Before coming to Tufts, he was in the Human-Computer Interaction Lab at the Naval Research Laboratory. He received his Ph.D. from Johns Hopkins University, and he is a member of the editorial board of Human-Computer Interaction and the ACM Transactions on Computer-Human Interaction. He was Papers Co-Chair of the CHI 2001 conference, Co-Chair of UIST 2007 and TEI 2010, and Vice-President of ACM SIGCHI. He was elected to the ACM CHI Academy in 2007, an honorary group of the principal leaders of the field of HCI, whose efforts have shaped the discipline and industry, and have led research and innovation in human-computer interaction.

Publications

Publication period start: 1982

Number of co-authors: 78

Co-authors

Number of publications with favourite co-authors

Audrey Girouard
Erin Treacy Solovey
Orit Shaer

Productive Colleagues

Most productive colleagues in number of publications

Albrecht Schmidt
Hiroshi Ishii
Brad A. Myers

Publications

Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2009): Introduction to the special issue on UIDL for next-generation user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 16. https://dl.acm.org/doi/10.1145/1614390.1614391

Shaer, Orit, Jacob, Robert J. K. (2009): A specification paradigm for the design and implementation of tangible user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 20. https://dl.acm.org/doi/10.1145/1614390.1614395

Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (3) pp. 10. https://dl.acm.org/doi/10.1145/1453152.1453153

Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (4) pp. 14. https://dl.acm.org/doi/10.1145/1460355.1460356

Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): TEI goes on: Tangible and Embedded Interaction. In IEEE Pervasive Computing, 7 (2) pp. 91-96. https://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27

Hong, Dongpyo, Hollerer, Tobias, Haller, Michael, Takemura, Haruo, Cheok, Adrian David, Kim, Gerard Jounghyun, Billinghurst, Mark, Woo, Woontack, Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): Advances in Tangible Interaction and Ubiquitous Virtual Reality. In IEEE Pervasive Computing, 7 (2) pp. 90-96. https://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27

Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael, Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2007): CHI2006: what is the next generation of human-computer interaction?. In Interactions, 14 (3) pp. 53-58. https://dl.acm.org/doi/10.1145/1242421.1242459

Shaer, Orit, Leland, Nancy, Calvillo-Gamez, Eduardo H., Jacob, Robert J. K. (2004): The TAC paradigm: specifying tangible user interfaces. In Personal and Ubiquitous Computing, 8 (5) pp. 359-369. https://dx.doi.org/10.1007/s00779-004-0298-3

Jacob, Robert J. K., Ishii, Hiroshi, Pangaro, Gian, Patten, James (2002): A tangible interface for organizing information using a grid. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 339-346.

Jacob, Robert J. K. (2001): Elements of next-generation non-WIMP user interfaces. In: Graphics Interface 2001 June 7-9, 2001, Ottawa, Ontario, Canada. pp. 235-235.

Tanriverdi, Vildan, Jacob, Robert J. K. (2000): Interacting with Eye Movements in Virtual Environments. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 265-272. https://www.acm.org/pubs/articles/proceedings/chi/332040/p265-tanriverdi/p265-tanriverdi.pdf

Sibert, Linda E., Jacob, Robert J. K. (2000): Evaluation of Eye Gaze Interaction. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 281-288. https://www.acm.org/pubs/articles/proceedings/chi/332040/p281-sibert/p281-sibert.pdf

Jacob, Robert J. K., Deligiannidis, Leonidas, Morrison, Stephen (1999): A Software Model and Specification Language for Non-WIMP User Interfaces. In ACM Computing Surveys (CSUR), 6 (1) pp. 1-46. https://www.acm.org/pubs/articles/journals/tochi/1999-6-1/p1-jacob/p1-jacob.pdf

Jacob, Robert J. K., Feiner, Steven K., Foley, James D., Mackinlay, Jock D., Olsen Jr, Dan R. (1997): UIST'007: Where Will We Be Ten Years From Now?. In: Robertson, George G., Schmandt, Chris (eds.) Proceedings of the 10th annual ACM symposium on User interface software and technology October 14 - 17, 1997, Banff, Alberta, Canada. pp. 115-118. https://www.acm.org/pubs/articles/proceedings/uist/263407/p115-jacob/p115-jacob.pdf

Jacob, Robert J. K. (1996): Human-Computer Interaction: Input Devices. In ACM Computing Surveys, 28 (0) pp. 177-179.

Hix, Deborah, Templeman, James N., Jacob, Robert J. K. (1995): Pre-Screen Projection: From Concept to Testing of a New Interaction Technique. In: Katz, Irvin R., Mack, Robert L., Marks, Linn, Rosson, Mary Beth, Nielsen, Jakob (eds.) Proceedings of the ACM CHI 95 Human Factors in Computing Systems Conference May 7-11, 1995, Denver, Colorado. pp. 226-233. https://www.acm.org/sigchi/chi95/proceedings/papers/dh_bdy.htm

Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen Jr, M. Preston (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (1) pp. 3-26. https://www.acm.org/pubs/articles/journals/tochi/1994-1-1/p3-jacob/p3-jacob.pdf

Durbin, Jim, Jacob, Robert J. K., Hinckley, Ken (1994): Laying the Foundation for the Information Super Highway: Human-Computer Interaction Resear. In ACM SIGCHI Bulletin, 26 (4) pp. 56-58.

Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen, M. P. (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (0) pp. 3-26.

Jacob, Robert J. K., Leggett, John, Myers, Brad A., Pausch, Randy (1993): Interaction Styles and Input/Output Devices. In Behaviour and Information Technology, 12 (2) pp. 69-79.

Jacob, Robert J. K., Sibert, Linda E. (1992): The Perceptual Structure of Multidimensional Input Device Selection. In: Bauersfeld, Penny, Bennett, John, Lynch, Gene (eds.) Proceedings of the ACM CHI 92 Human Factors in Computing Systems Conference June 3-7, 1992, Monterey, California. pp. 211-218. https://www.acm.org/pubs/articles/proceedings/chi/142750/p211-jacob/p211-jacob.pdf

Jacob, Robert J. K. (1991): The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is Wha. In ACM Transactions on Information Systems, 9 (2) pp. 152-169. https://www.acm.org/pubs/articles/journals/tois/1991-9-2/p152-jacob/p152-jacob.pdf

Jacob, Robert J. K. (1990): What You Look At is What You Get: Eye Movement-Based Interaction Techniques. In: Carrasco, Jane, Whiteside, John (eds.) Proceedings of the ACM CHI 90 Human Factors in Computing Systems Conference , 1990, Seattle, Washington,USA. pp. 11-18.

Jacob, Robert J. K. (1986): A Specification Language for Direct-Manipulation User Interfaces. In ACM Transactions on Graphics, 5 (4) pp. 283-317.

Jacob, Robert J. K. (1985): A State Transition Diagram Language for Visual Programming. In IEEE Computer, 18 (8) pp. 51-59.

Jacob, Robert J. K. (1983): Executable Specifications for a Human-Computer Interface. In: Smith, Raoul N., Pew, Richard W., Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 28-34.

Jacob, Robert J. K. (1983): Using Formal Specifications in the Design of a Human-Computer Interface. In Communications of the ACM, 26 (4) pp. 259-264.

Jacob, Robert J. K. (1982): Using Formal Specifications in the Design of a Human-Computer Interface. In: Nichols, Jean A., Schneider, Michael L. (eds.) Proceedings of the SIGCHI conference on Human factors in computing systems March 15-17, 1982, Gaithersburg, Maryland, United States. pp. 315-321.

Mynatt, Elizabeth D., Jacob, Robert J. K. (eds.) Proceedings of the 11th annual ACM symposium on User interface software and technology November 01 - 04, 1998, San Francisco, California, United States.

Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA.

Chang, Angela, O\'Modhrain, Sile, Jacob, Robert J. K., Gunther, Eric, Ishii, Hiroshi (2002): ComTouch: design of a vibrotactile communication device. In: Proceedings of DIS02: Designing Interactive Systems: Processes, Practices, Methods, & Techniques , 2002, . pp. 312-320. https://doi.acm.org/10.1145/778712.778755

Shiaw, Horn-yeu, Jacob, Robert J. K., Crane, Gregory (2004): The 3D vase museum: a new approach to context in a digital library. In: JCDL04: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries , 2004, . pp. 125-134. https://doi.acm.org/10.1145/996350.996381

Bahna, Eric, Jacob, Robert J. K. (2005): Augmented reading: presenting additional information without penalty. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 1909-1912. https://doi.acm.org/10.1145/1056808.1057054

Zigelbaum, Jamie, Horn, Michael S., Shaer, Orit, Jacob, Robert J. K. (2007): The tangible video editor: collaborative video editing with active tokens. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 43-46. https://doi.acm.org/10.1145/1226969.1226978

Horn, Michael S., Jacob, Robert J. K. (2007): Designing tangible programming languages for classroom use. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 159-162. https://doi.acm.org/10.1145/1226969.1227003

Girouard, Audrey, Solovey, Erin Treacy, Hirshfield, Leanne M., Ecott, Stacey, Shaer, Orit, Jacob, Robert J. K. (2007): Smart Blocks: a tangible mathematical manipulative. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 183-186. https://doi.acm.org/10.1145/1226969.1227007

Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 279.

Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael S., Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2008): Reality-based interaction: a framework for post-WIMP interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 201-210. https://doi.acm.org/10.1145/1357054.1357089

Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2008): User interface description languages for next generation user interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 3949-3952. https://doi.acm.org/10.1145/1358628.1358964

Horn, Michael S., Solovey, Erin Treacy, Jacob, Robert J. K. (2008): Tangible programming and informal science learning: making TUIs work for museums. In: Proceedings of ACM IDC08 Interaction Design and Children , 2008, . pp. 194-201. https://doi.acm.org/10.1145/1463689.1463756

Horn, Michael S., Solovey, Erin Treacy, Crouser, R. Jordan, Jacob, Robert J. K. (2009): Comparing the use of tangible and graphical programming languages for informal science edu. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 975-984. https://doi.acm.org/10.1145/1518701.1518851

Hirshfield, Leanne M., Solovey, Erin Treacy, Girouard, Audrey, Kebinger, James, Jacob, Robert J. K., Sassaroli, Angelo, Fantini, Sergio (2009): Brain measurement for usability testing and adaptive interfaces: an example of uncovering . In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2185-2194. https://doi.acm.org/10.1145/1518701.1519035

Bean, Alex, Siddiqi, Sabina, Chowdhury, Anila, Whited, Billy, Shaer, Orit, Jacob, Robert J. K. (2008): Marble track audio manipulator (MTAM): a tangible user interface for audio composition. In: Schmidt, Albrecht, Gellersen, Hans-Werner, Hoven, Elise van den, Mazalek, Ali, Holleis, Paul, Villar, Nicolas (eds.) TEI 2008 - Proceedings of the 2nd International Conference on Tangible and Embedded Interaction February 18-20, 2008, Bonn, Germany. pp. 27-30. https://doi.acm.org/10.1145/1347390.1347398

Tanriverdi, Vildan, Jacob, Robert J. K. (2001): VRID: a design model and methodology for developing virtual reality interfaces. In: VRST 2001 , 2001, . pp. 175-182. https://doi.acm.org/10.1145/505008.505042

Jacob, Robert J. K. (1996): A Visual Language for Non-WIMP User Interfaces. In: VL 1996 , 1996, . pp. 231-238.

Shaer, Orit, Jacob, Robert J. K. (2006): A Visual Language for Programming Reality-Based Interaction. In: VL-HCC 2006 - IEEE Symposium on Visual Languages and Human-Centric Computing 4-8 September, 2006, Brighton, UK. pp. 244-245. https://doi.ieeecomputersociety.org/10.1109/VLHCC.2006.6

Diep, Ellen, Jacob, Robert J. K. (2004): Visualizing E-mail with a Semantically Zoomable Interface. In: InfoVis 2004 - 10th IEEE Symposium on Information Visualization 10-12 October, 2004, Austin, TX, USA. https://doi.ieeecomputersociety.org/10.1109/INFOVIS.2004.75

Calvillo-Gamez, Eduardo H., Leland, Nancy, Shaer, Orit, Jacob, Robert J. K. (2003): The TAC paradigm: unified conceptual framework to represent Tangible User Interfaces. In: Proceedings of the 2003 Latin American conference on Human-computer interaction , 2003, . pp. 9-15. https://portal.acm.org/citation.cfm?id=944519.944521

Jacob, Robert J. K. (2001): Open syntax: improving access for all users. In: Proceedings of the 2001 EC/NSF Workshop on Universal Accessibility of Ubiquitous Computing , 2001, . pp. 84-89. https://doi.acm.org/10.1145/564526.564549

Christou, Georgios, Jacob, Robert J. K. (2003): Evaluating and Comparing Interaction Styles. In: Jorge, Joaquim A., Nunes, Nuno Jardim, Cunha, Joao Falcao e (eds.) DSV-IS 2003 - Interactive Systems. Design, Specification, and Verification, 10th International Workshop June 11-13, 2003, Funchal, Madeira Island, Portugal. pp. 406-409. https://link.springer.de/link/service/series/0558/bibs/2844/28440406.htm

Christou, Georgios, Jacob, Robert J. K., Cheng, Pericles Leng (2006): Modeling the Task - Leveraging Knowledge-in-the-Head at Design Time. In: Manolopoulos, Yannis, Filipe, Joaquim, Constantopoulos, Panos, Cordeiro, José (eds.) ICEIS 2006 - Proceedings of the Eighth International Conference on Enterprise Information Systems Databases and Information Systems Integration May 23-27, 2006, Paphos, Cyprus. pp. 131-134.

Girouard, Audrey, Solovey, Erin Treacy, Mandryk, Regan, Tan, Desney, Nacke, Lennart, Jacob, Robert J. K. (2010): Brain, body and bytes: psychophysiological user interaction. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 4433-4436. https://doi.acm.org/10.1145/1753846.1754167

Solovey, Erin Treacy, Girouard, Audrey, Chauncey, Krysta, Hirshfield, Leanne M., Sassaroli, Angelo, Zheng, Feng, Fantini, Sergio, Jacob, Robert J. K. (2009): Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. In: Proceedings of the ACM Symposium on User Interface Software and Technology , 2009, . pp. 157-166. https://doi.acm.org/10.1145/1622176.1622207

Deligiannidis, Leonidas, Jacob, Robert J. K. (2002): DLoVe: Using Constraints to Allow Parallel Processing in Multi-User Virtual Reality. In: VR 2002 , 2002, . pp. 49-. https://csdl.computer.org/comp/proceedings/vr/2002/1492/00/14920049abs.htm

Solovey, Erin Treacy, Lalooses, Francine, Chauncey, Krysta, Weaver, Douglas, Parasi, Margarita, Scheutz, Matthias, Sassaroli, Angelo, Fantini, Sergio, Schermerhorn, Paul, Girouard, Audrey, Jacob, Robert J. K. (2011): Sensing cognitive multitasking for a brain-based adaptive user interface. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 383-392. https://dx.doi.org/10.1145/1978942.1978997

Jacob, Robert J. K. (2012): Engineering next generation interfaces: past and future. In: ACM SIGCHI 2012 Symposium on Engineering Interactive Computing Systems , 2012, . pp. 1-2. https://dx.doi.org/10.1145/2305484.2305486