Personal Homepage

http://www.cs.tufts.edu/~jacob/

Employer

Tufts University (http://www.tufts.edu/)

Email

jacob@cs.tufts.edu

Robert Jacob is a Professor of Computer Science at Tufts University, where his research interests are new interaction modes and techniques and user interface software; his current work focuses on adaptive brain-computer interfaces. He was also a visiting professor at the Universite Paris-Sud and at the MIT Media Laboratory. Before coming to Tufts, he was in the Human-Computer Interaction Lab at the Naval Research Laboratory. He received his Ph.D. from Johns Hopkins University, and he is a member of the editorial board of Human-Computer Interaction and the ACM Transactions on Computer-Human Interaction. He was Papers Co-Chair of the CHI 2001 conference, Co-Chair of UIST 2007 and TEI 2010, and Vice-President of ACM SIGCHI. He was elected to the ACM CHI Academy in 2007, an honorary group of the principal leaders of the field of HCI, whose efforts have shaped the discipline and industry, and have led research and innovation in human-computer interaction.

Publication period start

1982

Publication period end

2012

Number of co-authors

78

Audrey Girouard

7

Erin Treacy Solovey

9

Orit Shaer

11

Albrecht Schmidt

107

Hiroshi Ishii

111

Brad A. Myers

154

Jacob, Robert J. K. (2012): Engineering next generation interfaces: past and future. In: ACM SIGCHI 2012 Symposium on Engineering Interactive Computing Systems , 2012, . pp. 1-2. http://dx.doi.org/10.1145/2305484.2305486

Solovey, Erin Treacy, Lalooses, Francine, Chauncey, Krysta, Weaver, Douglas, Parasi, Margarita, Scheutz, Matthias, Sassaroli, Angelo, Fantini, Sergio, Schermerhorn, Paul, Girouard, Audrey, Jacob, Robert J. K. (2011): Sensing cognitive multitasking for a brain-based adaptive user interface. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 383-392. http://dx.doi.org/10.1145/1978942.1978997

Girouard, Audrey, Solovey, Erin Treacy, Mandryk, Regan, Tan, Desney, Nacke, Lennart, Jacob, Robert J. K. (2010): Brain, body and bytes: psychophysiological user interaction. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 4433-4436. http://doi.acm.org/10.1145/1753846.1754167

Shaer, Orit, Jacob, Robert J. K. (2009): A specification paradigm for the design and implementation of tangible user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 20. http://doi.acm.org/10.1145/1614390.1614395

Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2009): Introduction to the special issue on UIDL for next-generation user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 16. http://doi.acm.org/10.1145/1614390.1614391

Solovey, Erin Treacy, Girouard, Audrey, Chauncey, Krysta, Hirshfield, Leanne M., Sassaroli, Angelo, Zheng, Feng, Fantini, Sergio, Jacob, Robert J. K. (2009): Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. In: Proceedings of the ACM Symposium on User Interface Software and Technology , 2009, . pp. 157-166. http://doi.acm.org/10.1145/1622176.1622207

Hirshfield, Leanne M., Solovey, Erin Treacy, Girouard, Audrey, Kebinger, James, Jacob, Robert J. K., Sassaroli, Angelo, Fantini, Sergio (2009): Brain measurement for usability testing and adaptive interfaces: an example of uncovering . In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2185-2194. http://doi.acm.org/10.1145/1518701.1519035

Horn, Michael S., Solovey, Erin Treacy, Crouser, R. Jordan, Jacob, Robert J. K. (2009): Comparing the use of tangible and graphical programming languages for informal science edu. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 975-984. http://doi.acm.org/10.1145/1518701.1518851

Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2008): User interface description languages for next generation user interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 3949-3952. http://doi.acm.org/10.1145/1358628.1358964

Hong, Dongpyo, Hollerer, Tobias, Haller, Michael, Takemura, Haruo, Cheok, Adrian David, Kim, Gerard Jounghyun, Billinghurst, Mark, Woo, Woontack, Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): Advances in Tangible Interaction and Ubiquitous Virtual Reality. In IEEE Pervasive Computing, 7 (2) pp. 90-96. http://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27

Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): TEI goes on: Tangible and Embedded Interaction. In IEEE Pervasive Computing, 7 (2) pp. 91-96. http://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27

Bean, Alex, Siddiqi, Sabina, Chowdhury, Anila, Whited, Billy, Shaer, Orit, Jacob, Robert J. K. (2008): Marble track audio manipulator (MTAM): a tangible user interface for audio composition. In: Schmidt, Albrecht, Gellersen, Hans-Werner, Hoven, Elise van den, Mazalek, Ali, Holleis, Paul, Villar, Nicolas (eds.) TEI 2008 - Proceedings of the 2nd International Conference on Tangible and Embedded Interaction February 18-20, 2008, Bonn, Germany. pp. 27-30. http://doi.acm.org/10.1145/1347390.1347398

Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (4) pp. 14. http://doi.acm.org/10.1145/1460355.1460356

Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (3) pp. 10. http://doi.acm.org/10.1145/1453152.1453153

Horn, Michael S., Solovey, Erin Treacy, Jacob, Robert J. K. (2008): Tangible programming and informal science learning: making TUIs work for museums. In: Proceedings of ACM IDC08 Interaction Design and Children , 2008, . pp. 194-201. http://doi.acm.org/10.1145/1463689.1463756

Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael S., Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2008): Reality-based interaction: a framework for post-WIMP interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 201-210. http://doi.acm.org/10.1145/1357054.1357089

Horn, Michael S., Jacob, Robert J. K. (2007): Designing tangible programming languages for classroom use. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 159-162. http://doi.acm.org/10.1145/1226969.1227003

Zigelbaum, Jamie, Horn, Michael S., Shaer, Orit, Jacob, Robert J. K. (2007): The tangible video editor: collaborative video editing with active tokens. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 43-46. http://doi.acm.org/10.1145/1226969.1226978

Girouard, Audrey, Solovey, Erin Treacy, Hirshfield, Leanne M., Ecott, Stacey, Shaer, Orit, Jacob, Robert J. K. (2007): Smart Blocks: a tangible mathematical manipulative. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 183-186. http://doi.acm.org/10.1145/1226969.1227007

Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael, Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2007): CHI2006: what is the next generation of human-computer interaction?. In Interactions, 14 (3) pp. 53-58. http://doi.acm.org/10.1145/1242421.1242459

Shaer, Orit, Jacob, Robert J. K. (2006): A Visual Language for Programming Reality-Based Interaction. In: VL-HCC 2006 - IEEE Symposium on Visual Languages and Human-Centric Computing 4-8 September, 2006, Brighton, UK. pp. 244-245. http://doi.ieeecomputersociety.org/10.1109/VLHCC.2006.6

Christou, Georgios, Jacob, Robert J. K., Cheng, Pericles Leng (2006): Modeling the Task - Leveraging Knowledge-in-the-Head at Design Time. In: Manolopoulos, Yannis, Filipe, Joaquim, Constantopoulos, Panos, Cordeiro, José (eds.) ICEIS 2006 - Proceedings of the Eighth International Conference on Enterprise Information Systems Databases and Information Systems Integration May 23-27, 2006, Paphos, Cyprus. pp. 131-134.

Bahna, Eric, Jacob, Robert J. K. (2005): Augmented reading: presenting additional information without penalty. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 1909-1912. http://doi.acm.org/10.1145/1056808.1057054

Shaer, Orit, Leland, Nancy, Calvillo-Gamez, Eduardo H., Jacob, Robert J. K. (2004): The TAC paradigm: specifying tangible user interfaces. In Personal and Ubiquitous Computing, 8 (5) pp. 359-369. http://dx.doi.org/10.1007/s00779-004-0298-3

Shiaw, Horn-yeu, Jacob, Robert J. K., Crane, Gregory (2004): The 3D vase museum: a new approach to context in a digital library. In: JCDL04: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries , 2004, . pp. 125-134. http://doi.acm.org/10.1145/996350.996381

Diep, Ellen, Jacob, Robert J. K. (2004): Visualizing E-mail with a Semantically Zoomable Interface. In: InfoVis 2004 - 10th IEEE Symposium on Information Visualization 10-12 October, 2004, Austin, TX, USA. http://doi.ieeecomputersociety.org/10.1109/INFOVIS.2004.75

Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 279.

Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 1004?.

Christou, Georgios, Jacob, Robert J. K. (2003): Evaluating and Comparing Interaction Styles. In: Jorge, Joaquim A., Nunes, Nuno Jardim, Cunha, Joao Falcao e (eds.) DSV-IS 2003 - Interactive Systems. Design, Specification, and Verification, 10th International Workshop June 11-13, 2003, Funchal, Madeira Island, Portugal. pp. 406-409. http://link.springer.de/link/service/series/0558/bibs/2844/28440406.htm

Calvillo-Gamez, Eduardo H., Leland, Nancy, Shaer, Orit, Jacob, Robert J. K. (2003): The TAC paradigm: unified conceptual framework to represent Tangible User Interfaces. In: Proceedings of the 2003 Latin American conference on Human-computer interaction , 2003, . pp. 9-15. http://portal.acm.org/citation.cfm?id=944519.944521

Jacob, Robert J. K., Ishii, Hiroshi, Pangaro, Gian, Patten, James (2002): A tangible interface for organizing information using a grid. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 339-346.

Deligiannidis, Leonidas, Jacob, Robert J. K. (2002): DLoVe: Using Constraints to Allow Parallel Processing in Multi-User Virtual Reality. In: VR 2002 , 2002, . pp. 49-. http://csdl.computer.org/comp/proceedings/vr/2002/1492/00/14920049abs.htm

Chang, Angela, O\'Modhrain, Sile, Jacob, Robert J. K., Gunther, Eric, Ishii, Hiroshi (2002): ComTouch: design of a vibrotactile communication device. In: Proceedings of DIS02: Designing Interactive Systems: Processes, Practices, Methods, & Techniques , 2002, . pp. 312-320. http://doi.acm.org/10.1145/778712.778755

Jacob, Robert J. K. (2001): Open syntax: improving access for all users. In: Proceedings of the 2001 EC/NSF Workshop on Universal Accessibility of Ubiquitous Computing , 2001, . pp. 84-89. http://doi.acm.org/10.1145/564526.564549

Tanriverdi, Vildan, Jacob, Robert J. K. (2001): VRID: a design model and methodology for developing virtual reality interfaces. In: VRST 2001 , 2001, . pp. 175-182. http://doi.acm.org/10.1145/505008.505042

Jacob, Robert J. K. (2001): Elements of next-generation non-WIMP user interfaces. In: Graphics Interface 2001 June 7-9, 2001, Ottawa, Ontario, Canada. pp. 235-235.

Sibert, Linda E., Jacob, Robert J. K. (2000): Evaluation of Eye Gaze Interaction. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 281-288. http://www.acm.org/pubs/articles/proceedings/chi/332040/p281-sibert/p281-sibert.pdf

Tanriverdi, Vildan, Jacob, Robert J. K. (2000): Interacting with Eye Movements in Virtual Environments. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 265-272. http://www.acm.org/pubs/articles/proceedings/chi/332040/p265-tanriverdi/p265-tanriverdi.pdf

Jacob, Robert J. K., Deligiannidis, Leonidas, Morrison, Stephen (1999): A Software Model and Specification Language for Non-WIMP User Interfaces. In ACM Computing Surveys (CSUR), 6 (1) pp. 1-46. http://www.acm.org/pubs/articles/journals/tochi/1999-6-1/p1-jacob/p1-jacob.pdf

Jacob, Robert J. K., Feiner, Steven K., Foley, James D., Mackinlay, Jock D., Olsen Jr, Dan R. (1997): UIST'007: Where Will We Be Ten Years From Now?. In: Robertson, George G., Schmandt, Chris (eds.) Proceedings of the 10th annual ACM symposium on User interface software and technology October 14 - 17, 1997, Banff, Alberta, Canada. pp. 115-118. http://www.acm.org/pubs/articles/proceedings/uist/263407/p115-jacob/p115-jacob.pdf

Jacob, Robert J. K. (1996): A Visual Language for Non-WIMP User Interfaces. In: VL 1996 , 1996, . pp. 231-238.

Jacob, Robert J. K. (1996): Human-Computer Interaction: Input Devices. In ACM Computing Surveys, 28 (0) pp. 177-179.

Hix, Deborah, Templeman, James N., Jacob, Robert J. K. (1995): Pre-Screen Projection: From Concept to Testing of a New Interaction Technique. In: Katz, Irvin R., Mack, Robert L., Marks, Linn, Rosson, Mary Beth, Nielsen, Jakob (eds.) Proceedings of the ACM CHI 95 Human Factors in Computing Systems Conference May 7-11, 1995, Denver, Colorado. pp. 226-233. http://www.acm.org/sigchi/chi95/proceedings/papers/dh_bdy.htm

Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen Jr, M. Preston (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (1) pp. 3-26. http://www.acm.org/pubs/articles/journals/tochi/1994-1-1/p3-jacob/p3-jacob.pdf

Durbin, Jim, Jacob, Robert J. K., Hinckley, Ken (1994): Laying the Foundation for the Information Super Highway: Human-Computer Interaction Resear. In ACM SIGCHI Bulletin, 26 (4) pp. 56-58.

Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen, M. P. (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (0) pp. 3-26.

Jacob, Robert J. K., Leggett, John, Myers, Brad A., Pausch, Randy (1993): Interaction Styles and Input/Output Devices. In Behaviour and Information Technology, 12 (2) pp. 69-79.

Jacob, Robert J. K., Sibert, Linda E. (1992): The Perceptual Structure of Multidimensional Input Device Selection. In: Bauersfeld, Penny, Bennett, John, Lynch, Gene (eds.) Proceedings of the ACM CHI 92 Human Factors in Computing Systems Conference June 3-7, 1992, Monterey, California. pp. 211-218. http://www.acm.org/pubs/articles/proceedings/chi/142750/p211-jacob/p211-jacob.pdf

Jacob, Robert J. K. (1991): The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is Wha. In ACM Transactions on Information Systems, 9 (2) pp. 152-169. http://www.acm.org/pubs/articles/journals/tois/1991-9-2/p152-jacob/p152-jacob.pdf

Jacob, Robert J. K. (1990): What You Look At is What You Get: Eye Movement-Based Interaction Techniques. In: Carrasco, Jane, Whiteside, John (eds.) Proceedings of the ACM CHI 90 Human Factors in Computing Systems Conference , 1990, Seattle, Washington,USA. pp. 11-18.

Jacob, Robert J. K. (1986): A Specification Language for Direct-Manipulation User Interfaces. In ACM Transactions on Graphics, 5 (4) pp. 283-317.

Jacob, Robert J. K. (1985): A State Transition Diagram Language for Visual Programming. In IEEE Computer, 18 (8) pp. 51-59.

Jacob, Robert J. K. (1983): Executable Specifications for a Human-Computer Interface. In: Smith, Raoul N., Pew, Richard W., Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 28-34.

Jacob, Robert J. K. (1983): Using Formal Specifications in the Design of a Human-Computer Interface. In Communications of the ACM, 26 (4) pp. 259-264.

Jacob, Robert J. K. (1982): Using Formal Specifications in the Design of a Human-Computer Interface. In: Nichols, Jean A., Schneider, Michael L. (eds.) Proceedings of the SIGCHI conference on Human factors in computing systems March 15-17, 1982, Gaithersburg, Maryland, United States. pp. 315-321.

Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA.

Mynatt, Elizabeth D., Jacob, Robert J. K. (eds.) Proceedings of the 11th annual ACM symposium on User interface software and technology November 01 - 04, 1998, San Francisco, California, United States.