Publication statistics
Pub. period:1996-2012
Pub. count:40
Number of co-authors:23
Co-authors
Number of publications with 3 favourite co-authors:
James Fung:8Ryan E. Janzen:4Corey Manders:2 Productive colleagues
Steve Mann's 3 most productive colleagues in number of publications:
Thad Starner:48Rosalind W. Picard:44Alex Pentland:43 
Design can be art. Design can be aesthetics. Design is so simple, that's why it is so complicated.
-- Paul Rand, 1997
Featured chapter
Read the fascinating history of Wearable Computing, told by its father, Steve Mann
Read Steve's chapter !
Steve Mann
Personal Homepage:
http://www.eecg.utoronto.ca/~mann/Steven Mann is a tenured professor at the Department of Electrical and Computer Engineering at the University of Toronto. Mann holds degrees from the Massachusetts Institute of Technology (PhD in Media Arts and Sciences '97) and McMaster University, where he was also inducted into the McMaster University Alumni Hall of Fame, Alumni Gallery, 2004, in recognition of his career as an inventor and teacher. While at MIT he was one of the founding members of the Wearable Computers group in the Media Lab. In 2004 he was named the recipient of the 2004 Leonardo Award for Excellence for his article "Existential Technology," published in Leonardo 36:1.
Image not found.
Publications by Steve Mann (bibliography)
Mann, Steve (2012). [Title to be defined - in press]. Retrieved 19 May 2013 from [URL to be defined - in press]
Mann, Steve and Janzen, Ryan (2012): Hydraulikos: ice, water, and steam as user-interfaces. In: Proceedings of the 6th International Conference on Tangible and Embedded Interaction 2012. pp. 27-28.
In 2001 the term "Natural User Interface" (NUI) was coined to denote the use of wearable computing or of physical matter (solids, liquids, and gases) as direct user interfaces for metaphor-free computing ["Intelligent Image Processing", S. Mann, John Wiley&Sons, Inc., 2001]. An example of NUI is the idioscope, a highly expressive musical instrument based on continuous ("undigital") scratch input ["Natural Interfaces for Musical Expression...", S. Mann, in Proc. NIME 2007, Jun6-10, New York, NY, USA.]. Human beings are "cyborgs" in the sense that we usually experience nature indirectly, through technologies like shoes, clothing, or smartphones. In fact we're often forbidden from interacting directly with the world around us, e.g. simply removing our shoes to feel the earth beneath our feet is likely to have us stopped by police or security guards. Natural User-Interfaces challenge this layer of indirection, and use direct physical contact with multisensory primordial input devices such as solids, liquids, and gases. H2O (dihydrogen monoxide) is the only chemical substance that we commonly and directly experience in all three of these states-of-matter. Thus H2O is a natural choice for a natural user-interface. H2O is not the same thing as water: it is more general than water in the sense that it can also exist as ice or steam. We explore ice and steam as primordial natural user interfaces. Our ultimate goal is the creation of a centre for Cyborg-Environment Interaction (CEI) as a research trajectory exploring the relationship between nature and technology. Presently, we will celebrate the solid and gaseous states of H2O through ice mallets and steam pipes, in a performance entitled "Sublime Sublimation".
© All rights reserved Mann and Janzen and/or ACM Press
Mann, Steve (2012): Hydraulikos: nature and technology and the centre for cyborg-environment interaction (CEI). In: Proceedings of the 6th International Conference on Tangible and Embedded Interaction 2012. pp. 29-32.
Technology has put us out of touch with nature. A goal of the CCEI (the Centre for Nature and Technology) is to invent, research, study, and teach technologies that facilitate connection with our natural world. One project of CCEI is Hydraulikos, the Water Labs, for people to touch and be touched by the most primordial of all media = water. Hydraulikos aims to be a place where science, quantum physics, and fluid mechanics come together with nature, the environment, the arts, culture and society, health, wellness, and innovation, as therapy for the mind and body... where music meets math, and the compartmentalized silos of academia are washed away with lateral thinking in a setting where the boundary between work and play can also dissolve. Past projects include "Hands Across the Water" and "Hands Across the Harbour" using WOIP (Water Over Internet Protocol) to connect people through water as an Internet-connected medium that's at once both broad and deep. Ontario's Great Lakes hold 80% of North America's freshwater; it has often been said that Ontario is water capital of the world. Thus we need an Ontario-based entity like Hydraulikos that celebrates water at all ontological levels.
© All rights reserved Mann and/or ACM Press
Mann, Steve (2011). Video: Page title suppressed - page not yet published. Retrieved 19 May 2013 from [URL suppressed - page not yet published]
Mann, Steve and Janzen, Ryan E. (2007): Fluid samplers: sampling music keyboards having fluidly continuous action and sound, without being electrophones. In: Lienhart, Rainer, Prasad, Anand R., Hanjalic, Alan, Choi, Sunghyun, Bailey, Brian P. and Sebe, Nicu (eds.) Proceedings of the 15th International Conference on Multimedia 2007 September 24-29, 2007, Augsburg, Germany. pp. 912-921.
Mann, Steve, Janzen, Ryan E., Lo, Raymond and Fung, James (2007): Non-electrophonic cyborg instruments: playing on everyday things as if the whole world were one giant musical instrument. In: Lienhart, Rainer, Prasad, Anand R., Hanjalic, Alan, Choi, Sunghyun, Bailey, Brian P. and Sebe, Nicu (eds.) Proceedings of the 15th International Conference on Multimedia 2007 September 24-29, 2007, Augsburg, Germany. pp. 932-941.
Janzen, Ryan E. and Mann, Steve (2007): Arrays of water jets as user interfaces: detection and estimation of flow by listening to turbulence signatures using hydrophones. In: Lienhart, Rainer, Prasad, Anand R., Hanjalic, Alan, Choi, Sunghyun, Bailey, Brian P. and Sebe, Nicu (eds.) Proceedings of the 15th International Conference on Multimedia 2007 September 24-29, 2007, Augsburg, Germany. pp. 505-508.
Mann, Steve (2006): The andantephone: a musical instrument that you play by simply walking. In: Nahrstedt, Klara, Turk, Matthew, Rui, Yong, Klas, Wolfgang and Mayer-Patel, Ketan (eds.) Proceedings of the 14th ACM International Conference on Multimedia October 23-27, 2006, Santa Barbara, CA, USA. pp. 181-184.
Mann, Steve, Janzen, Ryan E. and Post, Mark (2006): Hydraulophone design considerations: absement, displacement, and velocity-sensitive music keyboard in which each key is a water jet. In: Nahrstedt, Klara, Turk, Matthew, Rui, Yong, Klas, Wolfgang and Mayer-Patel, Ketan (eds.) Proceedings of the 14th ACM International Conference on Multimedia October 23-27, 2006, Santa Barbara, CA, USA. pp. 519-528.
Mann, Steve, Fung, James and Lo, Raymond (2006): Cyborglogging with camera phones: steps toward equiveillance. In: Nahrstedt, Klara, Turk, Matthew, Rui, Yong, Klas, Wolfgang and Mayer-Patel, Ketan (eds.) Proceedings of the 14th ACM International Conference on Multimedia October 23-27, 2006, Santa Barbara, CA, USA. pp. 177-180.
Manders, Corey and Mann, Steve (2006): Handheld electronic camera flash lamp as a tangible user-interface for creating expressive visual art works. In: Nahrstedt, Klara, Turk, Matthew, Rui, Yong, Klas, Wolfgang and Mayer-Patel, Ketan (eds.) Proceedings of the 14th ACM International Conference on Multimedia October 23-27, 2006, Santa Barbara, CA, USA. pp. 509-518.
Mann, Steve (2005): Sousveillance and Cyborglogs: A 30-Year Empirical Voyage through Ethical, Legal, and Policy Issues. In Presence: Teleoperators and Virtual Environments, 14 (6) pp. 625-646.
Fung, James and Mann, Steve (2005): OpenVIDIA: parallel GPU computer vision. In: Zhang, Hongjiang, Chua, Tat-Seng, Steinmetz, Ralf, Kankanhalli, Mohan S. and Wilcox, Lynn (eds.) Proceedings of the 13th ACM International Conference on Multimedia November 6-11, 2005, Singapore. pp. 849-852.
Mann, Steve (2005): "fl Huge UId streams": fountains that are keyboards with nozzle spray as keys that give rich tactile feedback and are more expressive and more fun than plastic keys. In: Zhang, Hongjiang, Chua, Tat-Seng, Steinmetz, Ralf, Kankanhalli, Mohan S. and Wilcox, Lynn (eds.) Proceedings of the 13th ACM International Conference on Multimedia November 6-11, 2005, Singapore. pp. 181-190.
Mann, Steve (2004): "Sousveillance": inverse surveillance in multimedia imaging. In: Schulzrinne, Henning, Dimitrova, Nevenka, Sasse, Martina Angela, Moon, Sue B. and Lienhart, Rainer (eds.) Proceedings of the 12th ACM International Conference on Multimedia October 10-16, 2004, New York, NY, USA. pp. 620-627.
Mann, Steve (2004): "Sousveillance": inverse surveillance in multimedia imaging. In: Schulzrinne, Henning, Dimitrova, Nevenka, Sasse, Martina Angela, Moon, Sue B. and Lienhart, Rainer (eds.) Proceedings of the 12th ACM International Conference on Multimedia October 10-16, 2004, New York, NY, USA. pp. 620-627.
This is a personal narrative that began 30 years ago as a childhood hobby, of wearing and implanting various sensors, effectors, and multimedia computation in order to re-define personal space and modify sensory perception computationally. This work involved the creation of various computational seeing aids that evolved into a new kind of visual art, using multimedia cyborglogs. Becoming at one with the machine, the author was able to explore a new humanity at the nexus of cyberspace and the real world. The author presents what was discovered accidentally, as a result of facing "cyborg discrimination". In particular, over the past 30 years, peer discrimination has decreased, while institutional and organized discrimination has intensified. Most notably, it was discovered that cyborg discrimination was most intense in establishments having the most surveillance. Rather than avoid such establishments, the author was able to explore and capture unique aspects to understand surveillance in new ways. The word sur-veillance denotes a God's eye view from on high (i.e. French for "to watch from above"). An inverse, called sous-veillance (French for "to watch from below") explores what happens when cameras move from lamp posts and ceilings down to eye level. Finally, it is suggested that new personal multimedia technologies, like mass-produced wearable cameraphones, can be used as tools for artists to explore "equiveillance" by shifting this equilibrium between surveillance and sousveillance with inverse/reverse/accountability/recountability/continuability of continuous sur/sousveillance.
© All rights reserved Mann and/or ACM Press
Mann, Steve and Barfield, Woodrow (2003): Introduction to Mediated Reality. In International Journal of Human-Computer Interaction, 15 (2) pp. 205-208.
Aimone, Chris, Fung, James and Mann, Steve (2003): An EyeTap video-based featureless projective motion estimation assisted by gyroscopic tracking for wearable computer mediated reality. In Personal and Ubiquitous Computing, 7 (5) pp. 236-248.
Mann, Steve (2003): Cyborg logs and collective stream of (de)consciousness capture for producing attribution-free informatic content such as cyborglogs. In First Monday, 8 (2) .
Mann, Steve, Nolan, Jason and Wellman, Barry (2003): Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments. In Surveillance & Society, 1 (3) .
This paper describes using wearable computing devices to perform "sousveillance" (inverse surveillance) as
a counter to organizational surveillance. A variety of wearable computing devices generated different kinds
of responses, and allowed for the collection of data in different situations. Visible sousveillance often
evoked counter-performances by front-line surveillance workers. The juxtaposition of sousveillance with
surveillance generates new kinds of information in a social surveillance situation.
© All rights reserved Mann et al. and/or their publisher
Mann, Steve (2003): Existential Technology: Wearable Computing is not the real issue. In Leonardo, 36 (1) pp. 19-25.
As our world becomes more and more globally connected, the official hierarchies of corporations and governments become larger and more complicated in scope, often making the chain of command and accountability more difficult for an individual person to question. Bureaucracies spanning several countries provide layers of abstraction and opacity to accountability for the functionaries involved in such official machinery. Thus, policy affecting our everyday life is moved further from our ability to influence, affect or even understand it. At the same time, the increased use of surveillance and monitoring technologies makes the individual more vulnerable to, and accountable to, these very organizations that are themselves becoming less accountable to the surveilled populace. In this paper, I propose the concept of “Existential Technology” as the technology of self-determination and mastery over our own destiny, and I provide several examples of in(ter)ventions (new inventions I filed with the Patent Office as well as new interventions). In this article I deliberately conflate the terms invention and intervention, as I did in my recent exhibit at Gallery TPW, Prior Art: Art of Record [1]. (The terms “Prior Art” and “Art of Record” are commonly used in patent law.) My performances and in(ter)ventions attempt to reflect the technological hypocrisies of large bureaucratic...
© All rights reserved Mann and/or his/her publisher
Fung, James and Mann, Steve (2002): Exploring Humanistic Intelligence Through Physiologically Mediated Reality. In: 2002 IEEE and ACM International Symposium on Mixed and Augmented Reality ISMAR 2002 30 September-1 October, 2002, Darmstadt, Germany. pp. 275-276.
Tang, Felix, Aimone, Chris, Fung, James, Marjan, Andrej and Mann, Steve (2002): Seeing Eye to Eye: A Shared Mediated Reality Using EyeTap Devices and the VideoOrbits Gyroscopic Head Tracker. In: 2002 IEEE and ACM International Symposium on Mixed and Augmented Reality ISMAR 2002 30 September-1 October, 2002, Darmstadt, Germany. pp. 267-268.
Mann, Steve and Fung, James (2002): EyeTap Devices for Augmented, Deliberately Diminished, or Otherwise Altered Visual Perception of Rigid Planar Patches of Real-World Scenes. In Presence: Teleoperators and Virtual Environments, 11 (2) pp. 158-175.
Mann, Steve, Manders, Corey and Fung, James (2002): Painting with looks: photographic images from video using quantimetric processing. In: ACM Multimedia 2002 2002. pp. 117-126.
Mann, Steve (2001): Computer Architectures For Personal Space: Forms-Based Reasoning in the Domain of Humanistic Intelligence. In First Monday, 6 (8) .
Mann, Steve (2001): Guest Editor's Introduction: Wearable Computing-Toward Humanistic Intelligence. In IEEE Intelligent Systems, 16 (3) pp. 10-15.
Mann, Steve and Niedzviecki, Hal (2001): Cyborg: Digital Destiny and Human Possibility in the Age of the Wearable Computer. Doubleday of Canada
Mann, Steve (2001): Intelligent Image Processing. Wiley-IEEE Press
Intelligent Image Processing describes the EyeTap technology that allows non-invasive tapping into the human eye through devices built into eyeglass frames. This isn't merely about a computer screen inside eyeglasses, but rather the ability to have a shared telepathic experience among viewers. Written by the developer of the EyeTap principle, this work explores the practical application and far-reaching implications this new technology has for human telecommunications.
© All rights reserved Mann and/or Wiley-IEEE Press
Mann, Steve (2000): Free Source as Free Thought: Architecting Free Standards. In First Monday, 5 (1) .
Mann, Steve (2000): Computer Architectures for Protection of Personal Informatic Property: Putting Pirates, Pigs, and Rapists in Perspective. In First Monday, 5 (7) .
Mann, Steve (2000): Existential Education in the Era of Personal Cybernetics. In Communications of the ACM, 43 (5) pp. 33-36.
Bass, Len, Mann, Steve, Siewiorek, Dan and Thompson, Chris (1997): Issues in Wearable Computing: A CHI 97 Workshop. In ACM SIGCHI Bulletin, 29 (4) pp. 34-39.
Mann, Steve (1997): Smart clothing. In Personal and Ubiquitous Computing, 1 (1) .
Mann, Steve (1997): Editorial. In Personal and Ubiquitous Computing, 1 (3) .
Mann, Steve (1997): Wearable Computing: A First Step Toward Personal Imaging. In IEEE Computer, 30 (2) pp. 25-32.
Starner, Thad, Mann, Steve, Rhodes, Bradley J., Levine, Jeffrey, Healey, Jennifer, Kirsch, Dana, Picard, Rosalind W. and Pentland, Alex (1997): Augmented Reality Through Wearable Computing. In Presence: Teleoperators and Virtual Environments, 6 (4) pp. 386-398.
Mann, Steve (1996): "Smart clothing": Wearable Multimedia Computing and "Personal Imaging" to Restore the Technological Balance Between People and Their Environments. In: ACM Multimedia 1996 1996. pp. 163-174.
Mann, Steve (1996): Smart Clothing: The Shift to Wearable Computing. In Communications of the ACM, 39 (8) pp. 23-24.
Mann, Steve (1996). Wearable, tetherless computer--mediated reality: WearCam as a wearable face--recognizer, and other applications for the disabled, MIT Tech Report number 361, Cambridge, Massachusetts. MIT
WearCam, a wearable multimedia system with video processing capability and wireless Internet connection, has recently been proposed. In this paper, WearCam is presented as a prosthetic device. In particular, two example applications: the `Personal Visual Assistant'; and the Visual Memory Prosthetic are described. The `Personal Visual Assistant' embodies a spatial `visual filter' that reconfigures the human visual system, providing a coordinate transformation (remapping of spatial coordinates). Such coordinate transformations, it is hoped, might someday be of use to the partially sighted. The Visual Memory Prosthetic embodies a `temporal visual filter' that provides computer-induced `flashbacks' (possibly together with annotation). These `flashbacks' currently help the author overcome `visual amnesia'. It is hoped that, with further research, the apparatus and approach might someday lead to perceptual intelligence that we can wear, and be of great benefit to the disabled.
© All rights reserved Mann and/or his/her publisher
Show this list on your homepage
Copyright legend
- Pd:
Public Domain (information that is common property and contains no original authorship)
Legal Code (full licence text): http://en.wikipedia.org/wiki/Public_domain - CompositeWorkWithMultipleCopyrightTerms:
Work that is derived from or composed of multiple works with varying copyright terms and/or copyright holders - FairUse:
Copyrighted materials that meet the legal criteria for Fair Use when used by the Interaction Design FoundationThe most common cases of Fair Use are: 1) Cover art: Cover art from various items, for identification only in the context of critical commentary of that item (not for identification without critical commentary). 2) Team and corporate logos: For identification. 3) Other promotional material: Posters, programs, billboards, ads: For critical commentary. 4) Film and television screen shots: For critical commentary and discussion of the cinema and television. 5) Screenshots from software products: For critical commentary. 6) Paintings and other works of visual art: For critical commentary, including images illustrative of a particular technique or school. 7) Images with iconic status or historical importance: As subjects of commentary. 8) Images that are themselves subject of commentary.
Legal Code (full licence text): http://en.wikipedia.org/wiki/Fair_use - AllRightsReservedUsedWithoutPermission:
All Rights Reserved. Non-free, copyrighted materials used without permission. The materials are used without permission of the copyright holder because the materials meet the legal criteria for Fair Use and/or because The Interaction Design Foundation has not been able to contact the copyright holder. The most common cases of Fair Use are: 1) Cover art: Cover art from various items, for identification only in the context of critical commentary of that item (not for identification without critical commentary). 2) Team and corporate logos: For identification. 3) Other promotional material: Posters, programs, billboards, ads: For critical commentary. 4) Film and television screen shots: For critical commentary and discussion of the cinema and television. 5) Screenshots from software products: For critical commentary. 6) Paintings and other works of visual art: For critical commentary, including images illustrative of a particular technique or school. 7) Images with iconic status or historical importance: As subjects of commentary. 8) Images that are themselves subject of commentary. - AllRightsReserved:
All Rights Reserved. Materials used with permission. Permission to use has been granted exclusively to The Interaction Design Foundation and/or the author of the given work/chapter, in which the copyrighted material is used. This permission constitutes a non-transferable license and, as such, only applies to The Interaction Design Foundation. Therefore, no part of this material may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, recording or otherwise without prior written permission of the copyright holder. - CC-Att-1:
Creative Commons Attribution 1.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by/1.0/ - CC-Att-3:
Creative Commons Attribution 3.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by/3.0/ - CC-Att-2:
Creative Commons Attribution 2.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by/2.0/ - CC-Att:
Creative Commons Attribution 3.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by/3.0/ - CC-Att-ND-3:
Creative Commons Attribution-NoDerivs 3.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-nd/3.0/ - CC-Att-ND-2:
Creative Commons Attribution-NoDerivs 2.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-nd/2.0/ - CC-Att-ND-1:
Creative Commons Attribution-NoDerivs 1.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-nd/1.0/ - CC-Att-ND:
Creative Commons Attribution-NoDerivs 3.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-nd/3.0/ - CC-Att-SA-1:
Creative Commons Attribution-ShareAlike 1.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-sa/1.0/ - CC-Att-SA-3:
Creative Commons Attribution-ShareAlike 3.0
Legal Code (full licence text): http://creativecommons.org/licenses/by-sa/3.0/ - CC-Att-SA-2:
Creative Commons Attribution-ShareAlike 2.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-sa/2.0/ - CC-Att-SA:
Creative Commons Attribution-ShareAlike 3.0 Unported
Legal Code (full licence text): http://creativecommons.org/licenses/by-sa/3.0/ - Unknown:
Copyright status unknown
dd
Join the technology elite and advance:
Changes to this page (author)
30 Oct 2012: Modified25 Sep 2012: Modified27 Apr 2012: Modified
05 Apr 2012: Added
05 Apr 2012: Added
19 Jan 2012: Modified
15 Dec 2011: Added
12 Sep 2011: Added
12 Sep 2011: Added
12 Sep 2011: Added
12 Sep 2011: Added
12 Sep 2011: Added
12 Sep 2011: Added
12 Sep 2011: Modified
12 Sep 2011: Modified
12 Sep 2011: Added
11 May 2011: Added
11 May 2011: Modified
11 May 2011: Modified
25 Feb 2010: Modified
17 Aug 2009: Added
17 Aug 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
17 Jun 2009: Added
01 Jun 2009: Added
01 Jun 2009: Added
01 Jun 2009: Added
01 Jun 2009: Added
31 May 2009: Added
31 May 2009: Added
31 May 2009: Added
31 May 2009: Added
31 May 2009: Added
31 May 2009: Added
31 May 2009: Added
29 May 2009: Added
29 May 2009: Added
24 Jun 2007: Added
28 Apr 2003: Added
Page Information
Page maintainer:
The Editorial Team
URL: http://www.interaction-design.org/references/authors/steve_mann.html