“
Once the product's task is known, design the interface first; then implement to the interface design..... As far as the customer is concerned, the interface is the the product.
”
-- Jef Raskin, Cited by Malcolm McCullough in Digital Ground, 2004
Authoritative overview of End-User Development (EUD) including 4 HD video interviews filmed in Rome, Italy. EUD is really all about democratization of computing.
The following articles are from "Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc":
Articles
p. 1-10
Norman, Donald A. (1983): Design Principles for Human-Computer Interfaces. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 1-10.
“If the field of Human Factors in Computer Systems is to be a success it must develop design principles that are useful, principles that apply across a wide range of technologies. In the first part of this paper I discuss some the properties that useful principles should have. While I am at it, I warn of the dangers of the tar pits and the sirens of technology. We cannot avoid these dangers entirely, for were we to do so, we would fail to cope with the real problems and hazards of the field. The second part of the paper is intended to illustrate the first part through the example of tradeoff analysis. Any single design technique is apt to have its virtues along one dimension compensated by deficiencies along another. Tradeoff analysis provides a quantitative method of assessing tradeoff relations for two attributes x{sub:i} and x{sub:j} by first determining the User Satisfaction function for each, U(x), then showing how U(x{sub:i}) trades off against U(x{sub:j}). In general, the User Satisfaction for a system is given by the weighted sum of the User Satisfaction values for the attributes. The analysis is used to examine two different tradeoffs of information versus time and editor workspace versus menu size. Tradeoffs involving command languages versus menu-based systems, choices of names, and handheld computers versus workstations are examined briefly.”
Kieras, David E. and Polson, Peter G. (1983): A Generalized Transition Network Representation for Interactive Systems. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 103-106.
“A general method for describing the behavior of an interactive system is presented which is based on transition networks generalized enough to describe even very complex systems easily, as shown by an example description of a word processor. The key feature is the ability to easily describe hierarchies of modes or states of the system. The representation system is especially valuable as a design tool when used in a simulation of a proposed user interface. In order to characterize the interaction between a user and a system, an explicit and formal representation of the behavior of the system itself is needed. To be of value in the design of user interfaces, the representation should be independent of the actual implementation of the system, but also reflect the structural properties of the system's behavior, such as its hierarchical form, the possible modes, and the consistent patterns of interaction. At the same time, the presentation must be easy to define and understand. This paper presents a representation notation with these properties.”
Revesman, Mark E. and Greenstein, Joel S. (1983): Application of a Model of Human Decision Making for Human/Computer Communication. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 107-111.
“When a human and computer perform similar tasks in parallel, it is important that an effective line of communication exist between the two entities. Since overt communication may add to the human's workload, an implicit method of communication is suggested in which the computer has a model of human performance on which to base actions. A two-stage model of human performance is employed in an experimental situation in which both a human and a computer act as decision makers. Results indicate that the implementation of a model significantly improves the human's performance and the overall system performance, without degrading the computer's performance. Research into additional experimental and real-world situations is suggested.”
Wright, Patricia (1983): Manual Dexterity: A User-Oriented Approach to Creating Computer Documentation. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 11-18.
“This paper will not advocate a list of firm recommendations about document design because it is recognised that design decisions will vary with many factors. Instead, the present discussion will emphasize that when making these decisions it is necessary for designers to take account of how readers will use the information provided. In order to help them do this, a simple framework is proposed which outlines the rudiments of how people interact with technical documents. The advantages of this framework will be illustrated by using it to motivate design decisions at two decision levels. At a "macro" level the document designer must make broad decisions about the contents and format of the manual. At a "micro" level the designer must select particular combinations of linguistic, graphic and typographic options which will help readers locate, understand and implement the information given in the manual.”
Dumais, Susan and Landauer, Thomas K. (1983): Using Examples to Describe Categories. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 112-115.
“The successful use of menu-based information retrieval system depends critically on users understanding the category names and partitions used by system designers. Some of the problems in this endeavor are psychological and have to do with naming large and ill-defined categories so that users can understand their contents, and effectively partitioning large sets of objects. Systems of interest (like home information systems) often consist of new and frequently changing content in large and varied domains, and are particularly prone to these problems. We explored several ways in which one might name categories in one such domain (Yellow Page category headings) - category names, category names plus examples, and examples alone. We found that three examples alone were essentially as good a way to name these categories as either an expertly chosen name or a name plus examples. Examples provide a promising possibility both as a means of flexibly naming menu categories and as a methodological tool to study certain categorization problems.”
Rosenberg, Jarrett (1983): A Featural Approach to Command Names. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 116-119.
“A variety of aspects of command names have been studied, such as suggestiveness, memorability, and the use of icons. A single framework for these disparate studies is desirable, and it is proposed that the concept of featural analysis prevalent in linguistics and psycholinguistics be adopted as an approach to command name design. Examples of the breadth of application of this approach are given for the naming issues of suggestiveness, learning and memory, congruence and hierarchicalness, universal commands, the relationships of names to the command language syntax, and the use of non-words as names.”
Kraut, Robert E., Hanson, Stephen J. and Farber, James M. (1983): Command Use and Interface Design. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 120-124.
p. 125-129
Leon, Lorenzo De, Harris, William G. and Evens, Martha (1983): Is There Really Trouble with UNIX?. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 125-129.
“Donald Norman has claimed that UNIX has cryptic and inconsistent command names. As Michael Lesk has remarked, the lack of objective data makes it difficult to evaluate the significance of Norman's criticisms. In an effort to explore this controversy we taught one group of novice users the UNIX command language and another group an English-based command language (NUIX). The number of errors and calls for on-line assistance were compared. The subjects in this study were 22 high school women with no formal exposure to computers. The results reveal that the UNIX group made fewer errors than the NUIX group in two training sessions a week apart. Although calls for on-line assistance for the two groups in the first session were comparable, the UNIX group made over twice as many calls for on-line assistance in the second session as the NUIX group. Our findings suggest that even though the UNIX command language may not be harder for novice users to learn, it is probably more difficult for them to use.”
Lee, Alison and Lochovsky, Frederick H. (1983): Enhancing the Usability of an Office Information System Through Direct Manipulation. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 130-134.
“In Office Information Systems, the primary focus has been to integrate facilities for the communication and management of information. However, the human factors aspects of the design of office systems are equally important considerations if such office systems are to gain widespread acceptance and use. The application of design techniques from Human Factors can help enhance the usability of an office system. In this paper, we describe the user interface of an office system developed by adapting such design techniques.”
Phillips, Mark D., Allison, James E. and Dodd, Valor S. (1983): An Assessment of Computer Generated Space Situation Map Projections. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 135-138.
“C{sup:3} environments have increasingly incorporated computer controlled maps as decision aids. The design of map displays in space oriented C{sup:3} system has taken on greater importance due to the complex spatial relationships among orbiting objects. The large number of objects orbiting the globe and their great speeds further complicates efforts to quickly and accurately portray their positions graphically. This paper describes an experimental plan aimed at evaluating a new 2D/3D "hybrid" space situation map display. The Hybrid display is created by opening a globe at the south pole and flattening it into a platter. A third dimension is obtained by tilting the platter. It was hypothesized that the Hybrid display would offer an advantage to C{sup:3} system operators and analysts dealing with three dimensional problems. The test plan focuses on perceptual parameters and user preference issues concerning conventional and Hybrid display techniques. The results of this study will be examined to direct future work on dynamic displays, and the impact of display design approach on cognitive performance.”
Lewis, J. W. (1983): An Effective Graphics User Interface for Rules and Inference Mechanisms. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 139-143.
“As the technology of rule-based inference mechanisms matures, knowledge acquisition-the creation, structuring, and verification of rules-becomes increasingly important. The accuracy and completeness of the rules in the knowledge base determine expert system performance, and the cost of acquiring that knowledge base dominates all other hardware and software costs in practical systems. To reduce knowledge acquisition time and error rate, a new interactive graphics interface for rules is being designed and implemented in GE Corporate Research and Development. In the new system, each set of rules is represented as an AND/OR graph and parts of the rule base are displayed on a CRT screen as an AND/OR tree. A user -- even an unsophisticated user -- can navigate the AND/OR graph, identify nodes to be modified, analyze the behavior of the graph, verify its correctness graphically, and follow the execution of inference engines.”
Gupta, S. M., Geyer, L. H. and Maalouf, J. A. (1983): Effect of Font and Medium on Recognition/Confusion. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 144-149.
“Systematic differences in recognition/confusion due to font variation is estimated by using confusion matrices of the full 26 capital letters of the English alphabet in 5 x 7 dot matrix font and "Keepsake" conventional stroke font. Average correct recognition was controlled to 50% by limiting brightness and duration of tachistoscopic displays for each font to individually determined levels for each of the four subjects. Each stimulus symbol was presented 45 times to each subject, resulting in 180 trials per letter per font. By comparing the obtained data to that reported by Townsend (1971), Craig (1979) and Gilmore et al. (1979), estimates of the differences in recognition/confusion attributable to medium, font and subject differences were isolated. This comparison reveals a substantial difference in recognition/confusion processes when the observer sees the display on a video screen versus seeing it projected on a white screen.”
Teitelbaum, Richard C. and Granda, Richard E. (1983): The Effects of Positional Constancy on Searching Menus for Information. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 150-153.
p. 154-160
Tennant, Harry R., Ross, Kenneth M. and Thompson, Craig W. (1983): Usable Natural Language Interfaces Through Menu-Based Natural Language Understanding. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 154-160.
“Conventional natural language interfaces suffer from several ease-of-use problems. They require a user to type and to formulate questions in a way that the system can understand. They have high failure rates which often frustrate users, and users often do not use features of the systems because they are unaware of them or don't trust them. In addition, conventional natural language systems are expensive to build and require large amounts of storage to use. This paper describes a new approach to natural language interfaces called menu-based natural language understanding. This new approach solves the problems listed above. The paper compares the menu-based natural language approach to conventional natural language interfaces and to other forms of interface and discusses the advantages and limitations of this new approach.”
Ogden, William C. and Brooks, Susan R. (1983): Query Languages for the Casual User: Exploring the Middle Ground Between Formal and Natural Languages. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 161-165.
p. 166-170
Poller, Merle F. and Garter, Susan K. (1983): A Comparative Study of Moded and Modeless Text Editing by Experienced Editor Users. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 166-170.
p. 171-175
Rosson, Mary Beth (1983): Patterns of Experience in Text Editing. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 171-175.
p. 176-181
Gomez, Louis M., Egan, Dennis E., Wheeler, Evangeline A., Sharma, Dhiraj K. and Gruchacz, Aleta M. (1983): How Interface Design Determines Who Has Difficulty Learning To Use a Text Editor. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 176-181.
“In previous studies two background characteristics of computer novices were consistently correlated with their success in learning to use a line-based computer text editor. Older people and those who scored low on a standard test of Spatial Memory had more difficulty than younger people and those with higher Spatial Memory test scores. In the present study, we observed computer novices as they learned to use a screen-based editor, which presumably reduced spatial memory load. Contrary to expectations, performance using a screen-based editor was again strongly correlated with Spatial Memory test scores. However, the correlation between performance and subjects' age was significantly reduced. Overall, subjects were able to perform the same text editing exercises almost twice as fast using the screen editor compared to subjects in previous experiments using the line editor. These results are discussed in terms of the different cognitive demands placed on users by line and screen text editors.”
Galambos, James A., Wikler, Eloise S., Black, John B. and Sebrechts, Marc M. (1983): How You Tell Your Computer What You Mean: Ostension in Interactive Systems. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 182-185.
“An important part of communication is being able to point to an object without referring to its components or to the area surrounding it. How to do this is the problem of ostension. We observed many ostension errors in novices learning to use a full-screen text editor. Specifically, the novices erroneously tried to use keys that are appropriate for pointing when using a typewriter but incorrect in screen editors (e.g., space bar, backspace key, etc.), they frequently missed the location they intended by one character, they inadvertently pointed to the wrong occurrence of a string using a FIND command, they incorrectly specified boundaries by forgetting about "invisible" characters (e.g., formatting characters), and they mistakenly attempted to point to nontyping areas of the screen that were off-limits.”
Cross, Stephen E. (1983): A Qualitative Reasoning Approach to Mathematical and Heuristic Knowledge Integration. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 186-189.
“Humans problems solvers use heuristic knowledge. Heuristics can be justified in a given problem solving context by reasoning about 'deeper' domain theories. A working computer program, an air traffic control expert system, uses a qualitative reasoning approach to justify heuristically generated plans. The justification is based on mathematical knowledge of aircraft performance which is computationally too complex for use in the normal planning process.”
Nakatani, Lloyd H. and Rohrlich, John A. (1983): Soft Machines: A Philosophy of User-Computer Interface Design. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 19-23.
“Machines and computer systems differ in many characteristics that have important consequences for the users. Machines are special-purpose, have forms suggestive of their functions, are operated with controls in obvious one-to-one correspondence with their actions, and the consequences of the actions on visible objects are immediately and readily apparent. By contrast, computer systems are general-purpose, have inscrutable form, are operated symbolically via a keyboard with no obvious correspondence between keys and actions, and typically operate on invisible objects with consequences that are not immediately or readily apparent. The characteristics possessed by machines, but typically absent in computer systems, aid learning, use and transfer among machines. But "hard," physical machines have limitations: they are inflexible, and their complexity can overwhelm us. We have built in our laboratory "soft machine" interfaces for computer systems to capitalize on the good characteristics of machines and overcome their limitations. A soft machine is implemented using the synergistic combination of real-time computer graphics to display "soft controls," and a touch screen to make soft controls operable like conventional hard controls.”
Hendler, James A. and Michaelis, Paul Roller (1983): The Effects of Limited Grammar on Interactive Natural Language. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 190-192.
p. 193-196
Kelley, J. F. (1983): An Empirical Methodology for Writing User-Friendly Natural Language Computer Applications. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 193-196.
“A six-step, iterative, human factors design methodology was used to develop CAL, a natural language computer application to help computer-naive business professionals manage their personal calendars. Language is processed by a simple, non-parsing algorithm having limited storage requirements and a quick response time. CAL allows unconstrained English inputs from users with no training (except for a 5 minute introduction to the keyboard and display) and no manual (except for a two-page overview of the system). In controlled tests of performance, CAL correctly responded to between 86% and 97% of the inputs it received, according to various criteria. This research demonstrates that the methodological tools of the engineering psychologist can help build user-friendly software that accommodates the unruly language of computer-naive, first-time users by eliciting the cooperation of such users as partners in an iterative, empirical development process.”
McCoy, Kathleen F. (1983): Correcting Misconceptions: What to Say when the User is Mistaken. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 197-201.
“Because people's knowledge is often partial and/or faulty, it is inevitable that misconceptions will be revealed in the course of a conversation. If recognized, the other person may say something to correct the misconception, and the conversation continues. Just as this is the case when people interact with each other, so must it be when users interact with a computer system. For example, in interacting with an expert system, a user may reveal misconceptions about objects modelled by the system. By failing to correct such misconceptions, the system may not only confirm the original misconception, but may cause the user to develop further misconceptions. It must therefore be up to the system to recognize and respond to misconceptions in an effective way. In this paper the space of possible object misconceptions is characterized according to the kind of incorrect information involved. It has been found that this characterization is often useful in determining how the user arrived at the misconception, and therefore the kind of information to include in the response. Using such a characterization, a system will be able to effectively correct object misconceptions in a domain independent way. Factors which affect the amount of information included in a correction (such as discourse and situational context) are also examined.”
Payne, Stephen J. and Green, T. R. G. (1983): The User's Perception of the Interaction Language: A Two-Level Model. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 202-206.
“Users perceive consistency and inconsistency in syntax, and family resemblances among syntactic constructions. These factors are not captured in conventional BNF-like grammars. We argue that a generalised form of a two-level grammar is a better model of the user's perceptions, and show how the model relates to current psychological notions of organisation in recall and language learning. The model provides a unified interpretation of many previous results in HCI: we analyse here findings by Reisner (1981) and Barnard et al. (1981). Two preliminary experimental tests supporting the model are described.”
Douglas, Sarah A. and Moran, Thomas P. (1983): Learning Text Editor Semantics by Analogy. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 207-211.
“This paper presents a cognitive model for one aspect of how novices learn text editors-the acquisition of procedural skill by problem solving in problem spaces and the use of analogy for building a representation of the semantics of text-editor commands (which we call operators). Protocol data of computer-native subjects learning the EMACS text editor suggests that they use their knowledge of typewriting to decide which commands to use in performing editing tasks. We propose a formal method of analysis that compares operators in two problem spaces and generates misconceptions. The comparison of these predicted misconceptions with verbal comments, error data, and task difficulty lends support to this analysis.”
Halasz, Frank and Moran, Thomas P. (1983): Mental Models and Problem Solving in Using a Calculator. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 212-216.
“It has often been suggested that users understand and reason about complex system on the basis of a mental model of the system's internal mechanics. This paper describes an empirical study of how mental model knowledge is used in operating a stack calculator. One group of naive users were taught step-by-step procedures for solving typical problems on the calculator. A second group of naive users were taught the same procedures in conjunction with an explicit model of the calculator's stack mechanism. The users then solved problems on the calculator while thinking aloud. Analysis of the performance of these two groups indicates that the model had little effect in routine problem solving situations. But significantly improved performance for novel problems. Analyses of the think-aloud protocols indicate that the users employed five distinct modes of problem solving: skilled methods, problem reduction strategies, a conversion algorithm, model-based problem space search, and methods-based problem space search. Skilled methods, problem reduction strategies and the conversion algorithm were used for solving more routine problems and did not necessarily depend on mental model knowledge. Problem space search was used in the novel problems. For the model users, the states and operations of the stack mechanism served as the problem space to be searched for a problem solution. In contrast, the no-model users employed a less effective search strategy based on the recombination of pieces of known procedures. These results indicate that explicitly teaching naive users an appropriate mental model of a system can provide a psychologically effective and robust basis for operating the machine.”
Robertson, Scott P. and Black, John B. (1983): Planning Units in Text Editing Behavior. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 217-221.
“The organization of text editing behavior can be characterized by graph structures containing goals, subgoals, goal outcomes, and actions. Here we propose a model to represent the goals and plans of text editor users based on goal-fate analysis (Schank&Abelson, 1977). The representation captures relationships between a user's multiple goals and shows how errors can result from badly formed plans. We discuss some data from a psychological experiment which supports the hypothesis that text editing behavior is chunked into distinct plan units. The cognitive components of pause times between keystrokes were revealed by statistically removing the physical time required between keystrokes. Finally, we suggest how a system which builds goal-fate graphs from keystroke input might be useful in providing specific help information that is keyed to a user's intentions.”
Ross, Brian H. and Moran, Thomas P. (1983): Remindings and Their Effects in Learning a Text Editor. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 222-225.
“How can learning in text-editing be characterized? Much recent work has focused on the use of analogies from prior experience. In this paper, we investigate the retrievals of earlier experiences within the editor and how they might be used by analogy to accomplish the task and learn the editor. An experiment is presented that demonstrates the effects of these "remindings" on performance. In addition, some possible determinants of these remindings are investigated. This experiment points out the need to consider not only the general form of instruction, but also the specifics of the instructional sequence as well. Irrelevant aspects of the task may have strong effects on performance. We consider three teaching techniques, designed to take advantage of these effects in different ways.”
Shrager, Jeff and Klahr, David (1983): Learning in an Instructionless Environment: Observation and Analysis. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 226-229.
“In an instructionless environment, there are neither teachers nor books. The only feedback comes from interaction with the target. All information appears from within the subject or from observation of the environment. In this setting, subjects rely upon experimentation to develop an understanding of the target. They form hypotheses by analogy or inference and test these hypotheses via experiments of calibration, replication, confirmation, exploration, and discrimination. This paper describes subjects' performance in a particular instructionless environment. The target object is a programmable toy robot tank. We use the hypotheses formed by subjects and form of the experiments performed, to assess subjects' knowledge of the system. This knowledge falls into distinguishable categories: syntactic knowledge of the programming language, semantic knowledge of the actions of the device, and model knowledge which addresses the structure of the device. Exemplary selections of our protocols are used to support the various aspects of the learning model.”
Woolf, Beverly and McDonald, David D. (1983): Human-Computer Discourse in the Design of a PASCAL Tutor. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 230-234.
“An effective human-computer discourse system requires more than a clever grammar or a rich knowledge base. It needs knowledge about the user and his understanding of the domain in order to produce a relevant and coherent discourse. We describe MENO, A prototype tutor for elementary PASCAL, which uses a set of speech patterns modelled after complex human discourse and a richly annotated knowledge base to produce a flexible interactive system for the user.”
Kahney, Hank (1983): What Do Novice Programmers Know about Recursion. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 235-239.
“Recent research into differences between novice and expert computer programmers has provided evidence that experts know more than novices, and what they know is better organized. The conclusion is only as interesting as it is intuitive. This paper reports an experiment which was designed to determine precisely what novice programmers understand about the behaviour of recursive procedures, and exactly how their understanding differs from an expert's understanding of the process. The results show that different novices understand, or misunderstand, different things. Implications of the findings are discussed with respect to other research into novice and expert programming performance.”
Wixon, Dennis, Whiteside, John, Good, Michael and Jones, Sandra (1983): Building a User-Defined Interface. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 24-27.
“A measurably easy-to-use interface has been built using a novel technique. Novices attempted an electronic mail task using a command-line interface containing no help, no menu, no documentation, and no instruction. A hidden operator intercepted commands when necessary, creating the illusion of a true interactive session. The software was repeatedly revised to recognize users' new commands; in essence, the users defined the interface. This procedure was used on 67 subjects. The first version of the software could recognize only 7% of all the subjects' spontaneously generated commands; the final version could recognize 76% of those commands. This experience contradicts the idea that people are not good at designing their own command languages. Through careful observation and analysis of user behavior, a mail interface unusable by novices evolved into one that let novices do useful work within minutes.”
Soloway, Elliot, Ehrlich, Kate and Black, John B. (1983): Beyond Numbers: Don't Ask "How Many" ... Ask "Why". In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 240-246.
“While programmers may differ in their assessment of the comprehensibility of a program, there are nonetheless some clear cut cases of programs that are truly difficult to understand. In this paper, we analyze three programs -- two of which are relatively incomprehensible -- using Halstead's Volume Metric, Propositional Analysis and Plan Analysis. We argue that only Plan Analysis provides a satisfactory explanation for why the programs in question differ with respect to understandability. Moreover, we suggest that a qualitative analysis, such as provided by Plan Analysis, is the desired type of evaluation: rather than simply providing a numerical ranking for programs, the qualitative analysis can pinpoint the troublesome area in the code and provide prescriptive information for correcting the difficulty.”
Molzberger, Peter (1983): Aesthetics and Programming. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 247-250.
“The paper at hand is based on interviews with a total of eight so-called "superprogrammers", software people, who show exceptional performance quantitatively as well as qualitatively. It becomes apparent that these people do not experience programming as a purely rational activity, but that for them it possesses strong intuitive components. Programs are visualized wholistically as three-dimensional structures. In this, aesthetics plays a special part: the structure must please optically, be elegant -- then it is functionally acceptable. Logical mistakes manifest themselves as interfering with this aesthetics. The author suggests that in the area of software as well there is something like the absolute beautiful: perfect solutions with a maximum of transparence beyond all rivaling design parameters. He has a feeling that the faculties described in this paper are widespread and may open up a totally new dimension in programming.”
Baecker, Ronald M. and Marcus, Aaron (1983): On Enhancing the Interface to the Source Code of Computer Programs. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 251-255.
“This paper addresses issues in the human factors of computer program documentation. We develop a framework for research on enhancing the interface to the source code of computer programs through designing and automating the production of effective typeset representations of the source text. Principles underlying the design research and examples of sample production are presented.”
Boehm-Davis, Deborah A. and Fregly, Andrew M. (1983): Documentation of Concurrent Programs. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 256-261.
p. 262-266
Price, Lynne A. and Cordova, Carlos A. (1983): Use of Mouse Buttons. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 262-266.
“Two experimental tasks were designed to test use of multiple-button mice. In the first, number of errors made and time to complete subtasks were measured as subjects attempted to depress one, two, or three buttons under three sets of conditions. In the second, subjects were asked to indicate true or false either by pressing one of two different buttons or by clicking a single button one or two times. People tended to be faster and more accurate using different buttons than different numbers of clicks.”
Rollins, Ann M., Constantine, B. and Baker, S. (1983): Speech Recognition at Two Field Sites. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 267-273.
“The performance of two speech recognition systems installed at two field sites was analyzed. The speech systems were part of larger computer systems that were performing real functions in industrial environments. The two sites appeared to be polarized in terms of expected suitability for speech recognition. The variables looked at included task complexity, memory load, requirements for verification and error correction, vocabulary and syntax, microphone, operator experience and complexity of host computer software. Accuracy and throughput were measured for the speech recognition system at each site. The same measurements were made for keyboard entry. Operator differences account for most of the variance in results. Accuracy with voice input was higher than with keyboard for most operators. The most accurate operators with keyboard also tended to be the most accurate with voice. Throughput data appears more sensitive to individual differences in dealing with voice input, although the throughput data was clouded by slow host system response times overall. The discussion suggests that one to one replacement of keyboard with voice overlooks some possible advantages of voice. It is also possible to find operators who work well with voice. For those who do not work well with voice, the problems appear to be related to general work habits and attitude, rather than to specific difficulties with speech.”
Brauninger, U. and Grandjean, E. (1983): Lighting Characteristics of Visual Display Terminals from an Ergonomic Point of View. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 274-276.
“Measuring procedures were developed to assess those lighting characteristics of VDTs which are of importance for visual comfort and for legibility: Luminance oscillation, sharpness, contrasts, stability and dimensions of characters as well as reflections on the display surfaces. 30 different VDT models of various European and US manufacturers disclosed great differences, indicating a big potential for improving the ergonomic qualities of VDTs.”
Magers, Celeste S. (1983): An Experimental Evaluation of On-Line HELP for Non-Programmers. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 277-281.
“An interactive computer system was made easier to learn for non-programmers by modifying the on-line HELP and error messages of a system designed primarily for programmers. The modifications included supplementing the existing HELP command with a HELP key, making the content of HELP and error messages more concrete, responding to command synonyms, and more. The systems were evaluated in a between-groups experiment in which office workers with no programming experience were asked to perform a typical office task using one of the unfamiliar interactive computer systems. The results of the experiment supported the inclusion of the modifications. Non-programmers using the modified system completed the computer task in less time, with greater accuracy, and with better resulting attitudes than those who used the system designed primarily for programmers.”
Jacob, Robert J. K. (1983): Executable Specifications for a Human-Computer Interface. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 28-34.
“It is useful to be able to specify a proposed human-computer interface formally before building it, particularly if a mockup suitable for testing can be obtained directly from the specification. A specification technique for user interfaces, based on state transition diagrams, is introduced and then demonstrated for a secure message system application. An interpreter that executes the resulting specification is then described. Some problems that arise in specifying a user interface are addressed by particular features of the technique: To reduce the complexity of the developer's task, a user interface is divided into the semantic, syntactic, and lexical levels, and a separate executable specification is provided for each. A process of stepwise refinement of the syntactic specification, leading from an informal specification to an executable one is also presented. Since the state diagram notation is based on a nondeterministic model, constraints necessary to realize the system with a deterministic interpreter are given.”
Mantei, Marilyn and Haskell, Nancy (1983): Autobiography of a First-Time Discretionary Microcomputer User. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 286-290.
p. 35-39
Roach, J. W. and Nickson, M. (1983): Formal Specifications for Modeling and Developing Human/Computer Interfaces. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 35-39.
“High quality human/computer interfaces have become a major topic of research. This paper describes a new method for modeling, designing, and developing dialogue, a method that has a strong formal basis and allows a uniform syntactic and semantic specification. This formal descriptive technique has the added advantage of being executable, that is, it has widely available translators. The technique chosen here allows a very high level specification of human/computer interaction enabling rapid development and easy modification. This paper describes the nature of the formal specifications written in first order logic using Prolog, and the successful specification and development of a carrier air traffic controller (CATC) dialogue. These experiments demonstrate the utility of Prolog as a high level specification language and point the way to a full dialogue development system that can incorporate a multi-layered concept of human/computer interaction.”
Hammond, Nick, Jorgensen, A., MacLean, Allan, Barnard, Philip J. and Long, John (1983): Design Practice and Interface Usability: Evidence from Interviews with Designers. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 40-44.
p. 45-49
Moran, Thomas P. (1983): Getting Into a System: External-Internal Task Mapping Analysis. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 45-49.
“A task analysis technique, called ETIT analysis, is introduced. It is based on the idea that tasks in the external world must be reformulated into the internal concepts of a computer system before the system can be used. The analysis is in the form of a mapping between sets of external tasks and internal tasks. An example analysis of several text editing systems is presented, and various properties of the systems are derived from the analysis. Further, it is shown how this analysis can be used to assess the potential transfer of knowledge from one system to another, i.e., how much knowing one system helps with learning another. Several issues are briefly discussed.”
Gould, John D. and Lewis, Clayton H. (1983): Designing for Usability -- Key Principles and What Designers Think. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 50-53.
“Any system designed for people to use should be (1) easy to learn; (b) useful, i.e., contain functions people really need in their work; (c) easy to use; and (4) pleasant to use. In this note we present theoretical considerations and empirical data relevant to attaining these goals. First, we mention four principles for system design which we believe are necessary to attain these goals. Then we present survey results that demonstrate that our principles are not really all that obvious, but just seem obvious once presented. The responses of designers suggest that they may sometimes think they are doing what we recommend when in fact they are not. This is consistent with the experience that systems designers do not often recommend or use them themselves. We contrast some of these responses with what we have in mind in order to provide a more useful description of our principles. Lastly, we consider why this might be so. These sections are summaries of those in a longer paper to appear elsewhere (Gould&Lewis, 1983). In that paper we elaborate on our four principles, showing how they form the basis for a general methodology of design, and we describe a successful example of using them in actual system design (IBM's Audio Distribution System).”
Bannon, Liam, Cypher, Allen, Greenspan, Steven and Monty, M. L. (1983): Evaluation and Analysis of Users' Activity Organization. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 54-57.
“Our analyses of the activities performed by users of computer systems show complex patterns of interleaved activities. Current human - computer interfaces provide little support for the kinds of problems users encounter when attempting to accomplish several different tasks in a single session. In this paper we develop a framework for discussing the characteristics of activities, in terms of activity structures, and provide a number of conceptual guidelines for developing an interface which supports activity coordination. The concept of a workspace is introduced as a unifying construct for reducing the mental workload when switching tasks, and for supporting contextually-driven interpretations of the users' activity structures.”
Butler, T. W. (1983): Computer Response Time and User Performance. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 58-62.
p. 63-67
Murrel, Sharon (1983): Computer Communication System Design Affects Group Decision Making. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 63-67.
“The impact of computer-based communication on group performance depends upon the structure enforced by the communication system. While the ability to introduce structures which enhance human communication processes has been applauded, research to evaluate the impact of various design features is lacking. This research has explored the impact of two synchronous systems which vary in the role of immediacy of interaction and feedback on group decision making. One system is message-oriented, requiring a conferee to complete a message before interacting with others. The other displays what each group member is typing in a separate window on the screens of all participants. In this system, comments can be made as ideas are expressed. Groups were asked to solve a problem first individually and then cooperatively using one of the two systems. All groups produced decisions superior to the average initial individual solutions. Window system groups both improved more and produced significantly higher quality decisions. These groups focused on fewer topics at one time while spending less time discussing how to organize both system and task efforts. By influencing the group's ability to organize and focus its attention, the design of the communication system influenced decision quality.”
Isa, Barbara S., Boyle, James M., Neal, Alan S. and Simons, Roger M. (1983): A Methodology for Objectively Evaluating Error Messages. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 68-71.
“Message quality is a critical factor in influencing user acceptance of a program product. Good error messages can reduce the time and cost to create and maintain software, as well as help users learn about the product. We have developed a methodology for conducting controlled usability evaluations of error messages. The Message Test Program is easily modified to adapt to different product situations, and messages can be evaluated even before working code exists. The Message Test Program can be used to test error messages for a batch product, as well as messages for an interactive product. It can also be used for stand-alone messages, for products that offer on-line help, or messages that provide additional information in a reference manual. Message testing enables us to objectively evaluate error messages and provide specific feedback about the difficulties users encounter and how error messages can be improved.”
Bewley, William L., Roberts, Teresa L., Schroit, David and Verplank, William (1983): Human Factors Testing in the Design of Xerox's 8010 `Star' Office Workstation. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 72-77.
“Integral to the design process of the Xerox 8010 "Star" workstation was constant concern for the user interface. The design was driven by principles of human cognition. Prototyping of ideas, paper-and-pencil analyses, and human-factors experiments with potential users all aided in making design decisions. Three of the human-factors experiments are described in this paper: A selection schemes test determined the number of buttons on the mouse pointing device and the meanings of these buttons for doing text selection. An icon test showed us the significant parameters in the shapes of objects on the display screen. A graphics test evaluated the user interface for making line drawings, and resulted in a redesign of that interface.”
Neal, Alan S. and Simons, Roger M. (1983): Playback: A Method for Evaluating the Usability of Software and Its Documentation. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 78-82.
“A methodology is described for obtaining objective measures of product usability. The Playback program developed at the IBM Human Factors Center in San Jose collects performance data of the user interface without impact upon the user or the system being evaluated. While a user is working with the system, keyboard activity is timed and recorded by a second computer. This log of stored activity is later played back through the host system for analysis. An observer watching television monitors enters time-stamped codes and comments concerning the users employment of system publications. The advantages of this approach are: (1) data-collection programs are external to the product being evaluated, (2) no modifications of the playback program are required for testing different software applications, (3) the data-collection process does not intrude on the user's thoughts or activities, (4) problem determination is performed at an accelerated rate during playback analysis, and (5) all data collection is performed on line.”
Root, Robert W. and Draper, Steven (1983): Questionnaires as a Software Evaluation Tool. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 83-87.
“This paper reports on a study investigating the strengths and weaknesses of questionnaires as software evaluation tools. Two major influences on the usefulness of questionnaire-based evaluation responses are examined: the administration of the questionnaire, and the background and experience of the respondent. Two questionnaires were administered to a large number of students in an introductory programming class. The questionnaires were also given to a group of more experienced users (including course proctors). Respondents were asked to evaluate the text editor used in the class along a number of dimensions; evaluation responses were solicited using a number of different question types. Another group of students received the questionnaire individually, with part of it presented on the computer; a third group also evaluated an enhanced version of the editor in followup sessions.”
Mooers, Charlotte D. (1983): Changes that Users Demanded in the Human Interface to the Hermes Message System. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 88-92.
“The Hermes Message System has evolved in response to the needs and criticisms of users. This paper gives examples of some less than successful features, many of which have been changed, so that future designers will know what didn't work, as well as what does. Principles derived from this experience are: (a) What you see should be what you can type. (b) Commands and syntax should be uniform. (c) Commands and objects should be organized into groups. (d) Hierarchy is great for organizing things you know about but much less useful for finding things you don't know. Even with careful design, it is impossible to predict what users will dislike so it is important to design programs so they can be easily changed.”
Horton, Martha R. (1983): Computing on a Shoestring: Initial Data Entry for Service Organizations. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 93-97.
p. 98-102
Kaczmarek, T., Mark, W. and Sondheimer, Norm (1983): The Consul/CUE Interface: An Integrated Interactive Environment. In: Smith, Raoul N., Pew, Richard W. and Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 98-102.
“Consul and CUE are two systems that combine to support an interface to interactive computer services that is integrated across a variety of interface methods. Consul is an experimental natural language interface system designed to be customized to a set of specific interactive computer services: electronic mail, personal calendar, word processing, etc. CUE is a window- and object-based run-time support environment for interactive services with a command language, pointing device and menu interface. Using the Consul/CUE interface, the user sees a single system that is capable of handling a wide variety of input in a completely uniform service environment. The success of the combined system derives from a large knowledge base formalizing facts in the interactive service environment in an artificial intelligence network structure.”
We have decided to give away world-class educational materials
because we believe that universal access to high quality education is key to the building
of peace, sustainable social and economic development, and intercultural dialogue.
To calculate just have much we have saved you, our wonderful readers, we compare our free encyclopedia to two
books we love:
As you are reading our encyclopedia on your iPad/tablet (and saving a few trees), we estimate that the price would be $90 if sold as an eBook.
With that number, we can calculate how much money we have saved our readers, based on calculating the number of readers.
How we calculate readership
Because of our online and tablet/iPad approach to publishing, we are able to precisely measure reading behaviour across hundreds of parameters in realtime: Anything from reading
speed, drop-off points in the text, reader demographics, and much more.
Based on our server logs and the Google Analytics API,
we calculate the number of readers as described in the calculation method below.
A reader is not the same as a simple pageview and a reader is not the same as a
website visitor (as described in our calculation method below).
We calculate readership for two types of readers:
Readers that have read our whole encyclopedia, much the same way you read a printed book
Readers that have reader an individual chapter
Calcalution method: How we define a reader
First we use the Google Analytics API to get a report of the number of unique human visitors to a chapter/page. Google runs its business on ads and thus completely relies on the ability to distinguish between a human visitor and an automated request. If not, you could earn millions on automating clicks on Google Ads.
We then compare that number to our Apache webserver logs, which report the much higher number of actual visits to a chapter/page (both human and automated). We calculate the difference in percent, which we call an "exaggeration factor", which we use in step 6 below.
With a large part of the visitors excluded, we further exclude any visitor who:
has not remained on the page for at least 3 minutes (this factor is calculated by recording visit durations of 1000 randomly selected visitors) or has not printed the page (i.e. has not visited the printerfriendly version of the chapter/page)
has not scrolled the page (this factor is calculated by recording scroll movements on 1000 randomly selected visitors)
We then further exclude "double readers", i.e. readers who read a portion of a chapter and then returns in,
say, a week or a month to read the rest.
Although this person's reading activity spans multiple server sessions, the person is only counted as a single reader.
We categorize a "double reader" as a visitor who:
visits a page, or multiple pages, across multiple server sessions
qualifies to be defined as a reader, cf step 1-3 above, in all server sessions
uses the same originating IP address
We then subtract 5% from the final number to counter-balance a last remaining factor, namely the situation where one reader reads a chapter on his/her tablet
using a WiFi connection (and counted as one reader) but then picks up his other tablet using a 3G dongle
(with another IP address) and re-reads some of the chapter. That will equal two readers, not one. We have no way
of calculating how many times this situation arises, but to be on the safe side we subtract 5%
from the final number.
We then take half of the "exaggeration factor" from step 2 and substract from the final number. We do this for no rational reason. We do it only as a further measure to be certain that our number of readers is not inflated.
To qualify as a reader who has read our whole encyclopedia - much the same way you read a printed book - that person must have qualified as a reader (cf. 1-6 above) of at least 80% of the encyclopedia chapters.
As a result, we have eliminated everything from automated requests to the more casual visitors. That leaves us with what we can safely call readers.
User-contributed notes
Give us your opinion! Do you have any comments/additions that you would like other visitors to see?
Add a thoughtful commentary or note to this page !
Changes to this page (conference)
06 Oct 2010: Conference Proceedings was edited (approved by an editor) 28 May 2003: Added the conference to the bibliography
Page Information
Page maintainer: How to cite/reference this page
URL: http://www.interaction-design.org/references/conferences/proceedings_of_the_acm_chi_83_human_factors_in_computing_systems_conferenc.html
“
Once the product's task is known, design the interface first; then implement to the interface design..... As far as the customer is concerned, the interface is the the product.
”
-- Jef Raskin, Cited by Malcolm McCullough in Digital Ground, 2004
Authoritative overview of End-User Development (EUD) including 4 HD video interviews filmed in Rome, Italy. EUD is really all about democratization of computing.
