5855338
The development of cooperation: five years of participatory design in the virtual school
During the past five years, our research group worked with a group of public school teachers to define, develop, and assess network-based support for collaborative learning in middle school physical science and high school physics. From the outset, we committed to a participatory design approach. This design collaboration has now existed far longer than is typical of participatory design endeavors, particularly in North America. The nature of our interactions, and in particular the nature of the role played by the teachers has changed significantly through the course of the project. We suggest that there may be a long-term developmental unfolding of roles and relationships in participatory design.
14643603
Making use is more than a matter of task analysis
I am pleased and honored that such an impressive group of commentators considered my book Making Use (Carroll, 2000) worthy of discussion and analysis. I would not expect, nor even prefer really, to have everyone agree with me. What would bother me, what would bother any author, is to not be read at all. Dan Diaper’s critical review and the commentaries by David Benyon/Catriona Macaulay, Tom Carey, and Fabio Paterno, will help to make that less likely! Many important themes are raised in Diaper (2002) review and in the commentaries. In this response I want to concentrate on refining a few of the main issues and distinctions. First, I briefly consider contrasts in values. I think that preferences for scenario-based design versus traditional task analytic methods reflect differences in the underlying world views and values of designers and researchers. To some extent, therefore, the issues in this discussion are not just technical, but paradigmatic and moral. Second, I consider the state of design practices in HCI and its implications for where onus lies in contemporary methodological argumentation and for what sorts of data are pertinent and required to address outstanding methodological issues. Finally, I consider the question of how task analysis, in the sense of structured task decomposition, might be reconstructed in the emerging paradigm of scenario-based design.
1921535
Interface design issues for advice-giving expert systems
Advice giving could become the first successful domain for intelligent interfaces.
1566611
Managing evaluation goals for training
goals and are characteristically underresourced. In this article, we describe a framework for managing training evaluation in such contexts. We illustrate by example the feasibility of taking a broad approach toward training evaluation. Scriven [21] introduced the terms formative and summative in his classic work on the objectives and processes of instructional evaluation. Formative evaluation seeks to identify aspects of a design that can be improved. A typical implementation would be having users think aloud as they work through a tutorial to produce a real-time commentary on the nature of the learning experience. Each comment is tightly coupled to a specific design feature, facilitating the identification of problems and reasoning about design solutions. Summative evaluation seeks to gauge a design product. A typical implementation would be measuring time-on-task and error rate to guide decision-making about whether a training system (or the software it supports) should be produced and marketed, or purchased. Formative evaluation work succeeds to the extent that it identifies priorities for redesign and refinement, and all the more to the extent that it provides concrete guidance as to how that redesign and refinement should be executed. Summative evaluation work succeeds to the extent that it allows a design product to be located on various measurement scales with respect to other design products; the stronger the scale (i.e., ratio scale versus interval scale versus ordinal scale versus nominal scale), the better the summative evaluation. Scriven [21] also distinguished two basic types of evaluation method, intrinsic and pay-off :
148806746
Human-computer interaction: psychology as a science of design.
7723669
Better home shopping or new democracy?: evaluating community network outcomes
This is a perspective paper on community networks - socio-technical infrastructures supporting villages, towns, and neighborhoods. Community networking is well-established, world wide, and addresses critical societal issues, such as the “crisis of community” and the sociality of the Internet. However, community network projects have not emphasized evaluation. Relatively little is known about the economic, social, and psychological consequences of community networks for the individuals, groups, and communities served. Evaluating community networks is a momentous mutual opportunity for the development of CHI evaluation methodologies and for bringing technical CHI expertise to bear on societal issues.
1970300
Acting out the future: a process for envisionment
It is difficult to design innovative information and communication technologies to meet needs that will emerge from future interactions between users, technologies and their situations of use. We have been using scenarios that are acted out as a way of envisioning the future. This paper describes some of the core dilemmas of innovative design. It draws on our existing work as well as ideas from a range of disciplines to present a ‘light’ but useful envisionment process that may be applied to commercial design problems.
15057511
Completing design in use: closing the appropriation cycle
Users appropriate a technology innovation as they adapt and adapt to its capabilities. This paper argues that the appropriation of technology innovations – information and communication technologies such as devices and systems – is actually part of the design process. The design of a technology innovation is completed by users as they appropriate it. The contributions of the paper are to draw attention to the crucial role played by users’ actions in completing the design process and to examine the implications for the design and implementation of technology innovations. The challenge for designers is to design malleable technologies that can be adapted to users’ organisational, social and personal practices, and then to harvest users’ needs from the appropriated innovation in order to improve its design. For managers, trainers and IS staff involved in the implementation of innovations, the challenge is to encourage and support users’ appropriation activities.
131770741
Structured Case: A Methodological Framework for Building Theory in Information Systems Research
This paper presents a methodological framework, structured-case, that assists IS researchers to undertake and assess theory building research within the interpretive paradigm, and explains its value in achieving convincing explanations that are strongly linked to both the research themes and data collected in the field.
10894513
Block-Level Consistency of Replicated Files
8413372
Relating Complexity to Practical Performance in Parsing with Wide-Coverage Unification Grammars
The paper demonstrates that exponential complexities with respect to grammar size and input length have little impact on the performance of three unification-based parsing algorithms, using a wide-coverage grammar. The results imply that the study and optimisation of unification-based parsing must rely on empirical data until complexity theory can more accurately predict the practical behaviour of such parsers1.