1921535
Interface design issues for advice-giving expert systems
Advice giving could become the first successful domain for intelligent interfaces.
2269827
Training wheels in a user interface
New users of high-function application systems can become frustrated and confused by the errors they make in the early stages of learning. A training interface for a commercial word processor was designed to make typical and troublesome error states “unreachable,” thus eliminating the sources of some new-user learning problems. Creating a training environment from the basic function of the system itself afforded substantially faster learning coupled with better learning achievement and better performance on a comprehension post-test. A control group spent almost a quarter of their time recovering from the error states that the training interface blocked off. We speculate on how this training strategy might be refined, and more generally, on how function should be organized in a user interface.
15595014
Notification and awareness: synchronizing task-oriented collaborative activity
People working collaboratively must establish and maintain awareness of one another's intentions, actions and results. Notification systems typically support awareness of the presence, tasks and actions of collaborators, but they do not adequately support awareness of persistent and complex activities. We analysed awareness breakdowns in use of our Virtual School system--stemming from problems related to the collaborative situation, group, task and tool support--to motivate the concept of activity awareness. Activity awareness builds on prior conceptions of social and action awareness, but emphasizes the importance of activity context factors like planning and coordination. This work suggests design strategies for notification systems to better support collaborative activity.
7151657
Making use: a design representation
16127213
Supporting interactive collaboration on the Web with CORK
Abstract The World Wide Web has served as a medium for collaboration since its inception. Web-based collaboration has, however, been dominated by systems supporting asynchronous activities such as sharing documents and participating in discussion forums. Supporting interactive, synchronous collaboration on the Web has proven much more challenging. In this paper we describe three of the challenges encountered in the context of supporting network-based collaboration among middle and high school science students: integrating synchronous and asynchronous modes of interaction, minimizing consumption of bandwidth, and adapting non-collaborative software components for collaborative use. We then present the Content Object Replication Kit, a toolkit for building interactive Java-based collaborative systems for use on the Web.
1566611
Managing evaluation goals for training
goals and are characteristically underresourced. In this article, we describe a framework for managing training evaluation in such contexts. We illustrate by example the feasibility of taking a broad approach toward training evaluation. Scriven [21] introduced the terms formative and summative in his classic work on the objectives and processes of instructional evaluation. Formative evaluation seeks to identify aspects of a design that can be improved. A typical implementation would be having users think aloud as they work through a tutorial to produce a real-time commentary on the nature of the learning experience. Each comment is tightly coupled to a specific design feature, facilitating the identification of problems and reasoning about design solutions. Summative evaluation seeks to gauge a design product. A typical implementation would be measuring time-on-task and error rate to guide decision-making about whether a training system (or the software it supports) should be produced and marketed, or purchased. Formative evaluation work succeeds to the extent that it identifies priorities for redesign and refinement, and all the more to the extent that it provides concrete guidance as to how that redesign and refinement should be executed. Summative evaluation work succeeds to the extent that it allows a design product to be located on various measurement scales with respect to other design products; the stronger the scale (i.e., ratio scale versus interval scale versus ordinal scale versus nominal scale), the better the summative evaluation. Scriven [21] also distinguished two basic types of evaluation method, intrinsic and pay-off :
257038
Apportioning Development Effort in a Probabilistic LR Parsing System Through Evaluation
We describe an implemented system for robust domain-independent syntactic parsing of English, using a unification-based grammar of part-ofspeech and punctuation labels coupled with a probabilistic LR parser. We present evaluations of the system’s performance along several different dimensions; these enable us to assess the contribution that each individual part is making to the success of the system as a whole, and thus prioritise the effort to be devoted to its further enhancement. Currently, the system is able to parse around 80% of sentences in a substantial corpus of general text containing a number of distinct genres. On a random sample of 250 such sentences the system has a mean crossing bracket rate of 0.71 and recall and precision of 83% and 84% respectively when evaluated against manually-disambiguated analyses.
14571844
The process of ISD methodology selection and use: a case study
This paper provides empirically-based explanations for the observed low, and partial, use of information systems development (ISD) methodologies. The research reported in this paper examines the process of methodology selection and use in an intensive field study of the early stages of systems development and notes ongoing adaptation of methodologies in response to changing contingencies. The paper concludes that, in many circumstances, methodology adaptation is a necessary part of successful systems development. It also suggests that deeper understanding of the attitudes of different stakeholders to selecting and using ISD methodologies may help to explain this adaptation.
45352
A Practical Approach to Multiple Default Inheritance for Unification-Based Lexicons
This paper describes a unification-based lexicon system for NLP applications that incorporates mechanisms for multiple default inheritance. Such systems are intractable in the general case---the approach adopted here places a number of restrictions on the inheritance hierarchy in order to remove some of the sources of complexity while retaining more desirable properties. Implications of the design choices are discussed, comparisons are drawn with related work in computational linguistics and AI, and illustrative examples from the lexicons of German and English are given.
11544923
Unparsing RDF/XML
It is difficult to serialize an RDF graph as a humanly readable RDF/XML document. This paper describes the approach taken in Jena 1.2, in which a design pattern of guarded procedures invoked using top down recursive descent is used. Each procedure corresponds to a grammar rule; the guard makes the choice about the applicability of the production. This approach is seen to correspond closely to the design of an LL(k) parser, and a theoretical justification of this correspondence is found in universal algebra.
3131824
From RAGS to RICHES: Exploiting the Potential of a Flexible Generation Architecture
The RAGS proposals for generic specification of NLG systems includes a detailed account of data representation, but only an outline view of processing aspects. In this paper we introduce a modular processing architecture with a concrete implementation which aims to meet the RAGS goals of transparency and reusability. We illustrate the model with the RICHES system -- a generation system built from simple linguistically-motivated modules.