An essential aspect of mobile and ubiquitous computing research is evaluation within the expected usage context, including environment. When that environment is an urban center, it can be dynamic, expansive, and unpredictable. Methodologies that focus on genuine use in the environment can uncover valuable insights, although they may also limit measurement and control. In this paper, we present our experiences applying traditional experimental techniques for field research in two separate projects set in urban environments. We argue that although traditional methods may be difficult to apply in cities, the challenges are surmountable, and this kind of field research can be a crucial component of evaluation.
['Melanie Kellar', 'Derek F. Reilly', 'Kirstie Hawkey', 'Malcolm E. Rodgers', 'Bonnie MacKay', 'David Dearman', 'Vicki Ha', 'W. Joseph MacInnes', 'Michael N. Nunes', 'Karen Parker', 'Tara Whalen', 'Kori Inkpen']
It's a jungle out there: practical considerations for evaluation in the city