Interpretation of human activity is primarily known from surveillance and video analysis tasks and concerned with the persons alone. In this paper we present an integrated system that gives a natural language interpretation of activities where a person handles objects. The system integrates low-level image components such as hand and object tracking, detection and recognition, with high-level processes such as spatio-temporal object relationship generation, posture and gesture recognition, and activity reasoning. A task-oriented approach focuses processing to achieve near real-time and to react depending on the situation context.
['Markus Vincze', 'Michael Zillich', 'Wolfgang Ponweiser', 'Václav Hlaváč', 'Jiri Matas', 'Stepan Obdrzalek', 'Hilary Buxton', 'A. Jonathan Howell', 'Kingsley Sage', 'Antonis A. Argyros', 'Christof Eberst', 'Gerald Umgeher']
Integrated vision system for the semantic interpretation of activities where a person handles objects