Task-based development of multimodal user interfaces using environmental context information

Abstract

As the era of real ambient intelligence comes closer, the need for a flexible design and runtime process able to exploit the added value of such heterogeneous environments emerges. One of these added values is the diversity of modalities supported by the different available devices. This paper discusses a task-based design process for multimodal user interfaces suitable for multi-device ambient intelligent environments. The approach is based on an ontology describing devices in the nearby interaction environment. Based on this ontology the user interface designer is able to annotate individual tasks in the task model with device requirements needed for executing the task successfully. To assist the design process, we have extended our model-based design tool, DynaMo-AID.