Two interesting references, the first on Multimodal analysis, listen Nico 🙂 :

– Kress, G and Van Leeuwen, T. multimodal discourse: the modes and media of contemporary communication. New York: Oxford University Press, 2001.

– Batonio, A., Kahn, J. and Decortis, F. Travelling narratives as a multi-sensorial experience: A user-centered approach to smart objects. Proceeding of Smart Objects Conference, Grenoble, 2003.