Responsive information architect: A context-sensitive multimedia conversation framework for information seeking

Various aspects of the context-sensitive framework, Responsive Information Architect (RIA), are discussed. RIA allows users to express their information requests flexibly using a mixture of input modalities, including speech, text, and gesture. RIA is capable of understanding user inputs, including complex data queries, abbreviated inquiries, and imprecise requests. It can also help users to refine queries by indicating the most effective navigation path. RIA automatically synthesizes a multimedia tour of information on the fly using graphics, speech, and video.