A general vision problem solving architecture: Hierarchical token grouping

Both modularity and integration are indispensable aspects of vision problem solving. A set of tools for a set of problems has to be effectively integrated to achieve an overall solution. We propose a formalism called hierarchical token grouping (HTG) for such an integration purpose. A formalism is developed that establishes a consistent and systematic framework for integrating modules, cues, and knowledge, all in a globally coherent mechanism.