istributed Object Space Cluster Architecture for Search Engines
Ben Choi & Rohit Dhawan
Computer Science, College of Engineering and
Science
Louisiana Tech University, Ruston,
LA 71272,
USA
pro@BenChoi.org
Abstract: In this paper we propose a new cluster architecture for parallel and distributed computing called Agent Space Architecture. Our architecture builds upon the notions of Agent and Object Space and utilizes Multicast Network. The building blocks for our proposed architecture consist of an active processing unit called Agent, a shared place for communication call Space, and a communication medium called Multicast Network. One unique feature of our architecture is that we extend the concept of Object Space to become an Active Space. Our Active Space functions as a rendezvous, a repository, a cache, a responder, a notifier, and a manager of its own resources. The organization of our architecture is as general as network topology. Any number of Agents, Spaces, or Networks can be added. High performance of the architecture is achieved by simply adding more Agents, Spaces, or Networks. Another feature for high performance is the result of using Space as cache. This results in reducing repeated computations and response times comparing to the original concept of Object Space. Our architecture is as scalable as Ethernet and adding Agents or Spaces is as easy as plug and play. High availability and fault tolerance is achieved through multiple Agents, Spaces, and Networks. All these features are particularly beneficial for challenging applications such as Search Engines.
Full Paper: