Dynamic Load Balancing Model: Preliminary Results for Parallel Pseudo-search Engine Indexers Crawler Mechanisms Using MPI and Genetic Programming

Created by W.Langdon from gp-bibliography.bib Revision:1.4333

  author =       "Reginald L. Walker",
  title =        "Dynamic Load Balancing Model: Preliminary Results for
                 Parallel Pseudo-search Engine Indexers Crawler
                 Mechanisms Using {MPI} and Genetic Programming",
  year =         "2001",
  booktitle =    "4th International Conference on Vector and Parallel
                 Processing - VECPAR 2000. Selected Papers and Invited
  editor =       "J. M. L. M. Palma and J. Dongarra and V. Hernandez",
  volume =       "1981",
  series =       "Lecture Notes in Computer Science",
  pages =        "61--74",
  address =      "Porto, Portugal",
  month =        "21-23 " # jun,
  publisher =    "Springer",
  keywords =     "genetic algorithms, genetic programming",
  CODEN =        "LNCSD9",
  ISSN =         "0302-9743",
  bibdate =      "Sat Feb 2 13:03:02 MST 2002",
  DOI =          "doi:10.1007/3-540-44942-6_5",
  acknowledgement = ack-nhfb,
  isbn13 =       "978-3-540-41999-0",
  abstract =     "Methodologies derived from Genetic Programming (GP)
                 and Knowledge Discovery in Databases (KDD) were used in
                 the parallel implementation of the indexer simulator to
                 emulate the current World Wide Web (WWW) search engine
                 indexers. This indexer followed the indexing strategies
                 that were employed by AltaVista and Inktomi that index
                 each word in each Web document. The insights gained
                 from the initial implementation of this simulator have
                 resulted in the initial phase of the adaption of a
                 biological model. The biological model will offer a
                 basis for future developments associated with an
                 integrated Pseudo-Search Engine. The basic
                 characteristics exhibited by the model will be
                 translated so as to develop a model of an integrated
                 search engine using GP. The evolutionary processes
                 exhibited by this biological model will not only
                 provide mechanisms for the storage, processing, and
                 retrieval of valuable information but also for Web
                 crawlers, as well as for an advanced communication
                 system. The current Pseudo-Search Engine Indexer,
                 capable of organizing limited subsets of Web documents,
                 provides a foundation for the first simulator of this
                 model. Adaptation of the model for the refinement of
                 the Pseudo-Search Engine establishes order in the
                 inherent interactions between the indexer, crawler and
                 browser mechanisms by including the social
                 (hierarchical) structure and simulated behavior of this
                 complex system. The simulation of behavior will
                 engender mechanisms that are controlled and coordinated
                 in their various levels of complexity. This unique
                 model will also provide a foundation for an
                 evolutionary expansion of the search engine as WWW
                 documents continue to grow. The simulator results were
                 generated using Message Passing Interface (MPI) on a
                 network of SUN workstations and an IBM SP2 computer

Genetic Programming entries for Reginald L Walker