Loading...

Enhancing focused crawling with genetic algorithms

Shokouhi, M ; Sharif University of Technology | 2005

184 Viewed
  1. Type of Document: Article
  2. DOI: 10.1109/itcc.2005.145
  3. Publisher: Institute of Electrical and Electronics Engineers Inc , 2005
  4. Abstract:
  5. Web crawlers are one of the most crucial components in search engines and their optimization would have a great effect on improving the searching efficiency. In this paper, we introduce an intelligent crawler called Gcrawler that uses a genetic algorithm for improving its crawling performance. Gcrawler estimates the best path for crawling on one hand and expands its initial keywords by using a genetic algorithm during the crawling on the other hand. This is the first crawler that acts intelligently without any relevance feedback or training. All the processes are online and there is no need for direct interaction with the users. © 2005 IEEE
  6. Keywords:
  7. Algorithms ; Feedback ; Optimization ; Personnel training ; Search engines ; Gcrawlers ; Intelligent crawlers ; Searching efficiency ; Web crawlers ; Genetic algorithms
  8. Source: ITCC 2005 - International Conference on Information Technology: Coding and Computing, Las Vegas, NV, 4 April 2005 through 6 April 2005 ; Volume 2 , 2005 , Pages 503-508 ; 0769523153 (ISBN); 9780769523156 (ISBN)
  9. URL: https://ieeexplore.ieee.org/document/1425193