Loading...

A hybrid approach for refreshing web page repositories

Ghodsi, M ; Sharif University of Technology | 2005

157 Viewed
  1. Type of Document: Article
  2. DOI: 10.1007/11408079_54
  3. Publisher: Springer Verlag , 2005
  4. Abstract:
  5. Web pages change frequently and thus crawlers have to down-load them often. Various policies have been proposed for refreshing local copies of web pages. In this paper, we introduce a new sampling method that excels over other change detection methods in experiment. Change Frequency (CF) is a method that predicts the change frequency of the pages and, in the long run, achieves an optimal efficiency in comparison with the sampling method. Here, we propose a new hybrid method that is a combination of our new sampling approach and CF and show how our hybrid method improves the efficiency of change detection. © Springer-Verlag Berlin Heidelberg 2005
  6. Keywords:
  7. Frequencies ; Public policy ; Sampling ; Change detection ; Change frequency (CF) ; Hybrid methods ; Websites
  8. Source: 10th International Conference on Database Systems for Advanced Applications, DASFAA 2005, Beijing, 17 April 2005 through 20 April 2005 ; Volume 3453 , 2005 , Pages 588-593 ; 03029743 (ISSN)
  9. URL: https://link.springer.com/chapter/10.1007/11408079_54