An architecture for SCS: A specialized web crawler on the topic of security


Ozmutlu H. C., Ozmutlu S.

67th Annual Meeting of the American-Society-for-Information-Science-and-Technology, Rhode Island, Amerika Birleşik Devletleri, 12 - 17 Kasım 2004, cilt.41, ss.317-326 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 41
  • Doi Numarası: 10.1002/meet.1450410138
  • Basıldığı Şehir: Rhode Island
  • Basıldığı Ülke: Amerika Birleşik Devletleri
  • Sayfa Sayıları: ss.317-326
  • Bursa Uludağ Üniversitesi Adresli: Evet

Özet

Mining for correct and relevant information in the World Wide Web is a difficult task, handled by Web crawlers. This study outlines the components of a specialized crawler on the topic of security (SCS) that heavily makes use of artificial neural networks and rule-based expert systems to establish successful focused crawling on the topic of security. SCS is designed to find, index and follow the updates of Web pages of interest, and proposes new approaches for reaching relevant pages, which might stay hidden to other crawling approaches. SCS consists of four new page explorers, a database of relevant pages, a relevance evaluator using artificial neural networks and an updater using rule-based expert systems. SCS is a multi-threaded multi-object Java Applet and Application combination with embedded SOL and PHP elements and is applicable on single or multiple machines through parallel processing with its expandable and modular structure.