Saturday May 18, 2024

Sphider: PHP Spider & Search Engine
  Posted by: AceBHound on Feb 27th, 2006 10:57 AM
I have been using Sphider for quite a while now and it has worked out wonderfully. Unfortunately as with many web hosts mine does not have ht://dig which I had previously used for my search engine needs. I tried a few open-source CGI search engines, but a majority of them only process the files in the filesystem and not the dynamically generated pages. I then attempted to use PHPDig, which claimed to be a slower PHP/MySQL-based search engine, but it was very buggy and pretty much unusable as a search engine during my attempts last year. Thankfully a few months later I stumbled across Sphider, which is a great PHP/MySQL solution for websites with less than 20,000 pages. It indexes dynamically generated pages adequately. Although nothing compares to the speed of spidering software like HTDIG, Sphider is still pretty quick, taking just a few minutes to fully index this site.

View More Techdose Articles