PHP-Crawler

From HandWiki - Reading time: 1 min

Short description: Open-source crawling script
PHP-Crawler
Developer(s)Vlad Fedorkov[1]
Initial release9 January 2006; 18 years ago (2006-01-09)
Preview release
0.8 / 25 July 2007; 16 years ago (2007-07-25)
Written inPHP
Available inEnglish
TypeWeb crawler
LicenseBSD License
Websiteastellar.com/php-crawler/

PHP-Crawler is an open-source crawling script based on PHP and MySQL. Created to implement simple as possible local website search it became popular for small websites on shared hosting. Script set is distributed under the terms of BSD License.

Features

  • Full text search support via MySQL FT indexes
  • As a general PHP script it allows running crawler manually from browser, requires no SSH access to the hosting.
  • Crawling is limited by depth setting or amount
  • Following "href=" links on web page, in HTML or JavaScripts

Requirements

External links

References





Licensed under CC BY-SA 3.0 | Source: https://handwiki.org/wiki/Software:PHP-Crawler
8 views | Status: cached on July 19 2024 13:36:00
↧ Download this article as ZWI file
Encyclosphere.org EncycloReader is supported by the EncyclosphereKSF