PHP-Crawler

Short description: Open-source crawling script

PHP-CrawlerDeveloper(s)| Vlad Fedorkov[1]

|

Initial release| 9 January 2006; 20 years ago (2006-01-09)
Preview release|

0.8 / 25 July 2007; 18 years ago (2007-07-25)

Written in| PHP
Available in| English
Type| Web crawler
License| BSD License
Website| astellar.com/php-crawler/

PHP-Crawler is an open-source crawling script based on PHP and MySQL. Created to implement simple as possible local website search it became popular for small websites on shared hosting. Script set is distributed under the terms of BSD License.

## Contents

* 1 Features
* 2 Requirements
* 3 External links
* 4 References

## Features

* Full text search support via MySQL FT indexes
* As a general PHP script it allows running crawler manually from browser, requires no SSH access to the hosting.
* Crawling is limited by depth setting or amount
* Following "href=" links on web page, in HTML or JavaScripts

## Requirements

* PHP 4.3.10+
* MySQL 3.23.56+

## External links

* Official website
* PHP-Crawler on SourceForge.net

## References

1. ↑ "Vlad Fedorkov". http://astellar.com/about/.

* v
* t
* e

Web crawlers

Internet bots designed for Web crawling and Web indexing

Active|

* 80legs
* bingbot
* Fetcher
* Googlebot
* Heritrix
* HTTrack
* Pandemonium_(Webcrawler)
* PHP-Crawler
* PowerMapper
* Wget

Discontinued|

* FAST Crawler
* msnbot
* RBSE
* TkWWW robot
* Twiceler
* Yahoo! Slurp

Types|

* Distributed web crawler
* Focused crawler
* ICDL crawler

0.00

(0 votes)

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Software:PHP-Crawler&oldid=763149"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template