PHPCrawl webcrawler library for PHP
Extracted Page: http://phpcrawl.cuab.de/example.html
Tutorial: Example Script
The following code is a simple example of using phpcrawl.
The listed script just "spiders" some pages of www.php.net until a traffic-limit of 1 mb is reached and prints out some information about all found documents.
Please note that this example-script (and others) also comes in a file called "example.php" with the phpcrawl-package. It's recommended to run it from the commandline (php CLI).
// It may take a whils to crawl a site ...
// Inculde the phpcrawl-mainclass
Additional text has been truncated due to copyright reasons. Things without URLs and private things don't get truncated.