Crawler

💫 Crawl urls from a webpage and provide a DomCrawler with Scraper Library.

DomCrawler

Scraper use DomCrawler library. This is symfony component for DOM navigation for HTML and XML documents. You can retrieve Documentation Here.

Installation

composer require mediashare/crawler
1

Usage

<?php
require 'vendor/autoload.php';

use Mediashare\Crawler\Crawler;

$crawler = new Crawler("http://marquand.pro");
$crawler->run();
dump($crawler);
1
2
3
4
5
6
7
8
With Config
<?php
require 'vendor/autoload.php';

use Mediashare\Crawler\Crawler;
use Mediashare\Crawler\Config;

$config = new Config();
$config->setWebspider(true); // All website crawling
$config->setVerbose(true); // Prompt progress bar

$crawler = new Crawler("http://marquand.pro", $config);
$crawler->run();
dump($crawler);
1
2
3
4
5
6
7
8
9
10
11
12
13
Last Updated: 12/25/2019, 1:17:10 AM