7 Laravel packages tagged “crawler”

Most downloaded: spatie/crawler, with 21,532,470 downloads and 2,830 GitHub stars. Ranked by total downloads — use the controls below to sort by stars, most recently updated, or name.

spatie/crawler

Crawl all internal links found on a website
2,830 21,532,470

jaybizzle/laravel-crawler-detect

A Laravel package to detect web crawlers via the user agent
326 2,956,107

vlados/laravel-blade-crawler-detect

Boost Lighthouse and PageSpeed scores by hiding cookie banners, chat widgets and heavy scripts from crawlers via two Blade directives. Octane-safe.
5,912

kaishiyoku/hera-rss-crawler

Modern library to handle RSS/Atom feeds
2 4,592

alrik11es/scrappy

A free proxy list based downloader for your crawling projects in PHP
1 2,224

hissezhaut/laravel-link-checker

Check all links in a Laravel app
16

abelhalo/zolcrawler

Zol Crawler
12