New

Just launched: Vueblocks, a brand-new search engine for Vue packages! Explore Vueblocks →

12 Laravel packages tagged “crawler”

Most downloaded: spatie/crawler, with 23,104,003 downloads and 2,828 GitHub stars. Ranked by total downloads — use the controls below to sort by stars, most recently updated, or name.

spatie/crawler

Crawl all internal links found on a website
2,828 23,104,003

jaybizzle/laravel-crawler-detect

A Laravel package to detect web crawlers via the user agent
326 3,093,515

lobotomised/laravel-autocrawler

A tool to crawl your own laravel installation checking your HTTP status codes
2 44,935

vlados/laravel-blade-crawler-detect

Boost Lighthouse and PageSpeed scores by hiding cookie banners, chat widgets and heavy scripts from crawlers via two Blade directives. Octane-safe.
5,978

kaishiyoku/hera-rss-crawler

Modern library to handle RSS/Atom feeds
2 4,670

acanto/crawler

Crawl all internal links found on a website
2,921

alrik11es/scrappy

A free proxy list based downloader for your crawling projects in PHP
1 2,224

jayanta/laravel-ai-guard

Protect your Laravel app from AI scrapers, LLM crawlers, and prompt injection attacks
4 1,417

tfd/laravel-well-known-traffic-advice

A Laravel package that provides a standardized .well-known/traffic-advice endpoint for communicating server load, maintenance windows, and access recommendations to automated clients, crawlers, and partner services.
1,334

mkopcic/laravel-bot-protection

Laravel middleware za blokiranje AI crawlera i tražilica. Auto-registracija, konfigurabilan, podržava Laravel 10/11/12/13.
2 1,011

hissezhaut/laravel-link-checker

Check all links in a Laravel app
16

abelhalo/zolcrawler

Zol Crawler
12