1 Laravel package tagged “robots-txt”
Most downloaded: spatie/robots-txt, with 20,877,839 downloads and 258 GitHub stars.
spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
258
20,877,839