spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
258
19,079,983