crwawlstop as sitemap in robots.txt
A friend's website uses cloudflare and it created a robots.txt that only lists this as its sitemap - won't that prevent further crawling? (Its a wordpress / woocommerce site)
Sitemap: https://www.crawlstop.com/sitemap.xml
u/IamZenweezil — 13 days ago