@ahrefs’s tweet
@ahrefs @joshuaziering added to robots.txt 2d ago:User-Agent: AhrefsBotCrawl-Delay: 3600bots ignored. thus blocked.
View
Conversation
on Twitter