Microsoft launches a new robots.txt tester tool for Bingrobots.txt is a file on the domain/subdomain that informs robots/crawlers/spiders which sections of a website should not be processed or scanned.Daniel RijoSep 7, 2020Sign up to like postSubscribeLoginPrivacyTermsInformation collection noticeShare nullThis post is for paying subscribersSubscribeAlready a paying subscriber? Sign in