Check basic publisher files on a public domain.

Review whether robots.txt and ads.txt are reachable, whether robots.txt lists a sitemap, and whether ads.txt contains expected-looking publisher lines.