Posted by Herbert König on Sep 13, 2012; 9:44am
URL: https://forum.world.st/How-to-serve-a-robots-txt-tp4647251.html

Hi,

how do I serve a robots.txt to tell web crawlers which links to
follow?

How do I give it the correct URL?

Thanks,

Herbert                          mailto:[hidden email]

_______________________________________________
Aida mailing list
[hidden email]
http://lists.aidaweb.si/mailman/listinfo/aida