# robots.txt for http://www.example.com/ User-agent: seekbot User-agent: psbot user-agent: thesubot user-agent: snapbot user-agent: SnapBot/1 user-agent: TheSuBot/0.1(www.thesubot.de) Disallow: /