# Allow Google, Yahoo (Slurp), Ask Jeeves, MSN (msnbot) and Blekko (ScoutJet) User-agent: googlebot User-agent: Mediapartners-Google* User-agent: Slurp User-agent: Ask Jeeves User-agent: msnbot User-agent: ScoutJet Disallow: /ext/ Disallow: /public/forgotPassword Disallow: /public/invitation/ Disallow: /public/login/ Disallow: /public/reg/ Disallow: /public/reg/signup/ Disallow: /public/searchCompanion/ Disallow: /public/sforce/ Disallow: /public/verifyLoginChange Disallow: /secure/ Disallow: /shared/ Disallow: /view/ # Block crawling by default User-agent: * Disallow: /