User-agent: * Disallow: /admin/ Disallow: /agent/ Disallow: /test/ Disallow: /t_admin/ Disallow: /customer/