#Robots indexing exclusion User-agent: * #disallow interview detail to avoid duplicate Disallow: /en/pub/detail.jsp #disallow user area Disallow: /en/biz/user/ Disallow: /en/common/user/ Disallow: /en/ind/user/ Disallow: /zh/biz/user/ Disallow: /zh/common/user/ Disallow: /zh/ind/user/ User-agent: baiduspider #disallow interview detail to avoid duplicate Disallow: /en/pub/detail.jsp #disallow user area Disallow: /en/biz/user/ Disallow: /en/common/user/ Disallow: /en/ind/user/ Disallow: /zh/biz/user/ Disallow: /zh/common/user/ Disallow: /zh/ind/user/ Disallow: /sp/zh/public/pastPublicEvents Sitemap: /sitemap.xml