# pt wib -- just crawl it. User-agent: * Disallow: */wb User-agent: Baiduspider Disallow: */wb User-agent: HaoSouSpider Disallow: */wb User-agent: Sogou web spider Disallow: */wb User-agent: Sogou inst spider Disallow: */wb User-agent: Sogou spider2 Disallow: */wb