banner
[求助] robots文件
2017-12-02 06:54
来源:未知
点击数:           

拿去用


  1. User-agent: Baiduspider
  2. Allow: /$
  3. Disallow: /*

  4. User-agent: Baiduspider-image
  5. Allow: /$
  6. Disallow: /*

  7. User-agent: Baiduspider-news
  8. Allow: /$
  9. Disallow: /*

  10. User-agent: Googlebot
  11. Disallow: /user/
  12. Disallow: /group/
  13. Disallow: /?*
  14. Disallow: /*?*

  15. User-agent: MSNBot
  16. Disallow: /user/
  17. Disallow: /group/
  18. Disallow: /?*
  19. Disallow: /*?*

  20. User-agent: YoudaoBot
  21. Disallow: /user/
  22. Disallow: /group/
  23. Disallow: /?*
  24. Disallow: /*?*

  25. User-agent: Sogou web spider
  26. Disallow: /user/
  27. Disallow: /group/
  28. Disallow: /?*
  29. Disallow: /*?*

  30. User-agent: Sogou inst spider
  31. Disallow: /user/
  32. Disallow: /group/
  33. Disallow: /?*
  34. Disallow: /*?*

  35. User-agent: Sogou spider2
  36. Disallow: /user/
  37. Disallow: /group/
  38. Disallow: /?*
  39. Disallow: /*?*

  40. User-agent: Sogou blog
  41. Disallow: /user/
  42. Disallow: /group/
  43. Disallow: /?*
  44. Disallow: /*?*

  45. User-agent: Sogou News Spider
  46. Disallow: /user/
  47. Disallow: /group/
  48. Disallow: /?*
  49. Disallow: /*?*

  50. User-agent: Sogou Orion spider
  51. Disallow: /user/
  52. Disallow: /group/
  53. Disallow: /?*
  54. Disallow: /*?*

  55. User-agent: ChinasoSpider
  56. Disallow: /user/
  57. Disallow: /group/
  58. Disallow: /?*
  59. Disallow: /*?*

  60. User-agent: Sosospider
  61. Disallow: /user/
  62. Disallow: /group/
  63. Disallow: /?*
  64. Disallow: /*?*

  65. User-agent: yisouspider
  66. Disallow: /user/
  67. Disallow: /group/
  68. Disallow: /?*
  69. Disallow: /*?*

  70. User-agent: EasouSpider
  71. Disallow: /user/
  72. Disallow: /group/
  73. Disallow: /?*
  74. Disallow: /*?*

  75. User-agent: 360Spider
  76. Disallow: /user/
  77. Disallow: /group/
  78. Disallow: /?*
  79. Disallow: /*?*


  80. User-Agent: *
  81. Disallow: /
复制代码


Copyright © 2003-2015 All rights reserved.http://www.gzyf88.com1378kj开奖中心|118kj开奖现场手机版118.一丿|白小姐六合_2018官网版权所有