Barkrowler

Barkrowler蜘蛛/爬虫属于营销类型,由eXenSa开发运行。您可以继续阅读下方信息,以深入了解Barkrowler基本信息,用户代理和访问控制等。

基本信息

Barkrowler的基本信息如下表。但部分不是很规范的蜘蛛和爬虫,可能存在信息不明的情况。
蜘蛛/爬虫名称
Barkrowler
类型
营销
开发商
eXenSa
当前状态
活动

用户代理

关于Barkrowler蜘蛛或者爬虫的用户代理字符串,IP地址和服务器,所在地等信息如下表格所示:
BarkRowler/0.9
用户代理字符串
Mozilla/5.0 (compatible; BarkRowler/0.9; +https://babbar.tech/crawler)
首次出现
2020-07-01 10:56:44
最后出现
2020-07-03 06:17:07
遵循robots.txt
未知
来源
IP地址(2) 服务器名称 所属国家
212.129.50.243 driver-gp.exensa.net FR
195.154.94.66 vms5.exensa.net FR
用户代理字符串
Barkrowler/0.9 (+https://babbar.tech/crawler)
首次出现
2020-01-21 22:55:48
最后出现
2020-06-14 08:19:45
遵循robots.txt
未知
来源
IP地址(20) 服务器名称 所属国家
62.210.188.240 crawl-dev-1.babbar.eu FR
62.210.89.213 wdl-demo-2.babbar.eu FR
62.210.151.70 crawl-dev-2.babbar.eu FR
62.210.143.10 crawl-dev-4.babbar.eu FR
62.210.149.60 crawl-dev-3.babbar.eu FR
62.210.92.16 store-prod-1.babbar.eu FR
212.129.50.243 driver-gp.exensa.net FR
195.154.104.23 crawl-prod-9.babbar.eu FR
51.15.191.230 51-15-191-230.rev.poneytelecom.eu FR
51.15.191.97 crawl-prod-1.babbar.eu FR
用户代理字符串
BarkRowler/0.9 (+https://babbar.tech/crawler)
首次出现
2020-04-28 11:39:34
最后出现
2020-05-17 01:49:44
遵循robots.txt
未知
来源
IP地址(2) 服务器名称 所属国家
212.129.50.243 driver-gp.exensa.net FR
62.210.92.16 store-prod-1.babbar.eu FR
用户代理字符串
Barkrowler/0.9 (+http://www.exensa.com/crawl)
首次出现
2019-01-17 11:30:49
最后出现
2019-07-04 22:30:12
遵循robots.txt
未知
来源
IP地址(30) 服务器名称 所属国家
51.15.191.96 crawl-node-online-9.exensa.net FR
195.154.104.33 crawl-node-online-15.exensa.net FR
163.172.67.63 crawl-node-online-7.exensa.net FR
51.15.191.180 crawl-node-online-12.exensa.net FR
51.15.191.38 crawl-node-online-8.exensa.net FR
195.154.104.23 crawl-node-online-14.exensa.net FR
51.15.191.231 crawl-node-online-13.exensa.net FR
163.172.65.98 crawl-node-online-4.exensa.net FR
163.172.64.127 crawl-node-online-1.exensa.net FR
163.172.64.171 crawl-node-online-2.exensa.net FR
用户代理字符串
Barkrowler/0.9 ( http://www.exensa.com/crawl)
首次出现
2019-01-18 22:40:27
最后出现
2019-02-08 21:33:37
遵循robots.txt
未知
来源
IP地址(2) 服务器名称 所属国家
154.54.249.194 crawl-prodd4-2.babbar.eu US
154.54.249.206 ? US
154.54.249.203 ? US
154.54.249.201 crawl-prodd4-9.babbar.eu US
154.54.249.207 crawl-prodd4-15.babbar.eu US
154.54.249.196 crawl-prodd4-4.babbar.eu US
154.54.249.195 crawl-prodd4-3.babbar.eu ?
154.54.249.200 crawl-prodd4-8.babbar.eu US
154.54.249.205 crawl-prodd4-13.babbar.eu US
154.54.249.204 crawl-prodd4-12.babbar.eu US
217.113.194.162 c162.babbar.eu FR
217.113.194.183 c183.babbar.eu FR
217.113.194.187 c187.babbar.eu FR
217.113.194.171 c171.babbar.eu FR
217.113.194.154 c154.babbar.eu FR
217.113.194.141 c141.babbar.eu FR
217.113.194.173 c173.babbar.eu FR
217.113.194.182 c182.babbar.eu FR
217.113.194.165 c165.babbar.eu FR
217.113.194.143 c143.babbar.eu FR
212.129.50.243 driver-gp.exensa.net FR
195.154.94.66 vms5.exensa.net FR
62.210.188.240 crawl-dev-1.babbar.eu FR
62.210.89.213 wdl-demo-2.babbar.eu FR
62.210.151.70 crawl-dev-2.babbar.eu FR
62.210.143.10 crawl-dev-4.babbar.eu FR
62.210.149.60 crawl-dev-3.babbar.eu FR
62.210.92.16 store-prod-1.babbar.eu FR
195.154.104.23 crawl-node-online-14.exensa.net FR
51.15.191.230 51-15-191-230.rev.poneytelecom.eu FR
51.15.191.97 crawl-prod-1.babbar.eu FR
51.15.191.96 crawl-node-online-9.exensa.net FR
195.154.104.33 crawl-node-online-15.exensa.net FR
163.172.67.63 crawl-node-online-7.exensa.net FR
51.15.191.180 crawl-node-online-12.exensa.net FR
51.15.191.38 crawl-node-online-8.exensa.net FR
51.15.191.231 crawl-node-online-13.exensa.net FR
163.172.65.98 crawl-node-online-4.exensa.net FR
163.172.64.127 crawl-node-online-1.exensa.net FR
163.172.64.171 crawl-node-online-2.exensa.net FR
51.15.21.189 onode2.exensa.net NL
163.172.33.100 163-172-33-100.rev.poneytelecom.eu FR
217.113.194.237 c237.babbar.eu FR
217.113.194.240 c240.babbar.eu FR
217.113.194.2 c002.babbar.eu FR
217.113.194.15 c015.babbar.eu FR
217.113.194.53 c053.babbar.eu FR
154.54.249.18 crawl-dev-4.babbar.eu US
154.54.249.173 ? FR
154.54.249.15 crawl-dev-1.babbar.eu US
217.113.194.116 c116.babbar.eu FR
217.113.194.100 c100.babbar.eu FR
217.113.194.79 c079.babbar.eu FR
154.54.249.171 ? FR
154.54.249.169 154.54.249.169 FR
217.113.194.128 c128.babbar.eu FR
217.113.194.44 c044.babbar.eu FR
217.113.194.158 c158.babbar.eu FR
217.113.194.210 c210.babbar.eu FR
217.113.194.194 c194.babbar.eu FR
217.113.194.211 c211.babbar.eu FR
217.113.194.139 c139.babbar.eu FR
217.113.194.160 c160.babbar.eu FR
217.113.194.248 c248.babbar.eu FR
217.113.194.242 c242.babbar.eu FR
217.113.194.101 c101.babbar.eu FR
217.113.194.3 c003.babbar.eu FR
217.113.194.145 c145.babbar.eu FR
217.113.194.150 c150.babbar.eu FR
217.113.194.131 c131.babbar.eu FR
217.113.194.172 c172.babbar.eu FR
217.113.194.166 c166.babbar.eu FR
217.113.194.179 c179.babbar.eu FR
217.113.194.169 c169.babbar.eu FR
217.113.194.223 c223.babbar.eu FR
217.113.194.215 c215.babbar.eu FR
217.113.194.60 c060.babbar.eu FR
217.113.194.25 c025.babbar.eu FR
217.113.194.31 c031.babbar.eu FR
217.113.194.24 c024.babbar.eu FR
217.113.194.23 c023.babbar.eu FR
217.113.194.50 c050.babbar.eu FR
217.113.194.57 c057.babbar.eu FR
217.113.194.180 c180.babbar.eu FR
217.113.194.234 c234.babbar.eu FR
217.113.194.254 c254.babbar.eu FR
217.113.194.200 c200.babbar.eu FR
217.113.194.233 c233.babbar.eu FR
217.113.194.232 c232.babbar.eu FR
217.113.194.246 c246.babbar.eu FR
217.113.194.214 c214.babbar.eu FR
217.113.194.163 c163.babbar.eu FR
217.113.194.186 c186.babbar.eu FR
217.113.194.184 c184.babbar.eu FR
217.113.194.191 c191.babbar.eu FR
217.113.194.178 c178.babbar.eu FR
217.113.194.138 c138.babbar.eu FR
217.113.194.136 c136.babbar.eu FR
217.113.194.157 c157.babbar.eu FR
217.113.194.175 c175.babbar.eu FR
217.113.194.188 c188.babbar.eu FR
217.113.194.167 c167.babbar.eu FR
217.113.194.190 c190.babbar.eu FR
217.113.194.132 c132.babbar.eu FR
217.113.194.153 c153.babbar.eu FR
217.113.194.135 c135.babbar.eu FR
217.113.194.146 c146.babbar.eu FR
217.113.194.176 c176.babbar.eu FR
217.113.194.206 c206.babbar.eu FR
217.113.194.252 c252.babbar.eu FR
217.113.194.226 c226.babbar.eu FR
217.113.194.198 c198.babbar.eu FR
217.113.194.189 c189.babbar.eu FR
217.113.194.142 c142.babbar.eu FR
217.113.194.170 c170.babbar.eu FR
217.113.194.161 c161.babbar.eu FR
217.113.194.185 c185.babbar.eu FR
217.113.194.156 c156.babbar.eu FR
217.113.194.35 c035.babbar.eu FR
217.113.194.14 c014.babbar.eu FR
217.113.194.225 c225.babbar.eu FR
217.113.194.201 c201.babbar.eu FR
217.113.194.197 c197.babbar.eu FR
217.113.194.193 c193.babbar.eu FR
217.113.194.221 c221.babbar.eu FR
217.113.194.216 c216.babbar.eu FR
217.113.194.243 c243.babbar.eu FR
217.113.194.207 c207.babbar.eu FR
217.113.194.239 c239.babbar.eu FR
217.113.194.202 c202.babbar.eu FR
217.113.194.49 c049.babbar.eu FR
217.113.194.213 c213.babbar.eu FR
217.113.194.21 c021.babbar.eu FR
217.113.194.47 c047.babbar.eu FR
217.113.194.62 c062.babbar.eu FR
217.113.194.42 c042.babbar.eu FR
217.113.194.51 c051.babbar.eu FR
217.113.194.1 c001.babbar.eu FR
213.163.168.33 213.163.168.33 FR
217.113.194.134 c134.babbar.eu FR
217.113.194.144 c144.babbar.eu FR
217.113.194.164 c164.babbar.eu FR
217.113.194.250 c250.babbar.eu FR
217.113.194.151 c151.babbar.eu FR
217.113.194.174 c174.babbar.eu FR
217.113.194.155 c155.babbar.eu FR
217.113.194.130 c130.babbar.eu FR
217.113.194.181 c181.babbar.eu FR
217.113.194.236 c236.babbar.eu FR
217.113.194.199 c199.babbar.eu FR
217.113.194.219 c219.babbar.eu FR
217.113.194.249 c249.babbar.eu FR
217.113.194.230 c230.babbar.eu FR
217.113.194.227 c227.babbar.eu FR
217.113.194.208 c208.babbar.eu FR
154.54.249.17 crawl-dev-3.babbar.eu US
217.113.194.10 c010.babbar.eu FR
217.113.194.39 c039.babbar.eu FR
217.113.194.204 c204.babbar.eu FR
217.113.194.224 c224.babbar.eu FR
217.113.194.229 c229.babbar.eu FR
217.113.194.212 c212.babbar.eu FR
217.113.194.5 c005.babbar.eu FR
217.113.194.29 c029.babbar.eu FR
217.113.194.18 c018.babbar.eu FR
217.113.194.203 c203.babbar.eu FR
217.113.194.235 c235.babbar.eu FR
217.113.194.148 c148.babbar.eu FR
217.113.194.253 c253.babbar.eu FR
217.113.194.152 c152.babbar.eu FR
217.113.194.218 c218.babbar.eu FR
217.113.194.251 c251.babbar.eu FR
217.113.194.245 c245.babbar.eu FR
217.113.194.159 c159.babbar.eu FR
217.113.194.177 c177.babbar.eu FR
217.113.194.228 c228.babbar.eu FR
217.113.194.195 c195.babbar.eu FR
217.113.194.196 c196.babbar.eu FR
217.113.194.222 c222.babbar.eu FR
217.113.194.209 c209.babbar.eu FR
217.113.194.244 c244.babbar.eu FR
217.113.194.217 c217.babbar.eu FR
217.113.194.7 c007.babbar.eu FR
217.113.194.36 c036.babbar.eu FR
217.113.194.147 c147.babbar.eu FR
217.113.194.12 c012.babbar.eu FR
217.113.194.41 c041.babbar.eu FR
217.113.194.61 c061.babbar.eu FR
217.113.194.192 c192.babbar.eu FR
217.113.194.205 c205.babbar.eu FR
217.113.194.6 c006.babbar.eu FR
217.113.194.140 c140.babbar.eu FR
217.113.194.63 c063.babbar.eu FR
217.113.194.33 c033.babbar.eu FR
217.113.194.129 c129.babbar.eu FR
217.113.194.231 c231.babbar.eu FR
217.113.194.149 c149.babbar.eu FR
217.113.194.37 c037.babbar.eu FR
217.113.194.58 c058.babbar.eu FR
217.113.194.56 c056.babbar.eu FR
217.113.194.168 c168.babbar.eu FR
54.36.242.101 vm-gpitel.babbar.eu FR
217.113.194.133 c133.babbar.eu FR
217.113.194.8 c008.babbar.eu FR
217.113.194.34 c034.babbar.eu FR
217.113.194.220 c220.babbar.eu FR
217.113.194.40 c040.babbar.eu FR
217.113.194.4 c004.babbar.eu FR
217.113.194.16 c016.babbar.eu FR
217.113.194.20 c020.babbar.eu FR
217.113.194.26 c026.babbar.eu FR
217.113.194.54 c054.babbar.eu FR
217.113.194.30 c030.babbar.eu FR
217.113.194.43 c043.babbar.eu FR
217.113.194.55 c055.babbar.eu FR
217.113.194.238 c238.babbar.eu FR
217.113.194.46 c046.babbar.eu FR
217.113.194.22 c022.babbar.eu FR
217.113.194.137 c137.babbar.eu FR
217.113.194.19 c019.babbar.eu FR
217.113.194.45 c045.babbar.eu FR
217.113.194.13 c013.babbar.eu FR
154.54.249.163 154.54.249.163 FR
154.54.249.161 154.54.249.161 FR
154.54.249.170 ? FR
154.54.249.160 154.54.249.160 FR
217.113.194.11 c011.babbar.eu FR
217.113.194.32 c032.babbar.eu FR
154.54.249.162 ? FR
217.113.194.107 c107.babbar.eu FR
217.113.194.67 c067.babbar.eu FR
217.113.194.123 c123.babbar.eu FR
217.113.194.112 c112.babbar.eu FR
217.113.194.76 c076.babbar.eu FR
217.113.194.110 c110.babbar.eu FR
217.113.194.75 c075.babbar.eu FR
217.113.194.122 c122.babbar.eu FR
217.113.194.71 c071.babbar.eu FR
217.113.194.74 c074.babbar.eu FR
217.113.194.65 c065.babbar.eu FR
217.113.194.64 c064.babbar.eu FR
217.113.194.121 c121.babbar.eu FR
217.113.194.89 c089.babbar.eu FR
217.113.194.17 c017.babbar.eu FR
217.113.194.127 c127.babbar.eu FR
217.113.194.81 c081.babbar.eu FR
217.113.194.119 c119.babbar.eu FR
217.113.194.93 c093.babbar.eu FR
217.113.194.120 c120.babbar.eu FR
217.113.194.102 c102.babbar.eu FR
217.113.194.48 c048.babbar.eu FR
217.113.194.103 c103.babbar.eu FR
217.113.194.78 c078.babbar.eu FR
217.113.194.69 c069.babbar.eu FR
217.113.194.84 c084.babbar.eu FR
217.113.194.241 c241.babbar.eu FR
217.113.194.247 c247.babbar.eu FR
217.113.194.85 c085.babbar.eu FR
217.113.194.115 c115.babbar.eu FR
217.113.194.83 c083.babbar.eu FR
154.54.249.168 154.54.249.168 FR
217.113.194.118 c118.babbar.eu FR
217.113.194.28 c028.babbar.eu FR
217.113.194.98 c098.babbar.eu FR
217.113.194.105 c105.babbar.eu FR
154.54.249.193 crawl-prodd4-1.babbar.eu US
217.113.194.9 c009.babbar.eu FR
217.113.194.104 c104.babbar.eu FR
217.113.194.108 c108.babbar.eu FR
154.54.249.172 154.54.249.172 FR
154.54.249.174 154.54.249.174 FR
217.113.194.109 c109.babbar.eu FR
217.113.194.94 c094.babbar.eu FR
217.113.194.95 c095.babbar.eu FR
217.113.194.91 c091.babbar.eu FR
154.54.249.198 crawl-prodd4-6.babbar.eu US
217.113.194.86 c086.babbar.eu FR
217.113.194.96 c096.babbar.eu FR
154.54.249.199 crawl-prodd4-7.babbar.eu US
217.113.194.99 c099.babbar.eu FR
217.113.194.87 c087.babbar.eu FR
217.113.194.80 c080.babbar.eu FR
217.113.194.92 c092.babbar.eu FR
217.113.194.90 c090.babbar.eu FR
217.113.194.52 c052.babbar.eu FR
217.113.194.113 c113.babbar.eu FR
217.113.194.124 c124.babbar.eu FR
217.113.194.125 c125.babbar.eu FR
217.113.194.117 c117.babbar.eu FR
217.113.194.114 c114.babbar.eu FR
217.113.194.97 c097.babbar.eu FR
217.113.194.59 c059.babbar.eu FR
217.113.194.68 c068.babbar.eu FR
217.113.194.70 c070.babbar.eu FR
154.54.249.216 154.54.249.216 FR
54.36.242.100 vm-emarchand.babbar.eu FR
154.54.249.208 crawl-prodd4-16.babbar.eu FR
217.113.194.66 c066.babbar.eu FR
154.54.249.175 154.54.249.175 FR
154.54.249.217 154.54.249.217 FR
用户代理字符串
Barkrowler/0.9 ( http://www.exensa.com/crawl)
首次出现
2019-01-18 22:40:27
最后出现
2019-02-08 21:33:37
遵循robots.txt
未知
来源
IP地址(2) 服务器名称 所属国家
51.15.21.189 onode2.exensa.net NL
163.172.33.100 163-172-33-100.rev.poneytelecom.eu FR
用户代理字符串
Barkrowler/0.8 (+http://www.exensa.com/crawl)
首次出现
2018-11-08 12:45:45
最后出现
2018-11-08 12:45:45
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
51.15.15.54 onode6.exensa.net NL
用户代理字符串
Barkrowler/0.7 ( http://www.exensa.com/crawl)
首次出现
2018-03-28 19:56:30
最后出现
2018-05-28 04:45:40
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
217.182.192.80 snode7.exensa.net FR
用户代理字符串
BarkRowler/0.7 (+http://www.exensa.com/crawling)
首次出现
2018-01-30 16:50:20
最后出现
2018-01-30 17:23:39
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
51.15.21.192 onode5.exensa.net NL
51.15.21.189 onode2.exensa.net NL
51.15.21.188 onode1.exensa.net NL
51.15.15.59 onode11.exensa.net NL
51.15.15.56 onode8.exensa.net NL
51.15.15.57 onode9.exensa.net NL
51.15.15.54 onode6.exensa.net NL
51.15.21.185 onode0.exensa.net NL
51.15.21.191 onode4.exensa.net NL
51.15.15.55 onode7.exensa.net NL
217.182.192.80 snode7.exensa.net FR
80.12.90.158 lputeaux-656-1-229-158.w80-12.abo.wanadoo.fr FR
用户代理字符串
BarkRowler/0.7 (+http://www.exensa.com/crawling)
首次出现
2018-01-30 16:50:20
最后出现
2018-01-30 17:23:39
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
80.12.90.158 lputeaux-656-1-229-158.w80-12.abo.wanadoo.fr FR
用户代理字符串
Barkrowler/0.5.1 (experimenting / debugging - sorry for your logs ) www.exensa.com/crawl - admin@exensa.com -- based on BUBing
首次出现
2017-10-04 11:34:01
最后出现
2017-10-05 00:23:41
遵循robots.txt
未知
来源
IP地址(3) 服务器名称 所属国家
52.209.13.26 ec2-52-209-13-26.eu-west-1.compute.amazonaws.com IE
52.210.53.75 ec2-52-210-53-75.eu-west-1.compute.amazonaws.com IE
52.213.243.107 ec2-52-213-243-107.eu-west-1.compute.amazonaws.com IE
52.211.90.31 ec2-52-211-90-31.eu-west-1.compute.amazonaws.com IE
34.240.68.56 ec2-34-240-68-56.eu-west-1.compute.amazonaws.com IE
34.250.179.109 ec2-34-250-179-109.eu-west-1.compute.amazonaws.com IE
52.49.56.194 ec2-52-49-56-194.eu-west-1.compute.amazonaws.com IE
34.240.195.122 ec2-34-240-195-122.eu-west-1.compute.amazonaws.com IE
34.249.52.36 ec2-34-249-52-36.eu-west-1.compute.amazonaws.com IE
52.18.43.150 ec2-52-18-43-150.eu-west-1.compute.amazonaws.com IE
52.50.61.55 ec2-52-50-61-55.eu-west-1.compute.amazonaws.com IE
34.241.17.0 ec2-34-241-17-0.eu-west-1.compute.amazonaws.com IE
34.248.40.13 ec2-34-248-40-13.eu-west-1.compute.amazonaws.com IE
用户代理字符串
Barkrowler/0.5.1 (experimenting / debugging - sorry for your logs ) www.exensa.com/crawl - admin@exensa.com -- based on BUBing
首次出现
2017-10-04 11:34:01
最后出现
2017-10-05 00:23:41
遵循robots.txt
未知
来源
IP地址(3) 服务器名称 所属国家
52.50.61.55 ec2-52-50-61-55.eu-west-1.compute.amazonaws.com IE
34.241.17.0 ec2-34-241-17-0.eu-west-1.compute.amazonaws.com IE
34.248.40.13 ec2-34-248-40-13.eu-west-1.compute.amazonaws.com IE
用户代理字符串
Barkrowler/0.4.8 (experimenting / debugging - sorry for your logs ) www.exensa.com/crawl - admin@exensa.com -- based on BUBing
首次出现
2017-09-30 06:27:31
最后出现
2017-09-30 07:56:51
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
34.240.95.255 ec2-34-240-95-255.eu-west-1.compute.amazonaws.com IE
用户代理字符串
Barkrowler experimental crawler - 0.4.7
首次出现
2017-09-07 17:01:36
最后出现
2017-09-14 04:45:38
遵循robots.txt
未知
来源
IP地址(77) 服务器名称 所属国家
52.31.154.76 ec2-52-31-154-76.eu-west-1.compute.amazonaws.com IE
34.249.42.90 ec2-34-249-42-90.eu-west-1.compute.amazonaws.com IE
52.31.18.166 ec2-52-31-18-166.eu-west-1.compute.amazonaws.com IE
52.215.59.218 ec2-52-215-59-218.eu-west-1.compute.amazonaws.com IE
52.49.97.213 ec2-52-49-97-213.eu-west-1.compute.amazonaws.com IE
52.215.86.230 ec2-52-215-86-230.eu-west-1.compute.amazonaws.com IE
52.214.74.34 ec2-52-214-74-34.eu-west-1.compute.amazonaws.com IE
52.210.186.168 ec2-52-210-186-168.eu-west-1.compute.amazonaws.com IE
34.240.113.69 ec2-34-240-113-69.eu-west-1.compute.amazonaws.com IE
52.210.134.153 ec2-52-210-134-153.eu-west-1.compute.amazonaws.com IE
用户代理字符串
Barkrowler 0.1.6
首次出现
2017-08-28 22:19:04
最后出现
2017-09-07 08:35:40
遵循robots.txt
未知
来源
IP地址(50) 服务器名称 所属国家
54.77.124.128 ec2-54-77-124-128.eu-west-1.compute.amazonaws.com IE
54.77.162.39 ec2-54-77-162-39.eu-west-1.compute.amazonaws.com IE
34.253.71.77 ec2-34-253-71-77.eu-west-1.compute.amazonaws.com IE
52.214.241.180 ec2-52-214-241-180.eu-west-1.compute.amazonaws.com IE
54.171.101.245 ec2-54-171-101-245.eu-west-1.compute.amazonaws.com IE
52.210.12.101 ec2-52-210-12-101.eu-west-1.compute.amazonaws.com IE
34.240.44.108 ec2-34-240-44-108.eu-west-1.compute.amazonaws.com IE
52.214.202.52 ec2-52-214-202-52.eu-west-1.compute.amazonaws.com IE
34.240.21.91 ec2-34-240-21-91.eu-west-1.compute.amazonaws.com IE
34.240.52.100 ec2-34-240-52-100.eu-west-1.compute.amazonaws.com IE

访问控制

了解如何控制Barkrowler访问权限,避免Barkrowler抓取行为不当。

是否拦截Barkrowler?

一般不需要拦截,尤其是如果你自己也受益于搜索引擎优化服务。不过,如果你担心服务器资源占用等问题,且您都不使用这些工具,当然也可以选择拦截它们。

通过Robots.txt拦截

您可以通过在网站的 robots.txt 中设置用户代理访问规则来屏蔽 Barkrowler 或限制其访问权限。我们建议安装 Spider Analyser 插件,以检查它是否真正遵循这些规则。

Plain text
Copy to clipboard
Open code in new window
EnlighterJS 3 Syntax Highlighter
# robots.txt
# 下列代码一般情况可以拦截该代理
User-agent: Barkrowler
Disallow: /
# robots.txt # 下列代码一般情况可以拦截该代理 User-agent: Barkrowler Disallow: /
# robots.txt
# 下列代码一般情况可以拦截该代理
User-agent: Barkrowler
Disallow: /

您无需手动执行此操作,可通过我们的 Wordpress 插件 Spider Analyser 来拦截不必要的蜘蛛或者爬虫。

常见蜘蛛/爬虫

Common Spiders
Matchory Bot
Matchory Bot蜘蛛/爬虫属于营销类型,由Matchory GmbH开发运行。您可以继续阅读下方信息,以深入了解Matchory Bot基本信息,用户代理和访问控制等。
Googlebot
GoogleBot蜘蛛/爬虫属于搜索引擎类型,由Google Inc.开发运行。您可以继续阅读下方信息,以深入了解GoogleBot基本信息,用户代理和访问控制等。
Online Domain Tools
Online Domain Tools蜘蛛/爬虫属于监控类型,由AITIS s.r.o.开发运行。您可以继续阅读下方信息,以深入了解Online Domain Tools基本信息,用户代理和访问控制等。
AhrefsBot
AhrefsBot蜘蛛/爬虫属于营销类型,由Ahrefs Pte Ltd开发运行。您可以继续阅读下方信息,以深入了解AhrefsBot基本信息,用户代理和访问控制等。
SEMrushBot
SEMrushBot蜘蛛/爬虫属于营销类型,由Semrush Inc开发运行。您可以继续阅读下方信息,以深入了解SEMrushBot基本信息,用户代理和访问控制等。
DotBot
DotBot蜘蛛/爬虫属于营销类型,由SEOmoz, Inc.开发运行。您可以继续阅读下方信息,以深入了解DotBot基本信息,用户代理和访问控制等。
SentiBot
SentiBot蜘蛛/爬虫属于营销类型,由SentiOne开发运行。您可以继续阅读下方信息,以深入了解SentiBot基本信息,用户代理和访问控制等。
Awario crawler
Awario crawler蜘蛛/爬虫属于营销类型,由Link-Assistant.Com开发运行。您可以继续阅读下方信息,以深入了解Awario crawler基本信息,用户代理和访问控制等。

相关文章

Related Articles