CCBot

CCBot蜘蛛/爬虫属于AI数据采集类型,由CommonCrawl Foundation开发运行。您可以继续阅读下方信息,以深入了解CCBot基本信息,用户代理和访问控制等。

基本信息

CCBot的基本信息如下表。但部分不是很规范的蜘蛛和爬虫,可能存在信息不明的情况。
蜘蛛/爬虫名称
CCBot
类型
AI数据采集
开发商
CommonCrawl Foundation
当前状态
活动

用户代理

关于CCBot蜘蛛或者爬虫的用户代理字符串,IP地址和服务器,所在地等信息如下表格所示:
CCBot/3.0
用户代理字符串
CCBot/3.0 (TEst crawl with StormCrawler; https://commoncrawl.org/faq/; info@commoncrawl.org)
首次出现
2023-12-07 17:28:57
最后出现
2023-12-07 23:39:49
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
52.71.252.250 ec2-52-71-252-250.compute-1.amazonaws.com US
用户代理字符串
CCBot/3.1 (https://commoncrawl.org/faq/; info@commoncrawl.org)
首次出现
2021-07-06 14:20:41
最后出现
2021-11-09 15:43:50
遵循robots.txt
来源
IP地址(2) 服务器名称 所属国家
109.157.173.191 host109-157-173-191.range109-157.btcentralplus.com GB
193.191.148.194 wall.nat.iminds.be BE
用户代理字符串
CCBot/2.0 (http://commoncrawl.org/faq/)
首次出现
2014-03-07 01:55:00
最后出现
2018-07-23 19:16:34
遵循robots.txt
未知
来源
IP地址(2767) 服务器名称 所属国家
54.198.119.26 ec2-54-198-119-26.compute-1.amazonaws.com US
54.92.163.188 ec2-54-92-163-188.compute-1.amazonaws.com US
23.20.223.212 ec2-23-20-223-212.compute-1.amazonaws.com US
54.225.17.239 ec2-54-225-17-239.compute-1.amazonaws.com US
54.198.3.15 ec2-54-198-3-15.compute-1.amazonaws.com US
54.224.216.155 ec2-54-224-216-155.compute-1.amazonaws.com US
54.198.77.35 ec2-54-198-77-35.compute-1.amazonaws.com US
54.81.195.140 ec2-54-81-195-140.compute-1.amazonaws.com US
54.162.123.74 ec2-54-162-123-74.compute-1.amazonaws.com US
54.81.102.236 ec2-54-81-102-236.compute-1.amazonaws.com US
用户代理字符串
CCBot/2.0
首次出现
2013-08-23 08:10:00
最后出现
2013-12-22 10:50:06
遵循robots.txt
未知
来源
IP地址(145) 服务器名称 所属国家
18.204.56.185 ec2-18-204-56-185.compute-1.amazonaws.com US
34.236.192.4 ec2-34-236-192-4.compute-1.amazonaws.com ?
3.238.204.167 ec2-3-238-204-167.compute-1.amazonaws.com US
3.229.117.123 ec2-3-229-117-123.compute-1.amazonaws.com US
3.238.225.8 ec2-3-238-225-8.compute-1.amazonaws.com US
44.197.230.180 ec2-44-197-230-180.compute-1.amazonaws.com US
35.168.110.128 ec2-35-168-110-128.compute-1.amazonaws.com US
3.239.4.127 ec2-3-239-4-127.compute-1.amazonaws.com US
3.229.124.74 ec2-3-229-124-74.compute-1.amazonaws.com US
3.236.225.157 ec2-3-236-225-157.compute-1.amazonaws.com US
44.192.52.167 ec2-44-192-52-167.compute-1.amazonaws.com US
18.207.136.189 ec2-18-207-136-189.compute-1.amazonaws.com US
34.231.21.105 ec2-34-231-21-105.compute-1.amazonaws.com US
3.225.221.130 ec2-3-225-221-130.compute-1.amazonaws.com US
44.210.77.106 ec2-44-210-77-106.compute-1.amazonaws.com US
44.197.198.214 ec2-44-197-198-214.compute-1.amazonaws.com US
100.24.118.144 ec2-100-24-118-144.compute-1.amazonaws.com US
3.80.3.57 ec2-3-80-3-57.compute-1.amazonaws.com US
35.172.224.102 ec2-35-172-224-102.compute-1.amazonaws.com ?
3.235.180.193 ec2-3-235-180-193.compute-1.amazonaws.com US
54.198.119.26 ec2-54-198-119-26.compute-1.amazonaws.com US
54.92.163.188 ec2-54-92-163-188.compute-1.amazonaws.com US
23.20.223.212 ec2-23-20-223-212.compute-1.amazonaws.com US
54.225.17.239 ec2-54-225-17-239.compute-1.amazonaws.com US
54.198.3.15 ec2-54-198-3-15.compute-1.amazonaws.com US
54.224.216.155 ec2-54-224-216-155.compute-1.amazonaws.com US
54.198.77.35 ec2-54-198-77-35.compute-1.amazonaws.com US
54.81.195.140 ec2-54-81-195-140.compute-1.amazonaws.com US
54.162.123.74 ec2-54-162-123-74.compute-1.amazonaws.com US
54.81.102.236 ec2-54-81-102-236.compute-1.amazonaws.com US
54.235.20.17 ec2-54-235-20-17.compute-1.amazonaws.com US
54.242.191.65 ec2-54-242-191-65.compute-1.amazonaws.com US
54.226.108.247 ec2-54-226-108-247.compute-1.amazonaws.com US
54.196.29.175 ec2-54-196-29-175.compute-1.amazonaws.com US
204.236.250.249 ec2-204-236-250-249.compute-1.amazonaws.com US
23.22.76.170 ec2-23-22-76-170.compute-1.amazonaws.com US
107.21.146.13 ec2-107-21-146-13.compute-1.amazonaws.com US
54.243.21.188 ec2-54-243-21-188.compute-1.amazonaws.com US
54.234.208.14 ec2-54-234-208-14.compute-1.amazonaws.com US
54.204.102.125 ec2-54-204-102-125.compute-1.amazonaws.com US
18.232.56.9 ec2-18-232-56-9.compute-1.amazonaws.com US
34.229.119.176 ec2-34-229-119-176.compute-1.amazonaws.com US
3.236.65.63 ec2-3-236-65-63.compute-1.amazonaws.com US
44.210.85.190 ec2-44-210-85-190.compute-1.amazonaws.com US
44.201.99.222 ec2-44-201-99-222.compute-1.amazonaws.com US
44.200.169.3 ec2-44-200-169-3.compute-1.amazonaws.com US
18.232.127.73 ec2-18-232-127-73.compute-1.amazonaws.com US
3.239.112.140 ec2-3-239-112-140.compute-1.amazonaws.com US
3.236.121.117 ec2-3-236-121-117.compute-1.amazonaws.com US
35.175.107.185 ec2-35-175-107-185.compute-1.amazonaws.com US
3.236.146.28 ec2-3-236-146-28.compute-1.amazonaws.com US
107.21.186.38 ec2-107-21-186-38.compute-1.amazonaws.com US
67.202.18.97 ec2-67-202-18-97.compute-1.amazonaws.com US
54.234.29.117 ec2-54-234-29-117.compute-1.amazonaws.com US
54.204.119.249 ec2-54-204-119-249.compute-1.amazonaws.com US
50.16.132.180 ec2-50-16-132-180.compute-1.amazonaws.com US
54.211.208.163 ec2-54-211-208-163.compute-1.amazonaws.com US
50.17.88.213 ec2-50-17-88-213.compute-1.amazonaws.com US
184.73.146.114 ec2-184-73-146-114.compute-1.amazonaws.com US
54.242.112.13 ec2-54-242-112-13.compute-1.amazonaws.com US
3.93.74.25 ec2-3-93-74-25.compute-1.amazonaws.com US
18.232.31.206 ec2-18-232-31-206.compute-1.amazonaws.com US
3.239.119.61 ec2-3-239-119-61.compute-1.amazonaws.com US
3.236.80.119 ec2-3-236-80-119.compute-1.amazonaws.com US
44.211.239.1 ec2-44-211-239-1.compute-1.amazonaws.com US
44.192.247.184 ec2-44-192-247-184.compute-1.amazonaws.com US
3.235.195.196 ec2-3-235-195-196.compute-1.amazonaws.com US
3.237.29.69 ec2-3-237-29-69.compute-1.amazonaws.com US
44.213.63.130 ec2-44-213-63-130.compute-1.amazonaws.com US
18.232.179.5 ec2-18-232-179-5.compute-1.amazonaws.com US
184.72.184.104 ec2-184-72-184-104.compute-1.amazonaws.com US
54.237.34.165 ec2-54-237-34-165.compute-1.amazonaws.com US
54.205.203.151 ec2-54-205-203-151.compute-1.amazonaws.com US
50.17.177.32 ec2-50-17-177-32.compute-1.amazonaws.com US
54.196.42.114 ec2-54-196-42-114.compute-1.amazonaws.com US
23.20.196.179 ec2-23-20-196-179.compute-1.amazonaws.com US
54.242.233.11 ec2-54-242-233-11.compute-1.amazonaws.com US
54.226.118.37 ec2-54-226-118-37.compute-1.amazonaws.com US
54.234.231.49 ec2-54-234-231-49.compute-1.amazonaws.com US
35.172.230.154 ec2-35-172-230-154.compute-1.amazonaws.com US
3.214.216.26 ec2-3-214-216-26.compute-1.amazonaws.com US
34.225.194.102 ec2-34-225-194-102.compute-1.amazonaws.com US
3.238.181.138 ec2-3-238-181-138.compute-1.amazonaws.com US
44.192.38.49 ec2-44-192-38-49.compute-1.amazonaws.com US
54.234.180.187 ec2-54-234-180-187.compute-1.amazonaws.com US
54.196.78.24 ec2-54-196-78-24.compute-1.amazonaws.com US
23.22.182.239 ec2-23-22-182-239.compute-1.amazonaws.com US
107.20.7.65 ec2-107-20-7-65.compute-1.amazonaws.com US
54.243.11.78 ec2-54-243-11-78.compute-1.amazonaws.com US
72.44.49.67 ec2-72-44-49-67.compute-1.amazonaws.com US
54.237.0.16 ec2-54-237-0-16.compute-1.amazonaws.com US
54.204.212.114 ec2-54-204-212-114.compute-1.amazonaws.com US
50.16.20.131 ec2-50-16-20-131.compute-1.amazonaws.com US
3.236.70.233 ec2-3-236-70-233.compute-1.amazonaws.com US
107.22.3.72 ec2-107-22-3-72.compute-1.amazonaws.com US
72.44.48.122 ec2-72-44-48-122.compute-1.amazonaws.com US
54.235.36.164 ec2-54-235-36-164.compute-1.amazonaws.com US
54.204.208.204 ec2-54-204-208-204.compute-1.amazonaws.com US
50.16.17.90 ec2-50-16-17-90.compute-1.amazonaws.com US
54.196.12.7 ec2-54-196-12-7.compute-1.amazonaws.com US
184.73.74.47 ec2-184-73-74-47.compute-1.amazonaws.com US
54.242.187.251 ec2-54-242-187-251.compute-1.amazonaws.com US
54.224.75.101 ec2-54-224-75-101.compute-1.amazonaws.com US
44.201.67.0 ec2-44-201-67-0.compute-1.amazonaws.com US
44.192.83.225 ec2-44-192-83-225.compute-1.amazonaws.com US
3.235.254.183 ec2-3-235-254-183.compute-1.amazonaws.com US
35.175.119.163 ec2-35-175-119-163.compute-1.amazonaws.com US
3.237.8.187 ec2-3-237-8-187.compute-1.amazonaws.com US
3.85.222.115 ec2-3-85-222-115.compute-1.amazonaws.com US
35.171.244.190 ec2-35-171-244-190.compute-1.amazonaws.com US
44.192.67.235 ec2-44-192-67-235.compute-1.amazonaws.com US
18.232.73.161 ec2-18-232-73-161.compute-1.amazonaws.com US
3.236.6.174 ec2-3-236-6-174.compute-1.amazonaws.com US
50.17.66.15 ec2-50-17-66-15.compute-1.amazonaws.com US
184.73.142.169 ec2-184-73-142-169.compute-1.amazonaws.com US
54.242.1.117 ec2-54-242-1-117.compute-1.amazonaws.com US
54.211.199.91 ec2-54-211-199-91.compute-1.amazonaws.com US
54.226.5.29 ec2-54-226-5-29.compute-1.amazonaws.com US
54.196.47.196 ec2-54-196-47-196.compute-1.amazonaws.com US
23.21.24.193 ec2-23-21-24-193.compute-1.amazonaws.com US
54.242.4.108 ec2-54-242-4-108.compute-1.amazonaws.com US
18.206.92.240 ec2-18-206-92-240.compute-1.amazonaws.com US
44.200.168.16 ec2-44-200-168-16.compute-1.amazonaws.com US
34.232.63.94 ec2-34-232-63-94.compute-1.amazonaws.com US
3.239.6.58 ec2-3-239-6-58.compute-1.amazonaws.com US
34.239.152.207 ec2-34-239-152-207.compute-1.amazonaws.com US
3.236.207.90 ec2-3-236-207-90.compute-1.amazonaws.com US
3.236.241.39 ec2-3-236-241-39.compute-1.amazonaws.com US
3.236.209.138 ec2-3-236-209-138.compute-1.amazonaws.com ?
3.238.202.76 ec2-3-238-202-76.compute-1.amazonaws.com US
34.239.173.144 ec2-34-239-173-144.compute-1.amazonaws.com US
34.232.62.64 ec2-34-232-62-64.compute-1.amazonaws.com ?
3.238.250.73 ec2-3-238-250-73.compute-1.amazonaws.com US
3.238.134.157 ec2-3-238-134-157.compute-1.amazonaws.com US
184.73.40.4 ec2-184-73-40-4.compute-1.amazonaws.com US
54.242.115.62 ec2-54-242-115-62.compute-1.amazonaws.com US
54.221.158.5 ec2-54-221-158-5.compute-1.amazonaws.com US
50.17.90.164 ec2-50-17-90-164.compute-1.amazonaws.com US
54.196.69.105 ec2-54-196-69-105.compute-1.amazonaws.com US
23.22.100.67 ec2-23-22-100-67.compute-1.amazonaws.com US
107.20.129.212 ec2-107-20-129-212.compute-1.amazonaws.com US
54.242.86.143 ec2-54-242-86-143.compute-1.amazonaws.com US
54.227.41.124 ec2-54-227-41-124.compute-1.amazonaws.com US
44.201.92.114 ec2-44-201-92-114.compute-1.amazonaws.com US
44.200.171.156 ec2-44-200-171-156.compute-1.amazonaws.com ?
107.20.28.151 ec2-107-20-28-151.compute-1.amazonaws.com US
54.242.86.162 ec2-54-242-86-162.compute-1.amazonaws.com US
54.234.123.4 ec2-54-234-123-4.compute-1.amazonaws.com US
54.196.71.150 ec2-54-196-71-150.compute-1.amazonaws.com US
23.22.102.9 ec2-23-22-102-9.compute-1.amazonaws.com US
50.16.166.175 ec2-50-16-166-175.compute-1.amazonaws.com US
107.22.25.119 ec2-107-22-25-119.compute-1.amazonaws.com US
67.202.9.192 ec2-67-202-9-192.compute-1.amazonaws.com US
54.204.178.81 ec2-54-204-178-81.compute-1.amazonaws.com US
34.238.189.240 ec2-34-238-189-240.compute-1.amazonaws.com US
107.21.152.234 ec2-107-21-152-234.compute-1.amazonaws.com US
3.226.122.122 ec2-3-226-122-122.compute-1.amazonaws.com US
44.200.30.101 ec2-44-200-30-101.compute-1.amazonaws.com US
34.239.154.251 ec2-34-239-154-251.compute-1.amazonaws.com US
44.192.67.153 ec2-44-192-67-153.compute-1.amazonaws.com US
3.239.98.75 ec2-3-239-98-75.compute-1.amazonaws.com US
3.235.180.127 ec2-3-235-180-127.compute-1.amazonaws.com US
3.235.147.223 ec2-3-235-147-223.compute-1.amazonaws.com US
34.204.187.250 ec2-34-204-187-250.compute-1.amazonaws.com US
34.238.191.149 ec2-34-238-191-149.compute-1.amazonaws.com US
3.234.211.135 ec2-3-234-211-135.compute-1.amazonaws.com US
18.205.59.131 ec2-18-205-59-131.compute-1.amazonaws.com US
3.237.4.45 ec2-3-237-4-45.compute-1.amazonaws.com US
34.229.131.158 ec2-34-229-131-158.compute-1.amazonaws.com US
3.236.111.123 ec2-3-236-111-123.compute-1.amazonaws.com US
3.239.50.162 ec2-3-239-50-162.compute-1.amazonaws.com US
44.210.19.181 ec2-44-210-19-181.compute-1.amazonaws.com US
34.204.166.236 ec2-34-204-166-236.compute-1.amazonaws.com US
3.92.91.133 ec2-3-92-91-133.compute-1.amazonaws.com US
3.237.32.15 ec2-3-237-32-15.compute-1.amazonaws.com US
44.200.145.223 ec2-44-200-145-223.compute-1.amazonaws.com US
35.172.111.47 ec2-35-172-111-47.compute-1.amazonaws.com US
3.227.251.94 ec2-3-227-251-94.compute-1.amazonaws.com ?
44.200.82.149 ec2-44-200-82-149.compute-1.amazonaws.com US
3.238.118.27 ec2-3-238-118-27.compute-1.amazonaws.com US
18.207.240.77 ec2-18-207-240-77.compute-1.amazonaws.com US
44.192.92.49 ec2-44-192-92-49.compute-1.amazonaws.com US
3.239.129.52 ec2-3-239-129-52.compute-1.amazonaws.com US
3.231.217.107 ec2-3-231-217-107.compute-1.amazonaws.com US
35.172.164.32 ec2-35-172-164-32.compute-1.amazonaws.com US
3.237.16.173 ec2-3-237-16-173.compute-1.amazonaws.com US
23.22.8.126 ec2-23-22-8-126.compute-1.amazonaws.com US
44.192.79.149 ec2-44-192-79-149.compute-1.amazonaws.com US
3.230.152.133 ec2-3-230-152-133.compute-1.amazonaws.com US
3.238.111.130 ec2-3-238-111-130.compute-1.amazonaws.com US
54.205.14.223 ec2-54-205-14-223.compute-1.amazonaws.com US
50.16.36.153 ec2-50-16-36-153.compute-1.amazonaws.com US
174.129.51.84 ec2-174-129-51-84.compute-1.amazonaws.com US
75.101.193.250 ec2-75-101-193-250.compute-1.amazonaws.com US
54.237.109.47 ec2-54-237-109-47.compute-1.amazonaws.com US
54.242.190.198 ec2-54-242-190-198.compute-1.amazonaws.com US
54.225.41.156 ec2-54-225-41-156.compute-1.amazonaws.com US
54.196.25.57 ec2-54-196-25-57.compute-1.amazonaws.com US
204.236.243.5 ec2-204-236-243-5.compute-1.amazonaws.com US
3.233.219.103 ec2-3-233-219-103.compute-1.amazonaws.com US
107.22.156.205 ec2-107-22-156-205.compute-1.amazonaws.com US
67.202.5.213 ec2-67-202-5-213.compute-1.amazonaws.com US
54.234.67.55 ec2-54-234-67-55.compute-1.amazonaws.com US
54.204.160.54 ec2-54-204-160-54.compute-1.amazonaws.com US
50.16.155.166 ec2-50-16-155-166.compute-1.amazonaws.com US
50.19.155.235 ec2-50-19-155-235.compute-1.amazonaws.com US
184.73.42.117 ec2-184-73-42-117.compute-1.amazonaws.com US
54.242.170.220 ec2-54-242-170-220.compute-1.amazonaws.com US
54.221.174.43 ec2-54-221-174-43.compute-1.amazonaws.com US
3.237.13.60 ec2-3-237-13-60.compute-1.amazonaws.com US
3.235.65.33 ec2-3-235-65-33.compute-1.amazonaws.com US
3.238.88.152 ec2-3-238-88-152.compute-1.amazonaws.com US
34.236.187.226 ec2-34-236-187-226.compute-1.amazonaws.com US
34.228.52.31 ec2-34-228-52-31.compute-1.amazonaws.com US
3.237.23.248 ec2-3-237-23-248.compute-1.amazonaws.com US
3.227.0.10 ec2-3-227-0-10.compute-1.amazonaws.com US
3.227.235.107 ec2-3-227-235-107.compute-1.amazonaws.com US
34.239.154.193 ec2-34-239-154-193.compute-1.amazonaws.com US
3.239.82.78 ec2-3-239-82-78.compute-1.amazonaws.com US
44.201.72.250 ec2-44-201-72-250.compute-1.amazonaws.com US
44.192.115.114 ec2-44-192-115-114.compute-1.amazonaws.com US
54.204.103.226 ec2-54-204-103-226.compute-1.amazonaws.com US
54.224.79.93 ec2-54-224-79-93.compute-1.amazonaws.com US
54.196.135.62 ec2-54-196-135-62.compute-1.amazonaws.com US
204.236.220.20 ec2-204-236-220-20.compute-1.amazonaws.com US
54.242.188.217 ec2-54-242-188-217.compute-1.amazonaws.com US
107.20.70.26 ec2-107-20-70-26.compute-1.amazonaws.com US
54.243.11.79 ec2-54-243-11-79.compute-1.amazonaws.com US
54.234.198.171 ec2-54-234-198-171.compute-1.amazonaws.com US
54.196.81.58 ec2-54-196-81-58.compute-1.amazonaws.com US
23.22.212.158 ec2-23-22-212-158.compute-1.amazonaws.com US
3.236.46.172 ec2-3-236-46-172.compute-1.amazonaws.com US
34.239.148.127 ec2-34-239-148-127.compute-1.amazonaws.com US
3.214.184.223 ec2-3-214-184-223.compute-1.amazonaws.com US
3.236.237.61 ec2-3-236-237-61.compute-1.amazonaws.com ?
3.239.59.31 ec2-3-239-59-31.compute-1.amazonaws.com US
35.175.191.46 ec2-35-175-191-46.compute-1.amazonaws.com US
3.237.31.191 ec2-3-237-31-191.compute-1.amazonaws.com ?
34.204.181.91 ec2-34-204-181-91.compute-1.amazonaws.com US
34.204.172.188 ec2-34-204-172-188.compute-1.amazonaws.com US
54.243.9.45 ec2-54-243-9-45.compute-1.amazonaws.com US
184.72.91.94 ec2-184-72-91-94.compute-1.amazonaws.com US
54.237.71.254 ec2-54-237-71-254.compute-1.amazonaws.com US
54.205.90.81 ec2-54-205-90-81.compute-1.amazonaws.com US
50.17.2.204 ec2-50-17-2-204.compute-1.amazonaws.com US
44.192.254.173 ec2-44-192-254-173.compute-1.amazonaws.com US
44.200.117.166 ec2-44-200-117-166.compute-1.amazonaws.com US
44.197.111.121 ec2-44-197-111-121.compute-1.amazonaws.com US
44.200.101.84 ec2-44-200-101-84.compute-1.amazonaws.com US
23.21.36.112 ec2-23-21-36-112.compute-1.amazonaws.com US
107.20.104.41 ec2-107-20-104-41.compute-1.amazonaws.com US
54.242.56.212 ec2-54-242-56-212.compute-1.amazonaws.com US
54.227.12.217 ec2-54-227-12-217.compute-1.amazonaws.com US
54.196.64.84 ec2-54-196-64-84.compute-1.amazonaws.com US
54.204.142.201 ec2-54-204-142-201.compute-1.amazonaws.com US
50.16.141.57 ec2-50-16-141-57.compute-1.amazonaws.com US
107.22.127.92 ec2-107-22-127-92.compute-1.amazonaws.com US
67.202.2.156 ec2-67-202-2-156.compute-1.amazonaws.com US
18.232.179.37 ec2-18-232-179-37.compute-1.amazonaws.com US
54.242.173.185 ec2-54-242-173-185.compute-1.amazonaws.com US
54.224.187.203 ec2-54-224-187-203.compute-1.amazonaws.com US
50.19.44.190 ec2-50-19-44-190.compute-1.amazonaws.com US
184.73.7.143 ec2-184-73-7-143.compute-1.amazonaws.com US
23.22.181.15 ec2-23-22-181-15.compute-1.amazonaws.com US
107.20.5.85 ec2-107-20-5-85.compute-1.amazonaws.com US
54.243.1.94 ec2-54-243-1-94.compute-1.amazonaws.com US
54.234.126.92 ec2-54-234-126-92.compute-1.amazonaws.com US
54.196.74.55 ec2-54-196-74-55.compute-1.amazonaws.com US
130.84.14.25 prodprox9.idris.fr FR
174.129.105.230 ec2-174-129-105-230.compute-1.amazonaws.com US
44.212.91.116 ec2-44-212-91-116.compute-1.amazonaws.com ?
44.210.240.122 ec2-44-210-240-122.compute-1.amazonaws.com US
44.200.185.56 ec2-44-200-185-56.compute-1.amazonaws.com US
44.220.49.19 ec2-44-220-49-19.compute-1.amazonaws.com US
44.200.95.31 ec2-44-200-95-31.compute-1.amazonaws.com US
34.236.171.124 ec2-34-236-171-124.compute-1.amazonaws.com US
44.220.254.49 ec2-44-220-254-49.compute-1.amazonaws.com US
44.210.150.177 ec2-44-210-150-177.compute-1.amazonaws.com US
44.211.237.126 ec2-44-211-237-126.compute-1.amazonaws.com US
44.197.249.17 ec2-44-197-249-17.compute-1.amazonaws.com US
130.84.14.29 prodprox13.idris.fr FR
130.84.14.28 prodprox12.idris.fr FR
130.84.14.26 prodprox10.idris.fr FR
130.84.14.30 prodprox14.idris.fr FR
130.84.14.27 prodprox11.idris.fr FR
34.228.52.21 ec2-34-228-52-21.compute-1.amazonaws.com ?
35.172.165.64 ec2-35-172-165-64.compute-1.amazonaws.com US
3.239.2.192 ec2-3-239-2-192.compute-1.amazonaws.com US
130.84.14.31 prodprox15.idris.fr FR
130.84.14.22 prodprox8.idris.fr FR
44.220.249.141 ec2-44-220-249-141.compute-1.amazonaws.com US
3.233.221.90 ec2-3-233-221-90.compute-1.amazonaws.com US
54.234.42.16 ec2-54-234-42-16.compute-1.amazonaws.com US
44.197.101.251 ec2-44-197-101-251.compute-1.amazonaws.com US
18.205.26.39 ec2-18-205-26-39.compute-1.amazonaws.com US
18.206.13.203 ec2-18-206-13-203.compute-1.amazonaws.com US
44.212.94.18 ec2-44-212-94-18.compute-1.amazonaws.com US
35.175.107.142 ec2-35-175-107-142.compute-1.amazonaws.com US
18.206.12.157 ec2-18-206-12-157.compute-1.amazonaws.com ?
3.80.4.147 ec2-3-80-4-147.compute-1.amazonaws.com US
44.212.96.86 ec2-44-212-96-86.compute-1.amazonaws.com US
18.207.160.97 ec2-18-207-160-97.compute-1.amazonaws.com US
18.206.48.243 ec2-18-206-48-243.compute-1.amazonaws.com ?
34.204.194.215 ec2-34-204-194-215.compute-1.amazonaws.com US
44.222.126.172 ec2-44-222-126-172.compute-1.amazonaws.com US
3.237.7.102 ec2-3-237-7-102.compute-1.amazonaws.com US
3.236.69.204 ec2-3-236-69-204.compute-1.amazonaws.com US
18.207.132.100 ec2-18-207-132-100.compute-1.amazonaws.com US
44.200.117.7 ec2-44-200-117-7.compute-1.amazonaws.com US
3.235.141.15 ec2-3-235-141-15.compute-1.amazonaws.com US
44.197.234.216 ec2-44-197-234-216.compute-1.amazonaws.com US
44.197.101.65 ec2-44-197-101-65.compute-1.amazonaws.com US
18.208.143.53 ec2-18-208-143-53.compute-1.amazonaws.com US
44.200.140.49 ec2-44-200-140-49.compute-1.amazonaws.com US
3.239.10.177 ec2-3-239-10-177.compute-1.amazonaws.com US
3.239.76.25 ec2-3-239-76-25.compute-1.amazonaws.com US
44.192.20.240 ec2-44-192-20-240.compute-1.amazonaws.com US
18.207.129.175 ec2-18-207-129-175.compute-1.amazonaws.com ?
44.222.218.145 ec2-44-222-218-145.compute-1.amazonaws.com US
44.200.77.92 ec2-44-200-77-92.compute-1.amazonaws.com US
35.175.201.191 ec2-35-175-201-191.compute-1.amazonaws.com US
34.204.169.230 ec2-34-204-169-230.compute-1.amazonaws.com ?
3.235.145.108 ec2-3-235-145-108.compute-1.amazonaws.com US
100.26.196.222 ec2-100-26-196-222.compute-1.amazonaws.com US
3.239.9.151 ec2-3-239-9-151.compute-1.amazonaws.com US
3.236.223.106 ec2-3-236-223-106.compute-1.amazonaws.com US
3.237.34.21 ec2-3-237-34-21.compute-1.amazonaws.com US
44.220.62.183 ec2-44-220-62-183.compute-1.amazonaws.com US
44.192.15.251 ec2-44-192-15-251.compute-1.amazonaws.com US
34.236.134.129 ec2-34-236-134-129.compute-1.amazonaws.com US
23.20.239.173 ec2-23-20-239-173.compute-1.amazonaws.com US
54.242.240.200 ec2-54-242-240-200.compute-1.amazonaws.com US
54.226.12.150 ec2-54-226-12-150.compute-1.amazonaws.com US
54.196.46.140 ec2-54-196-46-140.compute-1.amazonaws.com US
54.204.108.185 ec2-54-204-108-185.compute-1.amazonaws.com US
50.16.108.167 ec2-50-16-108-167.compute-1.amazonaws.com US
107.21.156.140 ec2-107-21-156-140.compute-1.amazonaws.com US
67.202.12.153 ec2-67-202-12-153.compute-1.amazonaws.com US
54.234.26.172 ec2-54-234-26-172.compute-1.amazonaws.com US
3.238.114.107 ec2-3-238-114-107.compute-1.amazonaws.com US
34.239.164.248 ec2-34-239-164-248.compute-1.amazonaws.com US
44.220.50.118 ec2-44-220-50-118.compute-1.amazonaws.com ?
44.192.247.187 ec2-44-192-247-187.compute-1.amazonaws.com US
18.232.119.111 ec2-18-232-119-111.compute-1.amazonaws.com ?
3.236.232.62 ec2-3-236-232-62.compute-1.amazonaws.com US
44.221.42.128 ec2-44-221-42-128.compute-1.amazonaws.com US
44.200.80.129 ec2-44-200-80-129.compute-1.amazonaws.com US
3.233.215.114 ec2-3-233-215-114.compute-1.amazonaws.com US
44.222.121.85 ec2-44-222-121-85.compute-1.amazonaws.com US
3.215.190.246 ec2-3-215-190-246.compute-1.amazonaws.com ?
34.239.180.140 ec2-34-239-180-140.compute-1.amazonaws.com ?
3.233.242.67 ec2-3-233-242-67.compute-1.amazonaws.com US
35.174.62.162 ec2-35-174-62-162.compute-1.amazonaws.com ?
44.212.99.208 ec2-44-212-99-208.compute-1.amazonaws.com US
3.230.143.213 ec2-3-230-143-213.compute-1.amazonaws.com US
3.238.174.191 ec2-3-238-174-191.compute-1.amazonaws.com US
44.210.149.205 ec2-44-210-149-205.compute-1.amazonaws.com ?
3.238.71.155 ec2-3-238-71-155.compute-1.amazonaws.com US
3.235.172.123 ec2-3-235-172-123.compute-1.amazonaws.com US
3.239.91.5 ec2-3-239-91-5.compute-1.amazonaws.com US
3.238.117.130 ec2-3-238-117-130.compute-1.amazonaws.com US
107.20.93.246 ec2-107-20-93-246.compute-1.amazonaws.com US
54.243.21.129 ec2-54-243-21-129.compute-1.amazonaws.com US
54.234.207.24 ec2-54-234-207-24.compute-1.amazonaws.com US
54.196.9.164 ec2-54-196-9-164.compute-1.amazonaws.com US
23.22.252.150 ec2-23-22-252-150.compute-1.amazonaws.com US
50.17.109.248 ec2-50-17-109-248.compute-1.amazonaws.com US
174.129.72.28 ec2-174-129-72-28.compute-1.amazonaws.com US
54.237.111.70 ec2-54-237-111-70.compute-1.amazonaws.com US
54.205.172.206 ec2-54-205-172-206.compute-1.amazonaws.com US
44.201.97.224 ec2-44-201-97-224.compute-1.amazonaws.com US
44.201.97.0 ec2-44-201-97-0.compute-1.amazonaws.com US
3.234.244.181 ec2-3-234-244-181.compute-1.amazonaws.com US
44.200.27.215 ec2-44-200-27-215.compute-1.amazonaws.com US
3.238.235.248 ec2-3-238-235-248.compute-1.amazonaws.com US
3.81.28.123 ec2-3-81-28-123.compute-1.amazonaws.com US
34.231.247.255 ec2-34-231-247-255.compute-1.amazonaws.com US
3.94.99.163 ec2-3-94-99-163.compute-1.amazonaws.com US
3.237.13.30 ec2-3-237-13-30.compute-1.amazonaws.com ?
44.211.117.197 ec2-44-211-117-197.compute-1.amazonaws.com US
3.230.154.90 ec2-3-230-154-90.compute-1.amazonaws.com US
18.207.251.220 ec2-18-207-251-220.compute-1.amazonaws.com US
18.207.133.207 ec2-18-207-133-207.compute-1.amazonaws.com US
18.207.160.21 ec2-18-207-160-21.compute-1.amazonaws.com US
44.221.64.83 ec2-44-221-64-83.compute-1.amazonaws.com US
3.239.95.36 ec2-3-239-95-36.compute-1.amazonaws.com ?
3.215.186.30 ec2-3-215-186-30.compute-1.amazonaws.com ?
34.236.191.0 ec2-34-236-191-0.compute-1.amazonaws.com US
44.210.83.132 ec2-44-210-83-132.compute-1.amazonaws.com US
44.200.86.95 ec2-44-200-86-95.compute-1.amazonaws.com ?
44.222.104.206 ec2-44-222-104-206.compute-1.amazonaws.com US
34.239.158.223 ec2-34-239-158-223.compute-1.amazonaws.com ?
3.238.112.198 ec2-3-238-112-198.compute-1.amazonaws.com US
44.223.39.67 ec2-44-223-39-67.compute-1.amazonaws.com US
44.221.70.232 ec2-44-221-70-232.compute-1.amazonaws.com ?
3.239.11.178 ec2-3-239-11-178.compute-1.amazonaws.com US
3.215.16.238 ec2-3-215-16-238.compute-1.amazonaws.com US
3.235.20.185 ec2-3-235-20-185.compute-1.amazonaws.com US
3.229.117.191 ec2-3-229-117-191.compute-1.amazonaws.com US
100.26.179.41 ec2-100-26-179-41.compute-1.amazonaws.com US
44.222.110.128 ec2-44-222-110-128.compute-1.amazonaws.com US
44.197.195.174 ec2-44-197-195-174.compute-1.amazonaws.com US
3.238.25.135 ec2-3-238-25-135.compute-1.amazonaws.com US
100.28.2.72 ec2-100-28-2-72.compute-1.amazonaws.com US
3.237.43.104 ec2-3-237-43-104.compute-1.amazonaws.com US
34.239.170.244 ec2-34-239-170-244.compute-1.amazonaws.com US
100.28.227.63 ec2-100-28-227-63.compute-1.amazonaws.com US
34.204.179.107 ec2-34-204-179-107.compute-1.amazonaws.com US
3.236.146.74 ec2-3-236-146-74.compute-1.amazonaws.com ?
44.220.44.148 ec2-44-220-44-148.compute-1.amazonaws.com US
44.221.73.157 ec2-44-221-73-157.compute-1.amazonaws.com US
44.221.66.130 ec2-44-221-66-130.compute-1.amazonaws.com US
3.236.142.143 ec2-3-236-142-143.compute-1.amazonaws.com ?
100.28.132.102 ec2-100-28-132-102.compute-1.amazonaws.com US
3.236.143.154 ec2-3-236-143-154.compute-1.amazonaws.com US
44.192.48.196 ec2-44-192-48-196.compute-1.amazonaws.com US
3.236.83.154 ec2-3-236-83-154.compute-1.amazonaws.com US
34.239.176.54 ec2-34-239-176-54.compute-1.amazonaws.com ?
3.236.83.14 ec2-3-236-83-14.compute-1.amazonaws.com US
44.211.26.178 ec2-44-211-26-178.compute-1.amazonaws.com US
3.236.116.27 ec2-3-236-116-27.compute-1.amazonaws.com US
34.239.152.82 ec2-34-239-152-82.compute-1.amazonaws.com US
34.236.33.84 ec2-34-236-33-84.compute-1.amazonaws.com US
100.28.132.120 ec2-100-28-132-120.compute-1.amazonaws.com US
44.201.71.111 ec2-44-201-71-111.compute-1.amazonaws.com US
35.172.230.21 ec2-35-172-230-21.compute-1.amazonaws.com US
34.204.185.231 ec2-34-204-185-231.compute-1.amazonaws.com US
3.226.72.194 ec2-3-226-72-194.compute-1.amazonaws.com US
3.236.9.23 ec2-3-236-9-23.compute-1.amazonaws.com US
100.26.176.111 ec2-100-26-176-111.compute-1.amazonaws.com US
3.236.112.70 ec2-3-236-112-70.compute-1.amazonaws.com US
44.192.15.41 ec2-44-192-15-41.compute-1.amazonaws.com ?
100.28.230.162 ec2-100-28-230-162.compute-1.amazonaws.com US
3.235.182.206 ec2-3-235-182-206.compute-1.amazonaws.com US
44.211.79.182 ec2-44-211-79-182.compute-1.amazonaws.com US
100.26.196.214 ec2-100-26-196-214.compute-1.amazonaws.com US
3.233.232.160 ec2-3-233-232-160.compute-1.amazonaws.com US
44.192.44.30 ec2-44-192-44-30.compute-1.amazonaws.com US
100.28.0.143 ec2-100-28-0-143.compute-1.amazonaws.com US
3.238.116.201 ec2-3-238-116-201.compute-1.amazonaws.com US
44.200.194.255 ec2-44-200-194-255.compute-1.amazonaws.com US
44.192.94.177 ec2-44-192-94-177.compute-1.amazonaws.com US
3.238.121.7 ec2-3-238-121-7.compute-1.amazonaws.com US
44.210.151.5 ec2-44-210-151-5.compute-1.amazonaws.com US
3.92.91.54 ec2-3-92-91-54.compute-1.amazonaws.com ?
44.211.31.134 ec2-44-211-31-134.compute-1.amazonaws.com US
44.210.101.13 ec2-44-210-101-13.compute-1.amazonaws.com US
44.200.142.112 ec2-44-200-142-112.compute-1.amazonaws.com US
100.27.249.103 ec2-100-27-249-103.compute-1.amazonaws.com US
44.220.50.41 ec2-44-220-50-41.compute-1.amazonaws.com US
3.227.2.106 ec2-3-227-2-106.compute-1.amazonaws.com US
44.211.236.76 ec2-44-211-236-76.compute-1.amazonaws.com US
98.81.32.131 ec2-98-81-32-131.compute-1.amazonaws.com US
44.222.69.148 ec2-44-222-69-148.compute-1.amazonaws.com US
3.236.247.59 ec2-3-236-247-59.compute-1.amazonaws.com US
44.211.237.117 ec2-44-211-237-117.compute-1.amazonaws.com US
18.232.181.20 ec2-18-232-181-20.compute-1.amazonaws.com US
3.238.244.234 ec2-3-238-244-234.compute-1.amazonaws.com US
3.236.12.180 ec2-3-236-12-180.compute-1.amazonaws.com US
44.192.49.30 ec2-44-192-49-30.compute-1.amazonaws.com US
44.200.135.224 ec2-44-200-135-224.compute-1.amazonaws.com US
18.206.13.10 ec2-18-206-13-10.compute-1.amazonaws.com US
100.28.126.41 ec2-100-28-126-41.compute-1.amazonaws.com US
44.200.165.168 ec2-44-200-165-168.compute-1.amazonaws.com US
34.239.173.251 ec2-34-239-173-251.compute-1.amazonaws.com US
3.236.50.207 ec2-3-236-50-207.compute-1.amazonaws.com US
3.236.247.200 ec2-3-236-247-200.compute-1.amazonaws.com US
34.239.177.27 ec2-34-239-177-27.compute-1.amazonaws.com US
44.200.73.128 ec2-44-200-73-128.compute-1.amazonaws.com US
3.236.226.8 ec2-3-236-226-8.compute-1.amazonaws.com US
44.192.34.27 ec2-44-192-34-27.compute-1.amazonaws.com US
44.200.146.28 ec2-44-200-146-28.compute-1.amazonaws.com ?
3.237.39.151 ec2-3-237-39-151.compute-1.amazonaws.com US
3.236.23.7 ec2-3-236-23-7.compute-1.amazonaws.com ?
34.239.177.163 ec2-34-239-177-163.compute-1.amazonaws.com ?
3.236.95.73 ec2-3-236-95-73.compute-1.amazonaws.com ?
3.235.195.91 ec2-3-235-195-91.compute-1.amazonaws.com US
3.226.242.113 ec2-3-226-242-113.compute-1.amazonaws.com US
3.228.20.94 ec2-3-228-20-94.compute-1.amazonaws.com US
44.210.148.135 ec2-44-210-148-135.compute-1.amazonaws.com US
35.171.45.182 ec2-35-171-45-182.compute-1.amazonaws.com US
44.222.131.239 ec2-44-222-131-239.compute-1.amazonaws.com US
44.192.49.72 ec2-44-192-49-72.compute-1.amazonaws.com ?
44.220.181.180 ec2-44-220-181-180.compute-1.amazonaws.com US
98.81.24.230 ec2-98-81-24-230.compute-1.amazonaws.com US
18.205.56.209 ec2-18-205-56-209.compute-1.amazonaws.com US
34.231.180.210 ec2-34-231-180-210.compute-1.amazonaws.com US
3.239.76.211 ec2-3-239-76-211.compute-1.amazonaws.com US
44.222.82.133 ec2-44-222-82-133.compute-1.amazonaws.com US
44.192.26.226 ec2-44-192-26-226.compute-1.amazonaws.com US
3.238.227.73 ec2-3-238-227-73.compute-1.amazonaws.com US
18.207.133.13 ec2-18-207-133-13.compute-1.amazonaws.com US
98.82.120.188 ec2-98-82-120-188.compute-1.amazonaws.com US
44.220.247.152 ec2-44-220-247-152.compute-1.amazonaws.com US
44.201.97.138 ec2-44-201-97-138.compute-1.amazonaws.com US
3.236.100.210 ec2-3-236-100-210.compute-1.amazonaws.com US
34.204.188.103 ec2-34-204-188-103.compute-1.amazonaws.com US
18.205.56.100 ec2-18-205-56-100.compute-1.amazonaws.com US
3.235.30.103 ec2-3-235-30-103.compute-1.amazonaws.com US
3.236.112.101 ec2-3-236-112-101.compute-1.amazonaws.com US
100.28.219.22 ec2-100-28-219-22.compute-1.amazonaws.com ?
3.80.3.235 ec2-3-80-3-235.compute-1.amazonaws.com US
3.237.10.202 ec2-3-237-10-202.compute-1.amazonaws.com US
3.238.82.77 ec2-3-238-82-77.compute-1.amazonaws.com US
3.235.185.160 ec2-3-235-185-160.compute-1.amazonaws.com US
3.235.223.185 ec2-3-235-223-185.compute-1.amazonaws.com US
44.220.184.63 ec2-44-220-184-63.compute-1.amazonaws.com US
34.239.150.167 ec2-34-239-150-167.compute-1.amazonaws.com US
98.83.41.208 ec2-98-83-41-208.compute-1.amazonaws.com US
44.200.94.150 ec2-44-200-94-150.compute-1.amazonaws.com US
98.84.18.52 ec2-98-84-18-52.compute-1.amazonaws.com US
44.222.134.250 ec2-44-222-134-250.compute-1.amazonaws.com US
44.192.95.161 ec2-44-192-95-161.compute-1.amazonaws.com US
35.170.81.33 ec2-35-170-81-33.compute-1.amazonaws.com US
3.236.86.184 ec2-3-236-86-184.compute-1.amazonaws.com US
3.239.3.196 ec2-3-239-3-196.compute-1.amazonaws.com US
35.171.164.77 ec2-35-171-164-77.compute-1.amazonaws.com US
3.237.15.145 ec2-3-237-15-145.compute-1.amazonaws.com US
35.173.48.18 ec2-35-173-48-18.compute-1.amazonaws.com ?
3.239.97.34 ec2-3-239-97-34.compute-1.amazonaws.com US
44.211.29.66 ec2-44-211-29-66.compute-1.amazonaws.com US
3.239.90.61 ec2-3-239-90-61.compute-1.amazonaws.com US
100.28.127.5 ec2-100-28-127-5.compute-1.amazonaws.com US
44.197.195.138 ec2-44-197-195-138.compute-1.amazonaws.com US
18.207.160.209 ec2-18-207-160-209.compute-1.amazonaws.com US
3.236.4.2 ec2-3-236-4-2.compute-1.amazonaws.com US
44.192.75.201 ec2-44-192-75-201.compute-1.amazonaws.com US
3.239.87.20 ec2-3-239-87-20.compute-1.amazonaws.com US
18.232.56.238 ec2-18-232-56-238.compute-1.amazonaws.com US
44.200.81.242 ec2-44-200-81-242.compute-1.amazonaws.com US
3.236.151.18 ec2-3-236-151-18.compute-1.amazonaws.com US
3.236.171.48 ec2-3-236-171-48.compute-1.amazonaws.com US
3.234.242.21 ec2-3-234-242-21.compute-1.amazonaws.com US
3.236.101.49 ec2-3-236-101-49.compute-1.amazonaws.com US
44.192.67.10 ec2-44-192-67-10.compute-1.amazonaws.com US
34.204.176.71 ec2-34-204-176-71.compute-1.amazonaws.com US
3.235.145.252 ec2-3-235-145-252.compute-1.amazonaws.com US
100.28.231.85 ec2-100-28-231-85.compute-1.amazonaws.com US
3.238.202.29 ec2-3-238-202-29.compute-1.amazonaws.com US
3.233.242.216 ec2-3-233-242-216.compute-1.amazonaws.com US
44.211.24.175 ec2-44-211-24-175.compute-1.amazonaws.com US
3.231.219.178 ec2-3-231-219-178.compute-1.amazonaws.com US
34.239.153.44 ec2-34-239-153-44.compute-1.amazonaws.com US
98.84.25.165 ec2-98-84-25-165.compute-1.amazonaws.com US
18.97.14.85 18-97-14-85.crawl.commoncrawl.org US
18.97.14.83 18-97-14-83.crawl.commoncrawl.org US
18.97.14.90 18-97-14-90.crawl.commoncrawl.org ?
18.97.14.89 18-97-14-89.crawl.commoncrawl.org US
18.97.14.87 18-97-14-87.crawl.commoncrawl.org US
18.97.9.168 18-97-9-168.crawl.commoncrawl.org US
18.97.14.81 18-97-14-81.crawl.commoncrawl.org US
18.97.14.84 18-97-14-84.crawl.commoncrawl.org ?
18.97.14.82 18-97-14-82.crawl.commoncrawl.org US
18.97.14.91 18-97-14-91.crawl.commoncrawl.org US
18.97.9.175 18-97-9-175.crawl.commoncrawl.org US
18.97.9.173 18-97-9-173.crawl.commoncrawl.org US
18.97.14.88 18-97-14-88.crawl.commoncrawl.org US
18.97.14.80 18-97-14-80.crawl.commoncrawl.org US
18.97.9.169 18-97-9-169.crawl.commoncrawl.org US
18.97.9.171 18-97-9-171.crawl.commoncrawl.org US
用户代理字符串
CCBot/2.0
首次出现
2013-08-23 08:10:00
最后出现
2013-12-22 10:50:06
遵循robots.txt
未知
来源
IP地址(145) 服务器名称 所属国家
54.235.20.17 ec2-54-235-20-17.compute-1.amazonaws.com US
50.16.132.180 ec2-50-16-132-180.compute-1.amazonaws.com US
107.21.186.38 ec2-107-21-186-38.compute-1.amazonaws.com US
67.202.18.97 ec2-67-202-18-97.compute-1.amazonaws.com US
54.234.29.117 ec2-54-234-29-117.compute-1.amazonaws.com US
54.204.119.249 ec2-54-204-119-249.compute-1.amazonaws.com US
54.211.208.163 ec2-54-211-208-163.compute-1.amazonaws.com US
50.17.88.213 ec2-50-17-88-213.compute-1.amazonaws.com US
184.73.146.114 ec2-184-73-146-114.compute-1.amazonaws.com US
54.242.112.13 ec2-54-242-112-13.compute-1.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Mobile; rv:18.0) Gecko/18.0 Firefox/18.0 commoncrawl.org/research//Nutch-1.7-SNAPSHOT
首次出现
2013-09-20 07:33:08
最后出现
2013-11-05 08:22:58
遵循robots.txt
未知
来源
IP地址(7) 服务器名称 所属国家
50.17.95.55 ec2-50-17-95-55.compute-1.amazonaws.com US
23.22.185.34 ec2-23-22-185-34.compute-1.amazonaws.com US
75.101.211.73 ec2-75-101-211-73.compute-1.amazonaws.com US
184.73.4.237 ec2-184-73-4-237.compute-1.amazonaws.com US
54.211.91.174 ec2-54-211-91-174.compute-1.amazonaws.com US
54.205.9.186 ec2-54-205-9-186.compute-1.amazonaws.com US
54.204.238.220 ec2-54-204-238-220.compute-1.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Android; Mobile; rv:21.0) Gecko/21.0 Firefox/21.0 commoncrawl.org/research//Nutch-1.7-SNAPSHOT
首次出现
2013-09-20 08:17:46
最后出现
2013-11-05 07:06:32
遵循robots.txt
未知
来源
IP地址(9) 服务器名称 所属国家
23.22.185.34 ec2-23-22-185-34.compute-1.amazonaws.com US
50.17.95.55 ec2-50-17-95-55.compute-1.amazonaws.com US
54.204.238.220 ec2-54-204-238-220.compute-1.amazonaws.com US
54.205.9.186 ec2-54-205-9-186.compute-1.amazonaws.com US
54.211.62.153 ec2-54-211-62-153.compute-1.amazonaws.com US
54.211.91.174 ec2-54-211-91-174.compute-1.amazonaws.com US
54.224.224.44 ec2-54-224-224-44.compute-1.amazonaws.com US
54.237.39.40 ec2-54-237-39-40.compute-1.amazonaws.com US
75.101.211.73 ec2-75-101-211-73.compute-1.amazonaws.com US
184.73.4.237 ec2-184-73-4-237.compute-1.amazonaws.com US
54.205.26.97 ec2-54-205-26-97.compute-1.amazonaws.com US
用户代理字符串
Mozilla/5.0 (Android; Mobile; rv:21.0) Gecko/21.0 Firefox/21.0 commoncrawl.org/research//Nutch-1.7-SNAPSHOT
首次出现
2013-09-20 08:17:46
最后出现
2013-11-05 07:06:32
遵循robots.txt
未知
来源
IP地址(9) 服务器名称 所属国家
23.22.185.34 ec2-23-22-185-34.compute-1.amazonaws.com US
50.17.95.55 ec2-50-17-95-55.compute-1.amazonaws.com US
75.101.211.73 ec2-75-101-211-73.compute-1.amazonaws.com US
54.224.224.44 ec2-54-224-224-44.compute-1.amazonaws.com US
184.73.4.237 ec2-184-73-4-237.compute-1.amazonaws.com US
54.205.9.186 ec2-54-205-9-186.compute-1.amazonaws.com US
54.237.39.40 ec2-54-237-39-40.compute-1.amazonaws.com US
54.205.26.97 ec2-54-205-26-97.compute-1.amazonaws.com US
54.204.238.220 ec2-54-204-238-220.compute-1.amazonaws.com US
用户代理字符串
CCResearchBot/1.0 commoncrawl.org/research//Nutch-1.7-SNAPSHOT
首次出现
2013-08-23 08:15:00
最后出现
2013-08-22 00:14:19
遵循robots.txt
未知
来源
IP地址(1) 服务器名称 所属国家
54.211.116.192 ec2-54-211-116-192.compute-1.amazonaws.com US
用户代理字符串
CCBot/1.0 (+http://www.commoncrawl.org/bot.html)
首次出现
2009-05-11 05:50:00
最后出现
2012-05-24 16:38:11
遵循robots.txt
未知
来源
IP地址(33) 服务器名称 所属国家
38.107.179.201 ? US
38.107.179.200 38.107.179.200 US
38.107.179.226 38.107.179.226 US
38.107.191.109 38.107.191.109 US
38.103.63.56 38.103.63.56 US
38.107.191.95 38.107.191.95 US
38.107.179.227 38.107.179.227 US
38.107.191.110 38.107.191.110 US
38.103.63.57 38.103.63.57 US
38.107.179.230 38.107.179.230 US
38.107.191.80 38.107.191.80 US
38.107.179.214 38.107.179.214 US
38.107.191.104 38.107.191.104 US
38.107.191.81 38.107.191.81 US
38.107.179.216 38.107.179.216 US
38.107.191.105 38.107.191.105 US
38.107.191.85 38.107.191.85 US
38.107.179.220 38.107.179.220 US
38.107.191.107 38.107.191.107 US
38.107.191.90 38.107.191.90 US
38.107.179.210 38.107.179.210 US
38.107.179.240 38.107.179.240 US
38.107.191.119 38.107.191.119 US
38.107.179.211 38.107.179.211 US
38.107.191.100 38.107.191.100 US
38.107.191.66 38.107.191.66 US
38.107.179.212 38.107.179.212 US
38.107.191.101 38.107.191.101 US
38.107.179.236 38.107.179.236 US
38.107.191.117 38.107.191.117 US
38.107.191.115 38.107.191.115 US
38.107.179.233 38.107.179.233 US
38.107.191.116 38.107.191.116 US

访问控制

了解如何控制CCBot访问权限,避免CCBot抓取行为不当。

是否拦截CCBot?

这取决于你。AI数据采集器器通常会下载公开可用的互联网内容,这些内容默认情况下可以免费访问。不过,如果你担心归属问题或你的创意作品如何被用于生成的人工智能模型中,你可以拦截它们。

通过Robots.txt拦截

您可以通过在网站的 robots.txt 中设置用户代理访问规则来屏蔽 CCBot 或限制其访问权限。我们建议安装 Spider Analyser 插件,以检查它是否真正遵循这些规则。

	# robots.txt
	# 下列代码一般情况可以拦截该代理
	
	User-agent: CCBot
	Disallow: /

您无需手动执行此操作,可通过我们的 Wordpress 插件 Spider Analyser 来拦截不必要的蜘蛛或者爬虫。

常见蜘蛛/爬虫

Common Spiders

相关文章

Related Articles