BuiltWith crawler

BuiltWith crawler蜘蛛/爬蟲屬於工具型別，由BuiltWith Pty Ltd開發執行。您可以繼續閱讀下方資訊，以深入瞭解BuiltWith crawler基本資訊，使用者代理和訪問控制等。

基本資訊

BuiltWith crawler的基本資訊如下表。但部分不是很規範的蜘蛛和爬蟲，可能存在資訊不明的情況。

蜘蛛/爬蟲名稱: BuiltWith crawler

型別: 工具

開發商: BuiltWith Pty Ltd

當前狀態: 活動

使用者代理

關於BuiltWith crawler蜘蛛或者爬蟲的使用者代理字串，IP地址和伺服器，所在地等資訊如下表格所示：

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.3; rb.gy/qyzae5) Chrome/124.0.0.0 Safari/537.36

首次出現: 2024-12-21 00:06:04

最後出現: 2025-01-09 11:57:45

遵循robots.txt: 未知

來源

IP地址(25)	伺服器名稱	所屬國家
35.217.18.157	157.18.217.35.bc.googleusercontent.com	FI
34.0.211.53	53.211.0.34.bc.googleusercontent.com	ES
35.219.245.138	?	IT
34.0.158.203	?	US
35.212.171.43	43.171.212.35.bc.googleusercontent.com	US
3.29.134.49	ec2-3-29-134-49.me-central-1.compute.amazonaws.com	AE
35.213.223.92	92.223.213.35.bc.googleusercontent.com	AU
35.207.215.104	104.215.207.35.bc.googleusercontent.com	IN
34.1.43.178	?	QA
34.1.22.199	199.22.1.34.bc.googleusercontent.com	?
34.0.129.105	?	US
35.219.247.54	?	IT
15.236.225.192	ec2-15-236-225-192.eu-west-3.compute.amazonaws.com	FR
34.0.135.51	?	US
35.209.31.237	237.31.209.35.bc.googleusercontent.com	US
34.1.11.46	46.11.1.34.bc.googleusercontent.com	FR
34.1.25.70	?	US
35.207.238.138	?	IN
35.206.115.46	?	US
34.1.32.144	?	QA
35.212.166.46	?	US
35.211.10.21	21.10.211.35.bc.googleusercontent.com	US
35.213.197.94	94.197.213.35.bc.googleusercontent.com	AU
35.215.97.90	90.97.215.35.bc.googleusercontent.com	US
35.207.5.150	150.5.207.35.bc.googleusercontent.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.2; rb.gy/oupwis) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2024-04-26 12:28:40

最後出現: 2024-05-03 05:34:32

遵循robots.txt: 未知

來源

IP地址(16)	伺服器名稱	所屬國家
35.210.108.76	?	BE
35.207.212.6	?	IN
35.217.68.215	?	US
3.78.247.129	ec2-3-78-247-129.eu-central-1.compute.amazonaws.com	DE
35.217.33.216	?	FI
35.206.194.70	?	TW
35.207.206.7	7.206.207.35.bc.googleusercontent.com	IN
35.217.109.238	?	US
35.213.241.230	230.241.213.35.bc.googleusercontent.com	?
34.1.43.3	34.1.43.3	QA
34.0.219.26	34.0.219.26	ES
35.207.248.89	?	IN
35.213.250.209	209.250.213.35.bc.googleusercontent.com	AU
35.212.176.45	?	US
35.215.121.143	143.121.215.35.bc.googleusercontent.com	US
35.219.252.45	45.252.219.35.bc.googleusercontent.com	IT
34.1.19.210	34.1.19.210	US
35.213.245.168	168.245.213.35.bc.googleusercontent.com	AU
35.212.186.31	31.186.212.35.bc.googleusercontent.com	US
34.0.194.177	34.0.194.177	ES
35.206.90.132	132.90.206.35.bc.googleusercontent.com	US
34.1.8.89	?	FR
34.0.135.5	?	US
34.0.220.22	34.0.220.22	ES
34.1.4.244	34.1.4.244	FR
34.1.20.228	34.1.20.228	US
35.211.10.21	?	US
34.1.23.37	?	US
35.207.5.150	?	US
34.0.80.164	?	IL
34.1.18.252	34.1.18.252	US
34.1.41.84	34.1.41.84	QA
35.212.147.88	?	?
34.0.79.148	34.0.79.148	IL
35.217.37.136	?	FI
35.213.229.199	199.229.213.35.bc.googleusercontent.com	AU
34.0.144.210	34.0.144.210	US
35.215.93.127	127.93.215.35.bc.googleusercontent.com	US
35.207.209.92	?	IN
34.0.198.152	?	ES
35.215.71.74	74.71.215.35.bc.googleusercontent.com	US
35.219.239.72	72.239.219.35.bc.googleusercontent.com	IT
15.236.225.192	ec2-15-236-225-192.eu-west-3.compute.amazonaws.com	FR
34.1.29.220	?	US
35.217.40.244	?	FI
34.1.12.43	34.1.12.43	FR
34.1.14.93	34.1.14.93	FR
35.217.1.191	191.1.217.35.bc.googleusercontent.com	FI
34.1.7.58	34.1.7.58	FR
35.207.223.141	141.223.207.35.bc.googleusercontent.com	IN
35.215.122.114	114.122.215.35.bc.googleusercontent.com	US
34.0.205.200	34.0.205.200	ES
34.1.47.166	34.1.47.166	QA
34.0.215.225	?	ES
34.0.215.184	34.0.215.184	ES
35.215.126.238	238.126.215.35.bc.googleusercontent.com	US
35.213.219.30	30.219.213.35.bc.googleusercontent.com	AU
35.207.251.138	138.251.207.35.bc.googleusercontent.com	IN
34.1.22.246	246.22.1.34.bc.googleusercontent.com	US
35.219.249.96	?	IT
35.217.33.81	81.33.217.35.bc.googleusercontent.com	FI
34.1.13.153	?	FR
34.0.194.186	?	ES
35.215.67.92	92.67.215.35.bc.googleusercontent.com	US
15.235.50.228	juno.builtwith.xyz	CA
34.1.22.77	?	US
34.1.31.216	?	US
35.219.224.197	?	IT
34.1.4.6	?	FR
35.215.94.30	?	US
35.219.236.143	?	IT
35.207.239.162	162.239.207.35.bc.googleusercontent.com	IN
34.1.29.106	?	?
34.0.218.186	186.218.0.34.bc.googleusercontent.com	ES
51.161.84.56	unicorn.builtwith.xyz	CA
35.212.152.192	?	?
35.217.40.35	35.40.217.35.bc.googleusercontent.com	FI
34.1.25.209	209.25.1.34.bc.googleusercontent.com	US
35.207.209.94	?	IN
35.215.100.121	?	?
35.207.252.192	?	IN
35.213.215.205	?	AU
34.0.133.250	250.133.0.34.bc.googleusercontent.com	US
34.0.195.237	237.195.0.34.bc.googleusercontent.com	ES
35.215.106.18	?	US
35.217.12.214	?	FI
35.219.250.20	?	IT
34.1.39.145	?	QA
34.1.21.87	?	US
35.215.124.246	246.124.215.35.bc.googleusercontent.com	US
34.1.16.49	49.16.1.34.bc.googleusercontent.com	US
34.0.220.67	67.220.0.34.bc.googleusercontent.com	?
34.1.20.176	?	US
34.1.12.239	?	FR
34.0.218.106	?	ES
34.1.12.133	?	FR
34.0.132.210	210.132.0.34.bc.googleusercontent.com	US
34.0.211.14	14.211.0.34.bc.googleusercontent.com	ES
34.1.25.52	52.25.1.34.bc.googleusercontent.com	US
35.212.185.32	32.185.212.35.bc.googleusercontent.com	US
34.1.13.193	193.13.1.34.bc.googleusercontent.com	FR
34.1.22.48	48.22.1.34.bc.googleusercontent.com	US
34.1.24.207	207.24.1.34.bc.googleusercontent.com	US
35.217.34.165	165.34.217.35.bc.googleusercontent.com	FI
35.215.120.50	50.120.215.35.bc.googleusercontent.com	US
35.207.204.100	100.204.207.35.bc.googleusercontent.com	IN
35.219.243.160	160.243.219.35.bc.googleusercontent.com	IT
34.0.212.197	197.212.0.34.bc.googleusercontent.com	ES
35.208.205.22	?	?
35.219.233.144	144.233.219.35.bc.googleusercontent.com	IT
35.215.127.4	4.127.215.35.bc.googleusercontent.com	US
35.217.43.184	184.43.217.35.bc.googleusercontent.com	FI
118.127.8.98	amy.builtwith.au	AU
35.215.107.207	?	?
35.206.115.46	?	US
35.212.151.150	150.151.212.35.bc.googleusercontent.com	US
34.0.201.85	?	ES
35.213.229.218	?	AU
35.219.227.164	?	IT
35.215.114.141	?	US
35.217.10.125	?	FI
34.1.29.10	10.29.1.34.bc.googleusercontent.com	US
34.0.219.241	?	ES
143.110.192.235	143.110.192.235	US
34.0.157.210	210.157.0.34.bc.googleusercontent.com	US
143.198.173.204	143.198.173.204	US
35.217.39.73	?	FI
34.1.40.252	?	QA
34.0.80.192	192.80.0.34.bc.googleusercontent.com	IL
35.215.68.60	60.68.215.35.bc.googleusercontent.com	US
35.217.9.251	?	FI
34.0.142.51	?	US
34.0.209.171	?	ES
34.0.64.141	141.64.0.34.bc.googleusercontent.com	IL
35.207.215.126	?	IN
35.213.238.120	120.238.213.35.bc.googleusercontent.com	AU
34.1.22.16	16.22.1.34.bc.googleusercontent.com	US
34.1.16.40	?	US
35.208.27.10	10.27.208.35.bc.googleusercontent.com	US
35.212.183.147	147.183.212.35.bc.googleusercontent.com	US
34.1.22.221	?	US
51.161.15.95	elmo.builtwith.xyz	CA
34.1.19.110	110.19.1.34.bc.googleusercontent.com	US
1.129.105.255	1.129.105.255	AU
35.213.238.230	230.238.213.35.bc.googleusercontent.com	AU
34.0.223.36	36.223.0.34.bc.googleusercontent.com	ES
35.217.52.185	185.52.217.35.bc.googleusercontent.com	FI
35.207.215.84	?	IN
46.4.84.237	amy.builtwith.xyz	DE
34.0.134.68	68.134.0.34.bc.googleusercontent.com	?
15.235.9.75	strawberry.builtwith.xyz	CA
34.1.26.205	?	?
34.1.31.111	111.31.1.34.bc.googleusercontent.com	US
34.1.25.55	55.25.1.34.bc.googleusercontent.com	US
34.0.133.43	?	US
35.215.99.233	233.99.215.35.bc.googleusercontent.com	?
34.1.2.113	?	FR
34.0.64.185	185.64.0.34.bc.googleusercontent.com	IL
35.212.189.1	?	?
34.1.6.20	20.6.1.34.bc.googleusercontent.com	FR
35.207.238.105	105.238.207.35.bc.googleusercontent.com	IN
34.0.142.187	187.142.0.34.bc.googleusercontent.com	US
35.215.107.24	24.107.215.35.bc.googleusercontent.com	US
34.0.198.29	?	ES
35.219.237.72	72.237.219.35.bc.googleusercontent.com	IT
34.1.27.159	159.27.1.34.bc.googleusercontent.com	US
35.215.87.212	?	US
34.1.38.72	72.38.1.34.bc.googleusercontent.com	QA
34.1.40.160	?	?
34.1.27.85	85.27.1.34.bc.googleusercontent.com	US
34.1.5.17	?	FR
35.215.112.171	171.112.215.35.bc.googleusercontent.com	US
34.0.153.203	203.153.0.34.bc.googleusercontent.com	US
34.1.28.42	42.28.1.34.bc.googleusercontent.com	US
35.207.228.82	82.228.207.35.bc.googleusercontent.com	IN
34.0.147.213	213.147.0.34.bc.googleusercontent.com	US
35.212.128.99	99.128.212.35.bc.googleusercontent.com	?
35.215.125.158	158.125.215.35.bc.googleusercontent.com	US
35.213.234.136	136.234.213.35.bc.googleusercontent.com	AU
35.215.99.245	245.99.215.35.bc.googleusercontent.com	US
34.0.131.10	?	US
34.1.18.58	58.18.1.34.bc.googleusercontent.com	US
35.213.195.32	32.195.213.35.bc.googleusercontent.com	AU
35.212.138.136	136.138.212.35.bc.googleusercontent.com	US
34.0.193.134	?	ES
34.0.133.62	62.133.0.34.bc.googleusercontent.com	US
34.1.22.130	?	US
35.215.78.40	40.78.215.35.bc.googleusercontent.com	US
34.1.28.167	167.28.1.34.bc.googleusercontent.com	US
34.1.43.178	?	QA
34.0.80.142	142.80.0.34.bc.googleusercontent.com	IL
35.219.248.240	240.248.219.35.bc.googleusercontent.com	IT
35.217.19.12	12.19.217.35.bc.googleusercontent.com	FI
117.210.139.11	117.210.139.11	IN
35.212.200.119	?	US
34.0.157.185	185.157.0.34.bc.googleusercontent.com	US
35.219.253.47	47.253.219.35.bc.googleusercontent.com	IT
35.215.118.37	?	US
35.217.18.223	?	FI
34.1.18.155	?	US
34.1.32.144	144.32.1.34.bc.googleusercontent.com	QA
34.0.141.215	?	US
34.1.18.154	154.18.1.34.bc.googleusercontent.com	US
35.212.169.143	143.169.212.35.bc.googleusercontent.com	US
35.215.124.32	32.124.215.35.bc.googleusercontent.com	US
35.219.231.152	?	IT
34.0.155.68	68.155.0.34.bc.googleusercontent.com	US
35.207.241.196	196.241.207.35.bc.googleusercontent.com	IN
35.212.153.195	195.153.212.35.bc.googleusercontent.com	US
34.1.27.55	55.27.1.34.bc.googleusercontent.com	US
35.207.251.152	152.251.207.35.bc.googleusercontent.com	IN
35.212.171.35	?	US
35.217.15.244	244.15.217.35.bc.googleusercontent.com	FI
34.1.25.177	?	US
35.207.249.220	?	IN
34.1.4.135	135.4.1.34.bc.googleusercontent.com	FR
34.0.129.252	252.129.0.34.bc.googleusercontent.com	US
34.1.21.66	?	US
34.0.147.102	?	US
35.209.31.237	?	US
35.215.125.197	?	US
34.0.69.87	87.69.0.34.bc.googleusercontent.com	IL
35.207.215.104	104.215.207.35.bc.googleusercontent.com	IN
34.1.10.233	?	FR

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 0756356a4e) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-02-05 17:19:17

最後出現: 2022-08-27 04:15:09

遵循robots.txt: 未知

來源

IP地址(7)	伺服器名稱	所屬國家
35.217.51.214	?	FI
3.128.79.74	ec2-3-128-79-74.us-east-2.compute.amazonaws.com	US
35.87.86.67	ec2-35-87-86-67.us-west-2.compute.amazonaws.com	US
18.216.214.63	ec2-18-216-214-63.us-east-2.compute.amazonaws.com	US
35.208.60.118	?	US
3.145.112.208	ec2-3-145-112-208.us-east-2.compute.amazonaws.com	US
35.217.48.162	?	FI

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 8b8d52af0d) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-02-05 15:07:51

最後出現: 2022-08-27 00:01:52

遵循robots.txt: 未知

來源

IP地址(7)	伺服器名稱	所屬國家
35.211.224.135	?	US
35.215.51.71	?	CA
54.171.212.141	ec2-54-171-212-141.eu-west-1.compute.amazonaws.com	IE
3.143.239.95	ec2-3-143-239-95.us-east-2.compute.amazonaws.com	US
34.222.190.88	ec2-34-222-190-88.us-west-2.compute.amazonaws.com	US
35.84.24.155	ec2-35-84-24-155.us-west-2.compute.amazonaws.com	US
35.212.232.39	?	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 50dcc0e8d1) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-02-03 15:26:50

最後出現: 2022-08-24 02:53:03

遵循robots.txt: 未知

來源

IP地址(8)	伺服器名稱	所屬國家
35.213.167.52	?	SG
44.200.61.147	ec2-44-200-61-147.compute-1.amazonaws.com	US
35.208.170.235	?	?
34.253.228.106	ec2-34-253-228-106.eu-west-1.compute.amazonaws.com	IE
35.84.2.231	ec2-35-84-2-231.us-west-2.compute.amazonaws.com	US
35.215.13.197	?	CA
35.212.163.212	?	US
44.234.254.117	ec2-44-234-254-117.us-west-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 22542faf4a) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-02-02 12:55:12

最後出現: 2022-08-22 15:46:54

遵循robots.txt: 未知

來源

IP地址(7)	伺服器名稱	所屬國家
35.212.239.193	?	US
35.217.92.253	?	US
35.84.189.251	ec2-35-84-189-251.us-west-2.compute.amazonaws.com	US
35.217.23.45	?	FI
35.217.36.186	?	FI
35.206.253.134	?	TW
35.211.201.14	?	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; f7a1fd935a) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-01-23 05:55:22

最後出現: 2022-08-20 16:49:24

遵循robots.txt: 未知

來源

IP地址(9)	伺服器名稱	所屬國家
35.210.151.25	?	BE
35.211.177.192	?	US
3.99.174.5	ec2-3-99-174-5.ca-central-1.compute.amazonaws.com	CA
35.217.0.133	?	FI
3.15.149.246	ec2-3-15-149-246.us-east-2.compute.amazonaws.com	US
34.222.194.203	ec2-34-222-194-203.us-west-2.compute.amazonaws.com	US
44.235.74.220	ec2-44-235-74-220.us-west-2.compute.amazonaws.com	US
35.217.36.186	?	FI
3.142.164.216	ec2-3-142-164-216.us-east-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; a2244af186) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-01-26 03:07:25

最後出現: 2022-08-11 11:15:17

遵循robots.txt: 未知

來源

IP地址(7)	伺服器名稱	所屬國家
35.206.153.39	?	BE
35.215.117.69	?	US
13.210.79.45	ec2-13-210-79-45.ap-southeast-2.compute.amazonaws.com	AU
35.215.64.144	?	US
104.45.194.225	?	US
35.207.231.2	?	IN
18.218.185.175	ec2-18-218-185-175.us-east-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 85f6ace805) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-01-19 13:56:44

最後出現: 2022-08-06 22:34:46

遵循robots.txt: 未知

來源

IP地址(7)	伺服器名稱	所屬國家
35.217.123.100	?	US
35.206.194.63	?	TW
35.213.211.88	?	AU
3.126.55.41	ec2-3-126-55-41.eu-central-1.compute.amazonaws.com	DE
3.23.92.26	ec2-3-23-92-26.us-east-2.compute.amazonaws.com	US
3.22.79.139	ec2-3-22-79-139.us-east-2.compute.amazonaws.com	US
18.133.181.190	ec2-18-133-181-190.eu-west-2.compute.amazonaws.com	GB

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 6fd1c55da3) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-02-09 11:10:21

最後出現: 2022-07-22 17:54:06

遵循robots.txt: 未知

來源

IP地址(6)	伺服器名稱	所屬國家
35.212.72.131	131.72.212.35.bc.googleusercontent.com	US
35.213.223.219	219.223.213.35.bc.googleusercontent.com	AU
35.213.234.99	99.234.213.35.bc.googleusercontent.com	AU
35.213.133.191	191.133.213.35.bc.googleusercontent.com	SG
35.213.241.103	103.241.213.35.bc.googleusercontent.com	AU
44.242.145.97	ec2-44-242-145-97.us-west-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S; 57a74ea5be) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2022-03-02 00:10:31

最後出現: 2022-07-13 18:01:14

遵循robots.txt: 未知

來源

IP地址(9)	伺服器名稱	所屬國家
35.87.64.110	ec2-35-87-64-110.us-west-2.compute.amazonaws.com	US
35.214.190.203	?	NL
35.212.179.95	?	US
44.200.185.9	ec2-44-200-185-9.compute-1.amazonaws.com	US
3.138.204.69	ec2-3-138-204-69.us-east-2.compute.amazonaws.com	US
35.217.123.100	?	US
35.208.97.249	?	US
35.206.153.39	?	BE
35.211.132.229	?	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S) Chrome/74.0.3729.131 Safari/537.36

首次出現: 2020-04-29 05:40:31

最後出現: 2022-03-02 16:02:33

遵循robots.txt: 未知

來源

IP地址(111)	伺服器名稱	所屬國家
104.45.194.225	104.45.194.225	US
44.230.202.248	ec2-44-230-202-248.us-west-2.compute.amazonaws.com	US
35.208.51.137	137.51.208.35.bc.googleusercontent.com	US
35.219.139.221	221.139.219.35.bc.googleusercontent.com	US
3.144.1.0	ec2-3-144-1-0.us-east-2.compute.amazonaws.com	US
34.204.194.230	ec2-34-204-194-230.compute-1.amazonaws.com	US
35.84.133.19	ec2-35-84-133-19.us-west-2.compute.amazonaws.com	US
35.215.13.197	197.13.215.35.bc.googleusercontent.com	?
35.212.163.212	212.163.212.35.bc.googleusercontent.com	US
35.213.234.99	99.234.213.35.bc.googleusercontent.com	AU

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2020-08-09 13:37:16

最後出現: 2022-03-02 06:08:50

遵循robots.txt: 未知

來源

IP地址(462)	伺服器名稱	所屬國家
35.217.31.190	?	FI
35.211.95.9	?	US
35.217.92.253	?	US
35.213.167.52	?	SG
35.206.153.39	?	BE
35.217.96.49	?	US
35.213.234.99	99.234.213.35.bc.googleusercontent.com	AU
35.86.233.110	ec2-35-86-233-110.us-west-2.compute.amazonaws.com	US
35.213.176.218	?	SG
35.217.97.157	?	US
35.208.51.137	137.51.208.35.bc.googleusercontent.com	US
35.211.201.14	?	US
35.214.242.237	?	NL
35.215.121.179	?	US
3.234.140.140	ec2-3-234-140-140.compute-1.amazonaws.com	US
35.206.82.75	?	?
35.213.211.88	?	AU
35.212.203.104	?	US
35.217.43.61	?	FI
35.209.133.94	?	US
35.208.69.188	?	US
35.213.241.103	?	AU
35.206.194.63	?	TW
35.208.166.254	?	US
35.206.253.134	?	TW
35.217.2.217	?	FI
35.208.7.7	?	US
35.215.117.69	?	US
35.212.153.217	?	US
35.214.190.203	?	NL
35.209.181.3	?	US
35.213.223.219	219.223.213.35.bc.googleusercontent.com	AU
35.217.123.100	?	US
3.126.55.41	ec2-3-126-55-41.eu-central-1.compute.amazonaws.com	DE
3.23.92.26	ec2-3-23-92-26.us-east-2.compute.amazonaws.com	US
3.22.79.139	ec2-3-22-79-139.us-east-2.compute.amazonaws.com	US
18.133.181.190	ec2-18-133-181-190.eu-west-2.compute.amazonaws.com	GB
35.210.151.25	?	BE
35.212.239.193	?	US
35.84.189.251	ec2-35-84-189-251.us-west-2.compute.amazonaws.com	US
35.217.23.45	?	FI
35.217.36.186	?	FI
35.212.253.196	?	US
35.211.224.135	?	US
35.215.51.71	?	CA
54.171.212.141	ec2-54-171-212-141.eu-west-1.compute.amazonaws.com	IE
3.143.239.95	ec2-3-143-239-95.us-east-2.compute.amazonaws.com	US
34.222.190.88	ec2-34-222-190-88.us-west-2.compute.amazonaws.com	US
35.84.24.155	ec2-35-84-24-155.us-west-2.compute.amazonaws.com	US
35.212.232.39	?	US
35.209.96.24	?	US
44.200.61.147	ec2-44-200-61-147.compute-1.amazonaws.com	US
35.208.170.235	?	US
34.253.228.106	ec2-34-253-228-106.eu-west-1.compute.amazonaws.com	IE
35.84.2.231	ec2-35-84-2-231.us-west-2.compute.amazonaws.com	US
35.215.13.197	197.13.215.35.bc.googleusercontent.com	CA
35.212.163.212	212.163.212.35.bc.googleusercontent.com	US
44.234.254.117	ec2-44-234-254-117.us-west-2.compute.amazonaws.com	US
35.87.64.110	ec2-35-87-64-110.us-west-2.compute.amazonaws.com	US
35.212.179.95	?	US
44.200.185.9	ec2-44-200-185-9.compute-1.amazonaws.com	US
3.138.204.69	ec2-3-138-204-69.us-east-2.compute.amazonaws.com	US
35.208.97.249	?	US
35.211.132.229	?	US
13.210.79.45	ec2-13-210-79-45.ap-southeast-2.compute.amazonaws.com	AU
35.215.64.144	?	US
104.45.194.225	104.45.194.225	US
35.207.231.2	?	IN
18.218.185.175	ec2-18-218-185-175.us-east-2.compute.amazonaws.com	US
35.211.177.192	?	US
3.99.174.5	ec2-3-99-174-5.ca-central-1.compute.amazonaws.com	CA
35.217.0.133	?	FI
3.15.149.246	ec2-3-15-149-246.us-east-2.compute.amazonaws.com	US
34.222.194.203	ec2-34-222-194-203.us-west-2.compute.amazonaws.com	US
44.235.74.220	ec2-44-235-74-220.us-west-2.compute.amazonaws.com	US
3.142.164.216	ec2-3-142-164-216.us-east-2.compute.amazonaws.com	US
35.217.51.214	?	FI
3.128.79.74	ec2-3-128-79-74.us-east-2.compute.amazonaws.com	US
35.87.86.67	ec2-35-87-86-67.us-west-2.compute.amazonaws.com	US
18.216.214.63	ec2-18-216-214-63.us-east-2.compute.amazonaws.com	US
35.208.60.118	?	US
3.145.112.208	ec2-3-145-112-208.us-east-2.compute.amazonaws.com	US
35.217.48.162	?	FI
35.212.72.131	131.72.212.35.bc.googleusercontent.com	US
35.213.133.191	191.133.213.35.bc.googleusercontent.com	SG
44.242.145.97	ec2-44-242-145-97.us-west-2.compute.amazonaws.com	US
44.230.202.248	ec2-44-230-202-248.us-west-2.compute.amazonaws.com	US
35.219.139.221	221.139.219.35.bc.googleusercontent.com	US
3.144.1.0	ec2-3-144-1-0.us-east-2.compute.amazonaws.com	US
34.204.194.230	ec2-34-204-194-230.compute-1.amazonaws.com	US
35.84.133.19	ec2-35-84-133-19.us-west-2.compute.amazonaws.com	US
35.219.137.69	69.137.219.35.bc.googleusercontent.com	US
51.161.15.95	elmo.builtwith.xyz	FR
35.215.8.122	?	US
35.217.33.156	156.33.217.35.bc.googleusercontent.com	FI
51.161.84.56	unicorn.builtwith.xyz	CA
3.127.66.58	ec2-3-127-66-58.eu-central-1.compute.amazonaws.com	DE
54.218.84.150	ec2-54-218-84-150.us-west-2.compute.amazonaws.com	US
35.215.39.199	?	CA
35.212.159.108	?	US
35.208.7.196	?	US
35.217.15.240	?	FI
35.209.103.171	?	US
44.200.7.14	ec2-44-200-7-14.compute-1.amazonaws.com	US
35.217.74.140	?	US
35.211.10.21	?	US
35.211.253.98	?	US
3.238.222.226	ec2-3-238-222-226.compute-1.amazonaws.com	US
35.211.17.242	?	US
35.206.82.85	?	US
35.217.19.207	?	?
35.212.234.187	?	US
35.212.175.213	?	US
35.213.191.235	?	SG
35.217.37.67	?	FI
35.217.88.92	?	US
35.214.204.123	?	NL
35.212.222.235	?	US
35.215.64.28	?	US
35.212.211.76	?	US
35.217.23.130	?	FI
35.211.248.167	?	US
35.217.73.164	?	US
35.209.79.175	?	US
35.215.84.249	?	US
35.209.187.78	?	US
35.211.139.15	?	US
18.197.19.255	ec2-18-197-19-255.eu-central-1.compute.amazonaws.com	DE
35.206.215.15	?	TW
35.217.26.113	?	FI
35.212.137.141	?	US
18.184.122.106	ec2-18-184-122-106.eu-central-1.compute.amazonaws.com	DE
35.208.11.114	?	US
35.213.203.149	?	AU
35.215.47.24	?	CA
35.206.153.204	?	BE
35.217.37.226	?	FI
35.213.233.14	?	AU
35.157.134.76	ec2-35-157-134-76.eu-central-1.compute.amazonaws.com	DE
52.59.231.99	ec2-52-59-231-99.eu-central-1.compute.amazonaws.com	DE
35.212.26.22	?	US
35.215.117.203	?	US
35.213.230.86	?	AU
18.196.145.56	ec2-18-196-145-56.eu-central-1.compute.amazonaws.com	DE
35.213.211.32	?	AU
18.184.6.77	ec2-18-184-6-77.eu-central-1.compute.amazonaws.com	DE
35.215.23.242	?	CA
35.219.134.110	?	US
35.214.140.188	?	NL
35.217.81.157	?	US
35.206.209.249	?	TW
35.215.88.36	?	US
35.215.80.210	?	US
35.214.161.13	?	NL
35.206.238.205	?	TW
35.212.110.19	?	US
35.213.201.35	?	AU
35.217.107.235	?	US
35.217.69.220	?	US
35.215.19.159	159.19.215.35.bc.googleusercontent.com	CA
35.219.178.21	?	US
35.212.166.193	?	US
35.213.224.188	?	?
35.215.112.133	?	US
35.207.193.163	?	IN
35.212.165.230	?	?
35.214.182.31	?	NL
35.219.149.75	?	US
35.215.70.21	?	US
35.212.10.132	?	US
35.217.6.152	?	FI
35.217.106.247	?	US
35.206.213.227	?	TW
35.217.51.60	?	FI
35.215.39.164	?	CA
35.217.97.198	?	US
35.207.233.125	?	IN
35.219.152.214	?	US
35.212.135.45	?	US
35.212.17.113	?	US
35.211.111.19	?	US
35.206.215.9	?	TW
35.213.218.132	?	AU
35.219.129.250	?	US
35.214.230.110	?	NL
35.213.193.173	?	AU
35.215.123.183	?	US
35.212.23.243	?	US
35.217.100.136	?	US
35.206.212.199	?	TW
35.206.204.142	?	TW
35.206.218.64	?	TW
35.212.111.31	?	US
35.206.240.199	?	?
35.217.117.104	?	US
35.213.195.154	?	AU
35.217.62.62	?	FI
35.215.51.85	?	CA
35.212.181.64	?	US
35.206.236.22	?	TW
35.215.72.56	?	US
35.215.1.54	?	CA
35.214.160.163	?	NL
35.212.205.117	?	US
35.212.130.102	?	US
35.206.242.182	?	TW
35.214.212.20	?	NL
35.214.151.249	?	NL
35.213.210.5	?	AU
35.213.222.68	?	AU
35.214.225.59	?	NL
35.215.47.153	?	CA
35.212.98.156	?	US
35.212.254.39	?	US
35.212.6.2	?	US
35.212.246.152	?	US
35.214.172.168	?	NL
35.212.89.123	?	US
35.212.199.227	?	US
35.217.22.43	?	FI
35.214.129.139	?	NL
35.212.146.14	?	US
35.219.166.80	?	US
35.208.177.52	?	US
35.206.202.163	?	TW
35.215.84.203	?	US
35.212.124.35	?	US
35.215.99.143	?	US
35.207.5.150	?	US
35.219.135.173	?	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BW/1.1; bit.ly/2W6Px8S) Chrome/84.0.4147.105 Safari/537.36

首次出現: 2020-08-09 13:37:16

最後出現: 2022-03-02 06:08:50

遵循robots.txt: 未知

來源

IP地址(462)	伺服器名稱	所屬國家
35.213.167.52	?	SG
35.219.137.69	69.137.219.35.bc.googleusercontent.com	US
51.161.15.95	elmo.builtwith.xyz	FR
35.215.8.122	?	US
35.213.241.103	?	AU
35.217.33.156	156.33.217.35.bc.googleusercontent.com	FI
51.161.84.56	unicorn.builtwith.xyz	CA
35.219.139.221	221.139.219.35.bc.googleusercontent.com	US
3.127.66.58	ec2-3-127-66-58.eu-central-1.compute.amazonaws.com	DE
54.218.84.150	ec2-54-218-84-150.us-west-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36

首次出現: 2019-12-01 18:40:16

最後出現: 2020-06-17 03:25:44

遵循robots.txt: 未知

來源

IP地址(220)	伺服器名稱	所屬國家
37.225.8.119	public-gprs549174.centertel.pl	PL
31.0.40.226	apn-31-0-40-226.dynamic.gprs.plus.pl	PL
37.225.8.85	public-gprs549140.centertel.pl	PL
37.248.224.10	apn-37-248-224-10.data.lycamobile.pl	PL
31.0.47.86	apn-31-0-47-86.dynamic.gprs.plus.pl	PL
31.0.46.210	apn-31-0-46-210.dynamic.gprs.plus.pl	PL
31.0.69.249	apn-31-0-69-249.dynamic.gprs.plus.pl	PL
31.0.82.191	ip-31-0-82-191.dynamic.gprs.plus.pl	PL
100.20.59.123	ec2-100-20-59-123.us-west-2.compute.amazonaws.com	US
37.225.12.193	public-gprs550272.centertel.pl	PL
37.248.224.225	apn-37-248-224-225.data.lycamobile.pl	PL
52.53.243.114	ec2-52-53-243-114.us-west-1.compute.amazonaws.com	US
18.228.219.23	ec2-18-228-219-23.sa-east-1.compute.amazonaws.com	BR
3.249.36.83	ec2-3-249-36-83.eu-west-1.compute.amazonaws.com	US
3.112.27.172	ec2-3-112-27-172.ap-northeast-1.compute.amazonaws.com	JP
18.229.140.74	ec2-18-229-140-74.sa-east-1.compute.amazonaws.com	BR
54.234.64.247	ec2-54-234-64-247.compute-1.amazonaws.com	US
100.26.253.226	ec2-100-26-253-226.compute-1.amazonaws.com	US
95.216.200.193	?	FI
54.198.79.48	ec2-54-198-79-48.compute-1.amazonaws.com	US
54.90.56.51	ec2-54-90-56-51.compute-1.amazonaws.com	US
158.69.52.114	bst.builtwith.xyz	CA
13.250.125.83	ec2-13-250-125-83.ap-southeast-1.compute.amazonaws.com	SG
15.235.50.228	juno.builtwith.xyz	CA

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36

首次出現: 2019-12-01 18:40:16

最後出現: 2020-06-17 03:25:44

遵循robots.txt: 未知

來源

IP地址(220)	伺服器名稱	所屬國家
52.53.243.114	ec2-52-53-243-114.us-west-1.compute.amazonaws.com	US
18.228.219.23	ec2-18-228-219-23.sa-east-1.compute.amazonaws.com	BR
3.249.36.83	ec2-3-249-36-83.eu-west-1.compute.amazonaws.com	US
3.112.27.172	ec2-3-112-27-172.ap-northeast-1.compute.amazonaws.com	JP
18.229.140.74	ec2-18-229-140-74.sa-east-1.compute.amazonaws.com	BR
54.234.64.247	ec2-54-234-64-247.compute-1.amazonaws.com	US
100.26.253.226	ec2-100-26-253-226.compute-1.amazonaws.com	US
95.216.200.193	?	FI
54.198.79.48	ec2-54-198-79-48.compute-1.amazonaws.com	US
54.90.56.51	ec2-54-90-56-51.compute-1.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.1; http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36

首次出現: 2020-04-25 23:30:12

最後出現: 2020-04-25 23:30:16

遵循robots.txt: 未知

來源

IP地址(1)	伺服器名稱	所屬國家
3.235.85.188	ec2-3-235-85-188.compute-1.amazonaws.com	US
3.231.57.174	ec2-3-231-57-174.compute-1.amazonaws.com	US
18.237.179.230	ec2-18-237-179-230.us-west-2.compute.amazonaws.com	US
34.222.64.224	ec2-34-222-64-224.us-west-2.compute.amazonaws.com	US
63.33.190.92	ec2-63-33-190-92.eu-west-1.compute.amazonaws.com	IE
34.241.92.116	ec2-34-241-92-116.eu-west-1.compute.amazonaws.com	IE
3.83.21.4	ec2-3-83-21-4.compute-1.amazonaws.com	US
34.220.246.160	ec2-34-220-246-160.us-west-2.compute.amazonaws.com	US
34.209.33.141	ec2-34-209-33-141.us-west-2.compute.amazonaws.com	US
34.220.63.207	ec2-34-220-63-207.us-west-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.1; http://builtwith.com/biup) Chrome/74.0.3729.131 Safari/537.36

首次出現: 2020-04-25 23:30:12

最後出現: 2020-04-25 23:30:16

遵循robots.txt: 未知

來源

IP地址(1)	伺服器名稱	所屬國家
34.220.63.207	ec2-34-220-63-207.us-west-2.compute.amazonaws.com	US

使用者代理字串: Mozilla/5.0 (X11; Ubuntu; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; BuiltWith/1.0; +http://builtwith.com/biup) Chrome/60.0.3112.101 Safari/537.36

首次出現: 2020-01-18 05:54:29

最後出現: 2020-03-25 21:20:22

遵循robots.txt: 未知

來源

IP地址(3)	伺服器名稱	所屬國家
54.90.56.51	ec2-54-90-56-51.compute-1.amazonaws.com	US
158.69.52.114	bst.builtwith.xyz	CA
13.250.125.83	ec2-13-250-125-83.ap-southeast-1.compute.amazonaws.com	SG

使用者代理字串: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US) AppleWebKit/534.13 (KHTML, like Gecko) Chrome/9.0.597.107 Safari/534.13 BuiltWith/1.2

首次出現: 2019-09-19 23:51:44

最後出現: 2019-09-19 23:51:44

遵循robots.txt: 未知

來源

IP地址(10)	伺服器名稱	所屬國家
195.242.80.29	195.242.80.29	UA
195.242.80.91	195.242.80.91	UA
195.242.80.31	195.242.80.31	UA
195.242.80.130	195.242.80.130	UA
195.242.80.92	195.242.80.92	UA
195.242.80.26	195.242.80.26	UA
195.242.80.47	195.242.80.47	UA
195.242.80.41	195.242.80.41	UA
198.27.69.78	ns508339.ip-198-27-69.net	CA
88.198.48.141	static.88-198-48-141.clients.your-server.de	DE

使用者代理字串: builtwith

首次出現: 2017-07-04 08:12:54

最後出現: 2017-07-04 08:12:54

遵循robots.txt: 未知

來源

IP地址(1)	伺服器名稱	所屬國家
151.80.98.81	ns3052559.ip-151-80-98.eu	FR

訪問控制

瞭解如何控制BuiltWith crawler訪問許可權，避免BuiltWith crawler抓取行為不當。

是否攔截BuiltWith crawler？

可能不需要。工具型別爬蟲通常為網站所有者使用此類工具對網站進行相關服務請求才會出現。當然，實際情況需站長判斷後再作決定。

通過Robots.txt攔截

您可以通過在網站的 robots.txt 中設定使用者代理訪問規則來遮蔽 BuiltWith crawler 或限制其訪問許可權。我們建議安裝 Spider Analyser 外掛，以檢查它是否真正遵循這些規則。

# robots.txt

# 下列程式碼一般情況可以攔截該代理

User-agent: BuiltWith crawler

Disallow: /

# robots.txt # 下列程式碼一般情況可以攔截該代理 User-agent: BuiltWith crawler Disallow: /

# robots.txt
# 下列程式碼一般情況可以攔截該代理
User-agent: BuiltWith crawler
Disallow: /

您無需手動執行此操作，可通過我們的 Wordpress 外掛 Spider Analyser 來攔截不必要的蜘蛛或者爬蟲。

站長工具

我們為站長量身定做的高效工具集。

檢視全部工具

常見蜘蛛/爬蟲

Common Spiders

Google Firebase

Google Firebase蜘蛛/爬蟲屬於工具型別，由Google Inc.開發執行。您可以繼續閱讀下方資訊，以深入瞭解Google Firebase基本資訊，使用者代理和訪問控制等。

magereport

magereport蜘蛛/爬蟲屬於工具型別，由Hypernode B.V.開發執行。您可以繼續閱讀下方資訊，以深入瞭解magereport基本資訊，使用者代理和訪問控制等。

7Siters

7Siters蜘蛛/爬蟲屬於工具型別，由Re-Re Web Studio開發執行。您可以繼續閱讀下方資訊，以深入瞭解7Siters基本資訊，使用者代理和訪問控制等。

GoodBarber

GoodBarber蜘蛛/爬蟲屬於工具型別，由GoodBarber SAS開發執行。您可以繼續閱讀下方資訊，以深入瞭解GoodBarber基本資訊，使用者代理和訪問控制等。

PWABuilder

PWABuilder蜘蛛/爬蟲屬於工具型別，由Microsoft Corporation.開發執行。您可以繼續閱讀下方資訊，以深入瞭解PWABuilder基本資訊，使用者代理和訪問控制等。

webzio

webzio蜘蛛/爬蟲屬於工具型別，由Webz.io Ltd.開發執行。您可以繼續閱讀下方資訊，以深入瞭解webzio基本資訊，使用者代理和訪問控制等。

globalping bot

globalping bot蜘蛛/爬蟲屬於工具型別，由globalping.io開發執行。您可以繼續閱讀下方資訊，以深入瞭解globalping bot基本資訊，使用者代理和訪問控制等。

Googlebot

GoogleBot蜘蛛/爬蟲屬於搜尋引擎型別，由Google Inc.開發執行。您可以繼續閱讀下方資訊，以深入瞭解GoogleBot基本資訊，使用者代理和訪問控制等。

如何做搜尋引擎蜘蛛日誌分析

搜尋引擎蜘蛛日誌檔案是一種非常強大但未被站長充分利用的檔案，分析它可以獲取有關每個搜尋引擎如何爬取網站內容的相關資訊點，及檢視搜尋引擎蜘蛛在一段時間內的行為。

什麼是抓取預算（Crawl Budget）及如何最大化其利用價值

抓取預算（Crawl Budget），您又可以將之稱為抓取頻率、抓取量。這個量一般是由搜尋引擎蜘蛛根據網站的質量度和權重給域名分配的。理解抓取預算的定義，重要性及最大化其效率，這有利於網站的索引、排名。

怎樣才算有利於SEO的網站結構

眾所周知，扁平且層級不超過三級的網站結構是最有利於搜尋引擎蜘蛛爬取的。顯淺的一句看似易懂但如深入，又未必是那麼容易理解。下面我們將深入瞭解網站結構的定義，重要性及實踐，以便於各位技術開發、站長和SEOer在未來的網站開發及運營中應用。

為什麼要控制Googlebot抓取速度？

在本文中，我們將瞭解您為什麼要控制Googlebot以及如何控制Googlebot和其他搜尋引擎爬蟲的抓取速度。

如何攔截Google和Bing訪問您的網站？

在本文中，我們將解釋如何遮蔽Googlebot和Bingbot，遮蔽爬蟲後會發生什麼以及出現爬取問題的常見原因。

Bing網站管理員工具Bingbot網站爬取頻率設定

Bing網站管理員工具中的爬網空間功能允許網站管理員控制Bingbot抓取您的網站的速率。當您的網站上有訪問者以適當地管理頻寬時，需要進行爬網控制以限制Bingbot和Googlebot等搜尋引擎蜘蛛的活動。

WordPress攔截IP地址的6種方法

當網站規模擴大時，您需要採取某些措施來限制來自評論垃圾郵件傳送者、無效機器人和人類攻擊者的流量。這對於保護您的伺服器資源可用於真實使用者以及您支付託管費用以獲得真實訪問者至關重要。在本文中，我們將解釋在WordPress中攔截IP地址的6種方法。

如何禁止搜尋引擎索引WordPress網站

您可能想要隱藏站點上的內容的原因有很多，但依靠“建議搜尋引擎不索引本站點”選項並不是確保此類內容不被看到的最佳方法。除非您想在網路上隱藏您的整個網站，否則永遠不要單擊此選項，因為如果不小心切換，它會對您的SEO造成巨大損害。

BuiltWith crawler

基本資訊

使用者代理

訪問控制

是否攔截BuiltWith crawler？

通過Robots.txt攔截

站長工具

常見蜘蛛/爬蟲

相關文章