Friendly_Crawler

基本信息

Friendly_Crawler的基本信息如下表。但部分不是很规范的蜘蛛和爬虫，可能存在信息不明的情况。

蜘蛛/爬虫名称: Friendly_Crawler

类型: 爬虫

开发商: Unknown Author

当前状态: 活动

用户代理

关于Friendly_Crawler蜘蛛或者爬虫的用户代理字符串，IP地址和服务器，所在地等信息如下表格所示：

用户代理字符串: Friendly_Crawler/Nutch-1.20-SNAPSHOT

首次出现: 2024-04-23 18:33:40

最后出现: 2024-05-19 12:41:12

遵循robots.txt: 未知

来源

IP地址(110)	服务器名称	所属国家
54.245.58.226	ec2-54-245-58-226.us-west-2.compute.amazonaws.com	US
35.88.62.217	ec2-35-88-62-217.us-west-2.compute.amazonaws.com	US
54.200.127.44	ec2-54-200-127-44.us-west-2.compute.amazonaws.com	US
54.245.76.133	ec2-54-245-76-133.us-west-2.compute.amazonaws.com	US
52.34.114.69	ec2-52-34-114-69.us-west-2.compute.amazonaws.com	US
34.218.206.182	ec2-34-218-206-182.us-west-2.compute.amazonaws.com	US
54.218.196.168	ec2-54-218-196-168.us-west-2.compute.amazonaws.com	US
54.202.40.141	ec2-54-202-40-141.us-west-2.compute.amazonaws.com	US
35.94.223.147	ec2-35-94-223-147.us-west-2.compute.amazonaws.com	US
54.202.32.191	ec2-54-202-32-191.us-west-2.compute.amazonaws.com	US
52.36.51.201	ec2-52-36-51-201.us-west-2.compute.amazonaws.com	US
54.244.16.223	ec2-54-244-16-223.us-west-2.compute.amazonaws.com	US
35.87.104.39	ec2-35-87-104-39.us-west-2.compute.amazonaws.com	US
54.201.146.27	ec2-54-201-146-27.us-west-2.compute.amazonaws.com	US
54.68.138.61	ec2-54-68-138-61.us-west-2.compute.amazonaws.com	US
34.220.48.173	ec2-34-220-48-173.us-west-2.compute.amazonaws.com	US
54.185.132.207	ec2-54-185-132-207.us-west-2.compute.amazonaws.com	US
35.86.177.145	ec2-35-86-177-145.us-west-2.compute.amazonaws.com	US
34.209.130.93	ec2-34-209-130-93.us-west-2.compute.amazonaws.com	US
54.188.204.146	ec2-54-188-204-146.us-west-2.compute.amazonaws.com	US
35.92.77.33	ec2-35-92-77-33.us-west-2.compute.amazonaws.com	US
52.12.108.254	ec2-52-12-108-254.us-west-2.compute.amazonaws.com	US
18.236.124.9	ec2-18-236-124-9.us-west-2.compute.amazonaws.com	US
34.219.192.215	ec2-34-219-192-215.us-west-2.compute.amazonaws.com	?
34.222.15.88	ec2-34-222-15-88.us-west-2.compute.amazonaws.com	?
35.93.119.233	ec2-35-93-119-233.us-west-2.compute.amazonaws.com	US
54.202.213.4	ec2-54-202-213-4.us-west-2.compute.amazonaws.com	US
35.92.238.63	ec2-35-92-238-63.us-west-2.compute.amazonaws.com	US
52.38.29.14	ec2-52-38-29-14.us-west-2.compute.amazonaws.com	US
35.91.204.156	ec2-35-91-204-156.us-west-2.compute.amazonaws.com	US
34.213.217.220	ec2-34-213-217-220.us-west-2.compute.amazonaws.com	US
54.190.169.5	ec2-54-190-169-5.us-west-2.compute.amazonaws.com	US
35.87.133.24	ec2-35-87-133-24.us-west-2.compute.amazonaws.com	US
54.190.151.84	ec2-54-190-151-84.us-west-2.compute.amazonaws.com	US
35.94.234.223	ec2-35-94-234-223.us-west-2.compute.amazonaws.com	US
52.37.62.147	ec2-52-37-62-147.us-west-2.compute.amazonaws.com	US
34.213.97.65	ec2-34-213-97-65.us-west-2.compute.amazonaws.com	US
54.187.56.35	ec2-54-187-56-35.us-west-2.compute.amazonaws.com	US
54.188.202.140	ec2-54-188-202-140.us-west-2.compute.amazonaws.com	US
54.188.207.77	ec2-54-188-207-77.us-west-2.compute.amazonaws.com	US
34.222.28.218	ec2-34-222-28-218.us-west-2.compute.amazonaws.com	US
35.90.59.43	ec2-35-90-59-43.us-west-2.compute.amazonaws.com	US
54.184.16.114	ec2-54-184-16-114.us-west-2.compute.amazonaws.com	US
34.219.236.237	ec2-34-219-236-237.us-west-2.compute.amazonaws.com	US
34.212.197.114	ec2-34-212-197-114.us-west-2.compute.amazonaws.com	US
54.70.238.66	ec2-54-70-238-66.us-west-2.compute.amazonaws.com	US
35.90.44.70	ec2-35-90-44-70.us-west-2.compute.amazonaws.com	US
34.221.149.174	ec2-34-221-149-174.us-west-2.compute.amazonaws.com	US
35.90.31.246	ec2-35-90-31-246.us-west-2.compute.amazonaws.com	US
34.219.197.206	ec2-34-219-197-206.us-west-2.compute.amazonaws.com	?
54.184.11.160	ec2-54-184-11-160.us-west-2.compute.amazonaws.com	US
34.220.68.221	ec2-34-220-68-221.us-west-2.compute.amazonaws.com	US
54.185.163.180	ec2-54-185-163-180.us-west-2.compute.amazonaws.com	US
35.92.164.188	ec2-35-92-164-188.us-west-2.compute.amazonaws.com	US
54.70.59.112	ec2-54-70-59-112.us-west-2.compute.amazonaws.com	US
35.95.138.255	ec2-35-95-138-255.us-west-2.compute.amazonaws.com	US
54.200.65.208	ec2-54-200-65-208.us-west-2.compute.amazonaws.com	US
35.90.134.157	ec2-35-90-134-157.us-west-2.compute.amazonaws.com	US
35.161.141.141	ec2-35-161-141-141.us-west-2.compute.amazonaws.com	US
34.220.5.215	ec2-34-220-5-215.us-west-2.compute.amazonaws.com	US
35.90.26.13	ec2-35-90-26-13.us-west-2.compute.amazonaws.com	US
34.220.35.46	ec2-34-220-35-46.us-west-2.compute.amazonaws.com	US
34.221.60.164	ec2-34-221-60-164.us-west-2.compute.amazonaws.com	US
35.165.102.28	ec2-35-165-102-28.us-west-2.compute.amazonaws.com	US
34.210.69.215	ec2-34-210-69-215.us-west-2.compute.amazonaws.com	US

用户代理字符串: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/605.1.16 (KHTML, like Gecko; compatible; Friendly_Crawler/2.0) Chrome/120.0.6099.217 Safari/605.1.15/Nutch-1.20-SNAPSHOT

首次出现: 2024-04-06 03:17:01

最后出现: 2024-04-12 03:26:05

遵循robots.txt: 未知

来源

IP地址(20)	服务器名称	所属国家
35.161.9.6	ec2-35-161-9-6.us-west-2.compute.amazonaws.com	US
35.90.234.218	ec2-35-90-234-218.us-west-2.compute.amazonaws.com	US
35.164.138.143	ec2-35-164-138-143.us-west-2.compute.amazonaws.com	?
35.93.4.205	ec2-35-93-4-205.us-west-2.compute.amazonaws.com	US
35.90.24.145	ec2-35-90-24-145.us-west-2.compute.amazonaws.com	US
54.202.167.18	ec2-54-202-167-18.us-west-2.compute.amazonaws.com	US
35.92.77.1	ec2-35-92-77-1.us-west-2.compute.amazonaws.com	US
34.215.165.240	ec2-34-215-165-240.us-west-2.compute.amazonaws.com	US
34.215.178.220	ec2-34-215-178-220.us-west-2.compute.amazonaws.com	US
52.89.103.111	ec2-52-89-103-111.us-west-2.compute.amazonaws.com	US
18.236.247.116	ec2-18-236-247-116.us-west-2.compute.amazonaws.com	US
34.219.182.147	ec2-34-219-182-147.us-west-2.compute.amazonaws.com	US
34.220.47.48	ec2-34-220-47-48.us-west-2.compute.amazonaws.com	US
34.220.4.151	ec2-34-220-4-151.us-west-2.compute.amazonaws.com	US
52.27.133.122	ec2-52-27-133-122.us-west-2.compute.amazonaws.com	US
34.215.105.176	ec2-34-215-105-176.us-west-2.compute.amazonaws.com	US
18.237.177.79	ec2-18-237-177-79.us-west-2.compute.amazonaws.com	US
34.218.76.67	ec2-34-218-76-67.us-west-2.compute.amazonaws.com	US
54.213.125.205	ec2-54-213-125-205.us-west-2.compute.amazonaws.com	US

访问控制

了解如何控制Friendly_Crawler访问权限，避免Friendly_Crawler抓取行为不当。

是否拦截Friendly_Crawler？

可以考虑拦截。。爬虫通常会下载公开的互联网内容，这些内容默认情况下可以免费访问。不过，如果你不希望你的内容被用于未经授权的目的，你应该拦截它们。

通过Robots.txt拦截

您可以通过在网站的 robots.txt 中设置用户代理访问规则来屏蔽 Friendly_Crawler 或限制其访问权限。我们建议安装 Spider Analyser 插件，以检查它是否真正遵循这些规则。

	# robots.txt
	# 下列代码一般情况可以拦截该代理
	
	User-agent: Friendly_Crawler
	Disallow: /

您无需手动执行此操作，可通过我们的 Wordpress 插件 Spider Analyser 来拦截不必要的蜘蛛或者爬虫。

如何使用WordPress数据包管理应用程序状态

管理任何 WordPress 应用程序的状态（如何处理和组织数据）都是一项挑战。随着项目的发展，跟踪数据流并确保各组件更新的一致性变得越来越困难。WordPress 数据包可以在这方面提供帮助，因为它为状态管理提供了一个强大的解决方案。本文将介绍 WordPress 数据包，探讨其关键概念、实施策略和最佳实践。

Friendly_Crawler

基本信息

用户代理

访问控制

是否拦截Friendly_Crawler？

通过Robots.txt拦截

站长工具

常见蜘蛛/爬虫

相关文章