Storm-crawler
Storm-crawler蜘蛛/爬虫属于爬虫类型，由Unknown Author开发运行。您可以继续阅读下方信息，以深入了解Storm-crawler基本信息，用户代理和访问控制等。
基本信息
Storm-crawler的基本信息如下表。但部分不是很规范的蜘蛛和爬虫，可能存在信息不明的情况。
- 蜘蛛/爬虫名称
- Storm-crawler
- 类型
- 爬虫
- 开发商
-
Unknown Author
- 当前状态
-
活动
用户代理
关于Storm-crawler蜘蛛或者爬虫的用户代理字符串，IP地址和服务器，所在地等信息如下表格所示：
StormCrawler 2.2
-
StormCrawler 2.2
-
Storm Crawler Demo/1.0
-
StormCrawler
-
StormCrawler 1.18
-
StormCrawler 2.1
-
StormCrawler 1.16
-
Anonymous Coward/1.0
-
Crawler Test/1.0
-
SCESbot/1.14
-
StormCrawler Archetype 1.8
-
Storm Crawler test app/1.0
-
G2 Web Services/1.0
-
Anonymous Coward/1.0
-
Anonymous Coward/1.0
- 用户代理字符串
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36/1.0 (built with StormCrawler 2.2; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2022-02-15 19:50:44
- 最后出现
- 2022-12-08 12:45:55
- 遵循robots.txt
- 否
- 来源
-
| IP地址(14) |
服务器名称 |
所属国家 |
| 54.244.41.24 |
ec2-54-244-41-24.us-west-2.compute.amazonaws.com |
US |
| 54.185.161.154 |
ec2-54-185-161-154.us-west-2.compute.amazonaws.com |
US |
| 54.191.252.115 |
ec2-54-191-252-115.us-west-2.compute.amazonaws.com |
US |
| 35.166.1.147 |
ec2-35-166-1-147.us-west-2.compute.amazonaws.com |
US |
| 35.86.186.41 |
ec2-35-86-186-41.us-west-2.compute.amazonaws.com |
US |
| 44.242.171.9 |
ec2-44-242-171-9.us-west-2.compute.amazonaws.com |
US |
| 54.186.136.183 |
ec2-54-186-136-183.us-west-2.compute.amazonaws.com |
US |
| 35.84.185.18 |
ec2-35-84-185-18.us-west-2.compute.amazonaws.com |
US |
| 34.219.135.100 |
ec2-34-219-135-100.us-west-2.compute.amazonaws.com |
US |
| 35.164.180.216 |
ec2-35-164-180-216.us-west-2.compute.amazonaws.com |
US |
| 34.215.94.152 |
ec2-34-215-94-152.us-west-2.compute.amazonaws.com |
US |
| 52.12.168.94 |
ec2-52-12-168-94.us-west-2.compute.amazonaws.com |
US |
| 44.234.39.197 |
ec2-44-234-39-197.us-west-2.compute.amazonaws.com |
US |
- 用户代理字符串
- Storm Crawler Demo/1.0 (built with StormCrawler ${version}; http://stormcrawler.net/; anil@gmail.com)
- 首次出现
- 2022-12-06 22:05:44
- 最后出现
- 2022-12-06 22:05:44
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(1) |
服务器名称 |
所属国家 |
| 20.232.174.70 |
20.232.174.70 |
US |
- 用户代理字符串
- StormCrawler
- 首次出现
- 2021-12-16 21:23:14
- 最后出现
- 2022-05-19 19:56:15
- 遵循robots.txt
- 否
- 来源
-
| IP地址(1) |
服务器名称 |
所属国家 |
| 193.191.148.194 |
wall.nat.iminds.be |
BE |
- 用户代理字符串
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36/1.0 (built with StormCrawler 1.18; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2021-07-24 04:08:43
- 最后出现
- 2021-10-16 07:19:58
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(4) |
服务器名称 |
所属国家 |
| 54.148.79.212 |
ec2-54-148-79-212.us-west-2.compute.amazonaws.com |
US |
| 34.219.135.100 |
ec2-34-219-135-100.us-west-2.compute.amazonaws.com |
US |
| 54.214.182.167 |
ec2-54-214-182-167.us-west-2.compute.amazonaws.com |
US |
| 34.209.62.163 |
ec2-34-209-62-163.us-west-2.compute.amazonaws.com |
US |
- 用户代理字符串
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36/1.0 (built with StormCrawler 2.1; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2021-09-25 06:58:32
- 最后出现
- 2021-10-13 06:35:54
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(2) |
服务器名称 |
所属国家 |
| 52.36.17.177 |
ec2-52-36-17-177.us-west-2.compute.amazonaws.com |
US |
| 35.81.77.114 |
ec2-35-81-77-114.us-west-2.compute.amazonaws.com |
US |
- 用户代理字符串
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36/1.0 (built with StormCrawler 1.16; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2020-08-04 21:44:00
- 最后出现
- 2021-07-11 03:41:00
- 遵循robots.txt
- 否
- 来源
-
| IP地址(4) |
服务器名称 |
所属国家 |
| 34.222.160.91 |
ec2-34-222-160-91.us-west-2.compute.amazonaws.com |
US |
| 52.32.205.101 |
ec2-52-32-205-101.us-west-2.compute.amazonaws.com |
US |
| 52.43.203.3 |
ec2-52-43-203-3.us-west-2.compute.amazonaws.com |
US |
| 54.213.163.234 |
ec2-54-213-163-234.us-west-2.compute.amazonaws.com |
US |
- 用户代理字符串
- Anonymous Coward/1.0 (built with StormCrawler Archetype 1.18-SNAPSHOT; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2021-04-20 19:42:41
- 最后出现
- 2021-04-21 05:57:24
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(1) |
服务器名称 |
所属国家 |
| 109.157.217.137 |
host109-157-217-137.range109-157.btcentralplus.com |
GB |
- 用户代理字符串
- Crawler Test/1.0 (built with StormCrawler Elasticsearch Archetype 1.17; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2021-01-14 17:18:31
- 最后出现
- 2021-01-14 20:29:44
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(2) |
服务器名称 |
所属国家 |
| 94.130.102.72 |
? |
DE |
| 88.198.19.75 |
static.88-198-19-75.clients.your-server.de |
DE |
- 用户代理字符串
- SCESbot/1.14 (built with StormCrawler Archetype 1.14; http://example.com/; some1@example.com)
- 首次出现
- 2020-03-23 15:51:12
- 最后出现
- 2020-03-23 15:51:12
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(1) |
服务器名称 |
所属国家 |
| 171.4.5.177 |
mx-ll-171.4.5-177.dynamic.3bb.in.th |
TH |
- 用户代理字符串
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36/1.0 (built with StormCrawler Archetype 1.8; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2019-02-10 09:42:31
- 最后出现
- 2019-05-09 05:37:06
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(4) |
服务器名称 |
所属国家 |
| 54.186.166.248 |
ec2-54-186-166-248.us-west-2.compute.amazonaws.com |
US |
| 35.162.158.149 |
ec2-35-162-158-149.us-west-2.compute.amazonaws.com |
US |
| 54.188.220.103 |
ec2-54-188-220-103.us-west-2.compute.amazonaws.com |
US |
| 35.162.175.250 |
ec2-35-162-175-250.us-west-2.compute.amazonaws.com |
US |
- 用户代理字符串
- Storm Crawler test app/1.0 (built with StormCrawler Archetype 1.13; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2019-02-06 23:28:59
- 最后出现
- 2019-02-06 23:28:59
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(1) |
服务器名称 |
所属国家 |
| 116.202.31.166 |
static.166.31.202.116.clients.your-server.de |
DE |
- 用户代理字符串
- G2 Web Services/1.0 (built with StormCrawler Archetype 1.8; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2018-12-24 18:30:48
- 最后出现
- 2019-01-30 08:49:56
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(4) |
服务器名称 |
所属国家 |
| 54.213.172.16 |
ec2-54-213-172-16.us-west-2.compute.amazonaws.com |
US |
| 54.187.245.22 |
ec2-54-187-245-22.us-west-2.compute.amazonaws.com |
US |
| 34.220.178.16 |
ec2-34-220-178-16.us-west-2.compute.amazonaws.com |
US |
| 54.200.213.220 |
ec2-54-200-213-220.us-west-2.compute.amazonaws.com |
US |
- 用户代理字符串
- Anonymous Coward/1.0 (A StormCrawler-based crawler; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2017-01-11 21:02:50
- 最后出现
- 2017-01-26 15:33:41
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(4) |
服务器名称 |
所属国家 |
| 109.157.217.137 |
host109-157-217-137.range109-157.btcentralplus.com |
GB |
| 86.177.114.172 |
host86-177-114-172.range86-177.btcentralplus.com |
GB |
| 34.195.157.29 |
ec2-34-195-157-29.compute-1.amazonaws.com |
US |
| 54.88.185.64 |
ec2-54-88-185-64.compute-1.amazonaws.com |
US |
| 54.197.222.15 |
ec2-54-197-222-15.compute-1.amazonaws.com |
US |
| 54.165.173.125 |
ec2-54-165-173-125.compute-1.amazonaws.com |
US |
| 86.176.175.83 |
host86-176-175-83.range86-176.btcentralplus.com |
GB |
| 31.54.38.4 |
host31-54-38-4.range31-54.btcentralplus.com |
GB |
- 用户代理字符串
- Anonymous Coward/1.0 (A StormCrawler-based crawler; http://someorganization.com/; someone@someorganization.com)
- 首次出现
- 2017-01-11 21:02:50
- 最后出现
- 2017-01-26 15:33:41
- 遵循robots.txt
- 未知
- 来源
-
| IP地址(4) |
服务器名称 |
所属国家 |
| 34.195.157.29 |
ec2-34-195-157-29.compute-1.amazonaws.com |
US |
| 54.88.185.64 |
ec2-54-88-185-64.compute-1.amazonaws.com |
US |
| 54.197.222.15 |
ec2-54-197-222-15.compute-1.amazonaws.com |
US |
| 54.165.173.125 |
ec2-54-165-173-125.compute-1.amazonaws.com |
US |
访问控制
了解如何控制Storm-crawler访问权限，避免Storm-crawler抓取行为不当。
是否拦截Storm-crawler？
可以考虑拦截。。爬虫通常会下载公开的互联网内容，这些内容默认情况下可以免费访问。不过，如果你不希望你的内容被用于未经授权的目的，你应该拦截它们。
通过Robots.txt拦截
您可以通过在网站的 robots.txt 中设置用户代理访问规则来屏蔽 Storm-crawler 或限制其访问权限。我们建议安装 Spider Analyser
插件，以检查它是否真正遵循这些规则。
# robots.txt
# 下列代码一般情况可以拦截该代理
User-agent: Storm-crawler
Disallow: /
您无需手动执行此操作，可通过我们的 Wordpress 插件 Spider Analyser 来拦截不必要的蜘蛛或者爬虫。
