Archive
Persistent archive
Visitors
32
Total bot blocks
177,090
Whitelist access
114,630
Known bots stored
115
Bots blocked
127,316
Limit blocked
49,774
Blocked IPs
11
Bots limited
72,806
Last 7 days
This year (2026)
Top bots
Summary of known bot activity in the archive.
✅ Allowed
⚪ Allowed with limit
🟨 Limit blocked
🟥 Hard blocked
| Bot ↕ | ✅ | ⚪ | 🟨 | 🟥 | Total ↕ | Last seen ↕ |
|---|---|---|---|---|---|---|
| bingbot | 8,654 | 65,706 | 49,442 | 11 | 123,813 | 2026-08-13 17:46 |
| Mozilla | 12,483 | 4 | 0 | 38,245 | 50,732 | 2026-08-13 17:21 |
| Meta External Agent | 0 | 0 | 0 | 50,142 | 50,142 | 2026-08-13 08:43 |
| Sogou | 18,694 | 0 | 0 | 11 | 18,705 | 2026-08-13 17:40 |
| DotBot | 0 | 0 | 0 | 12,486 | 12,486 | 2026-08-13 17:37 |
| Amazonbot | 0 | 0 | 0 | 11,877 | 11,877 | 2026-08-13 15:10 |
| Googlebot | 250 | 7,096 | 332 | 198 | 7,876 | 2026-08-13 17:34 |
| SemrushBot | 0 | 0 | 0 | 6,566 | 6,566 | 2026-08-11 16:11 |
| Mediapartners-Google | 0 | 0 | 0 | 4,541 | 4,541 | 2026-07-30 18:07 |
| Baiduspider | 1,241 | 0 | 0 | 13 | 1,254 | 2026-08-13 07:20 |
| DataForSeoBot | 0 | 0 | 0 | 663 | 663 | 2026-08-05 16:08 |
| Turnitin | 0 | 0 | 0 | 444 | 444 | 2026-08-02 07:43 |
| SERankingBacklinksBot | 0 | 0 | 0 | 337 | 337 | 2026-08-13 15:18 |
| Applebot | 313 | 0 | 0 | 11 | 324 | 2026-08-13 06:24 |
| YandexBot | 189 | 0 | 0 | 11 | 200 | 2026-08-12 08:55 |
| ClaudeBot | 0 | 0 | 0 | 200 | 200 | 2026-08-13 13:07 |
| Dalvik | 0 | 0 | 0 | 140 | 140 | 2026-08-13 16:56 |
| MJ12bot | 0 | 0 | 0 | 137 | 137 | 2026-08-13 10:18 |
| SiteLockSpider | 0 | 0 | 0 | 98 | 98 | 2026-08-13 07:50 |
| curl | 0 | 0 | 0 | 71 | 71 | 2026-08-11 01:52 |
| Pinterestbot | 0 | 0 | 0 | 48 | 48 | 2026-08-13 06:35 |
| CCBot | 0 | 0 | 0 | 46 | 46 | 2026-07-27 14:30 |
| Hello | 0 | 0 | 0 | 41 | 41 | 2026-08-12 13:18 |
| GPTBot | 0 | 0 | 0 | 32 | 32 | 2026-08-12 11:48 |
| Timpibot | 0 | 0 | 0 | 31 | 31 | 2026-08-07 05:38 |
| ZoominfoBot | 0 | 0 | 0 | 30 | 30 | 2026-08-12 16:57 |
| python-requests | 0 | 0 | 0 | 24 | 24 | 2026-08-04 03:55 |
| Go-http-client | 0 | 0 | 0 | 24 | 24 | 2026-07-27 14:29 |
| Wget | 0 | 0 | 0 | 22 | 22 | 2026-07-27 14:30 |
| meta-webindexer | 0 | 0 | 0 | 21 | 21 | 2026-08-09 15:11 |
| BYB-Testtool-www.blockyoubots.com | 0 | 0 | 0 | 20 | 20 | 2026-07-27 14:30 |
| Scrapy | 0 | 0 | 0 | 19 | 19 | 2026-07-20 16:14 |
| Twitterbot | 0 | 0 | 0 | 16 | 16 | 2026-07-27 14:30 |
| DnBCrawler-Analytics | 0 | 0 | 0 | 16 | 16 | 2026-08-06 10:29 |
| AhrefsBot | 0 | 0 | 0 | 15 | 15 | 2026-08-13 09:38 |
| okhttp | 0 | 0 | 0 | 14 | 14 | 2026-07-27 14:29 |
| PerplexityBot | 0 | 0 | 0 | 13 | 13 | 2026-08-07 08:06 |
| Other | 0 | 0 | 0 | 12 | 12 | 2026-07-29 01:11 |
| axios | 0 | 0 | 0 | 12 | 12 | 2026-07-27 14:29 |
| Java | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| node-fetch | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| GuzzleHttp | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| libwww-perl | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| Faraday | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| Googlebot-Image | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| AdsBot-Google | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| DuckDuckBot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| SeznamBot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:29 |
| awisbot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| CriteoBot | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 | |
| scrapy | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Python-urllib | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| masscan | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| sqlmap | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Havij | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Acunetix | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Nikto | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Netsparker | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| w3af.org | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| Arachni | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| commix | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| HP | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| jSQL | 0 | 0 | 0 | 11 | 11 | 2026-07-27 14:30 |
| UptimeRobot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| Pingdom.com_bot_version_1.4_(http: | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| GTmetrix | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| Uptrends | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| bot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| AspiegelBot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| BUbiNG | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| SEOkicks-Robot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| SerpstatBot | 0 | 0 | 0 | 10 | 10 | 2026-07-27 14:30 |
| Facebot | 0 | 0 | 0 | 10 | 10 | 2026-07-29 14:17 |
| Python | 0 | 0 | 0 | 9 | 9 | 2026-08-12 06:19 |
| Opera | 0 | 0 | 0 | 9 | 9 | 2026-08-11 21:17 |
| LinkedInBot | 0 | 0 | 0 | 8 | 8 | 2026-07-27 14:30 |
| Discordbot | 0 | 0 | 0 | 8 | 8 | 2026-07-27 14:30 |
| Slackbot-LinkExpanding | 0 | 0 | 0 | 8 | 8 | 2026-07-27 14:30 |
| req | 0 | 0 | 0 | 7 | 7 | 2026-07-27 15:56 |
| QwantifyBot | 0 | 0 | 0 | 5 | 5 | 2026-08-01 23:30 |
| BB-Scanner | 0 | 0 | 0 | 5 | 5 | 2026-08-07 12:51 |
| OAI-SearchBot | 0 | 0 | 0 | 4 | 4 | 2026-08-01 18:02 |
| VelenPublicWebCrawler | 0 | 0 | 0 | 4 | 4 | 2026-08-01 10:44 |
| meta-externalagent | 0 | 0 | 0 | 3 | 3 | 2026-07-24 04:13 |
| ev-crawler | 0 | 0 | 0 | 3 | 3 | 2026-07-26 07:42 |
| domains-distillery | 0 | 0 | 0 | 3 | 3 | 2026-07-23 06:36 |
| firefox | 0 | 0 | 0 | 2 | 2 | 2026-06-29 06:13 |
| User-Agent:Mozilla | 0 | 0 | 0 | 2 | 2 | 2026-06-29 15:34 |
| wp2shell | 0 | 0 | 0 | 2 | 2 | 2026-07-27 13:13 |
| MetaCrawler | 0 | 0 | 0 | 2 | 2 | 2026-07-30 05:01 |
| Spider_Bot | 0 | 0 | 0 | 2 | 2 | 2026-07-31 01:06 |
| MojeekBot | 0 | 0 | 0 | 2 | 2 | 2026-08-12 20:53 |
| vuln_scanner | 0 | 0 | 0 | 2 | 2 | 2026-08-11 08:11 |
| TikTokSpider | 0 | 0 | 0 | 1 | 1 | 2026-07-05 18:03 |
| SiteDown | 0 | 0 | 0 | 1 | 1 | 2026-07-08 04:26 |
| S33DBot | 0 | 0 | 0 | 1 | 1 | 2026-07-08 15:41 |
| YisouSpider | 0 | 0 | 0 | 1 | 1 | 2026-07-12 09:10 |
| WarmBadge-Trawler | 0 | 0 | 0 | 1 | 1 | 2026-07-13 08:15 |
| AkoniLeadHuntBot | 0 | 0 | 0 | 1 | 1 | 2026-07-21 07:37 |
| MetaJobBot | 0 | 0 | 0 | 1 | 1 | 2026-07-21 07:51 |
| rc-crawler | 0 | 0 | 0 | 1 | 1 | 2026-07-25 17:14 |
| Amuninni-WixFinder | 0 | 0 | 0 | 1 | 1 | 2026-07-25 19:02 |
| PipericBot | 0 | 0 | 0 | 1 | 1 | 2026-07-27 23:49 |
| tranco-crawler | 0 | 0 | 0 | 1 | 1 | 2026-07-28 18:24 |
| jscrawler | 0 | 0 | 0 | 1 | 1 | 2026-07-28 23:41 |
| CmsScaner | 0 | 0 | 0 | 1 | 1 | 2026-08-03 06:25 |
| IsonSearchBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 09:37 |
| BundlabsBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 14:44 |
| python-httpx | 0 | 0 | 0 | 1 | 1 | 2026-08-03 18:17 |
| python-urllib3 | 0 | 0 | 0 | 1 | 1 | 2026-08-09 10:01 |
| IonCrawl | 0 | 0 | 0 | 1 | 1 | 2026-08-11 04:55 |
| MoonBrowser | 0 | 0 | 0 | 1 | 1 | 2026-08-12 04:58 |
| annotate_google | 0 | 0 | 0 | 1 | 1 | 2026-08-12 04:58 |
| Dragonfly | 0 | 0 | 0 | 1 | 1 | 2026-08-12 04:58 |
| bingbot | 0 | 19,581 | 6,864 | 0 | 26,445 | 2026-08-13 17:46 |
| Sogou | 12,547 | 0 | 0 | 0 | 12,547 | 2026-08-13 17:40 |
| Meta External Agent | 0 | 0 | 0 | 11,436 | 11,436 | 2026-08-13 08:43 |
| Googlebot | 0 | 4,482 | 332 | 180 | 4,994 | 2026-08-13 17:34 |
| DotBot | 0 | 0 | 0 | 2,545 | 2,545 | 2026-08-13 17:37 |
| Amazonbot | 0 | 0 | 0 | 1,916 | 1,916 | 2026-08-13 15:10 |
| Mozilla | 1,638 | 4 | 0 | 22 | 1,664 | 2026-08-13 17:21 |
| SemrushBot | 0 | 0 | 0 | 1,524 | 1,524 | 2026-08-11 16:11 |
| Turnitin | 0 | 0 | 0 | 444 | 444 | 2026-08-02 07:43 |
| Baiduspider | 260 | 0 | 0 | 0 | 260 | 2026-08-13 07:20 |
| DataForSeoBot | 0 | 0 | 0 | 190 | 190 | 2026-08-05 16:08 |
| SERankingBacklinksBot | 0 | 0 | 0 | 131 | 131 | 2026-08-13 15:18 |
| Applebot | 99 | 0 | 0 | 0 | 99 | 2026-08-13 06:24 |
| Dalvik | 0 | 0 | 0 | 84 | 84 | 2026-08-13 16:56 |
| YandexBot | 51 | 0 | 0 | 0 | 51 | 2026-08-12 08:55 |
| ClaudeBot | 0 | 0 | 0 | 51 | 51 | 2026-08-13 13:07 |
| SiteLockSpider | 0 | 0 | 0 | 32 | 32 | 2026-08-13 07:50 |
| meta-webindexer | 0 | 0 | 0 | 21 | 21 | 2026-08-09 15:11 |
| MJ12bot | 0 | 0 | 0 | 20 | 20 | 2026-08-13 10:18 |
| Pinterestbot | 0 | 0 | 0 | 18 | 18 | 2026-08-13 06:35 |
| Hello | 0 | 0 | 0 | 13 | 13 | 2026-08-12 13:18 |
| curl | 0 | 0 | 0 | 12 | 12 | 2026-08-11 01:52 |
| DnBCrawler-Analytics | 0 | 0 | 0 | 9 | 9 | 2026-08-06 10:29 |
| ZoominfoBot | 0 | 0 | 0 | 7 | 7 | 2026-08-12 16:57 |
| Opera | 0 | 0 | 0 | 6 | 6 | 2026-08-11 21:17 |
| BB-Scanner | 0 | 0 | 0 | 5 | 5 | 2026-08-07 12:51 |
| python-requests | 0 | 0 | 0 | 4 | 4 | 2026-08-04 03:55 |
| Python | 0 | 0 | 0 | 4 | 4 | 2026-08-12 06:19 |
| VelenPublicWebCrawler | 0 | 0 | 0 | 4 | 4 | 2026-08-01 10:44 |
| GPTBot | 0 | 0 | 0 | 3 | 3 | 2026-08-12 11:48 |
| AhrefsBot | 0 | 0 | 0 | 2 | 2 | 2026-08-13 09:38 |
| PerplexityBot | 0 | 0 | 0 | 2 | 2 | 2026-08-07 08:06 |
| QwantifyBot | 0 | 0 | 0 | 2 | 2 | 2026-08-01 23:30 |
| MojeekBot | 0 | 0 | 0 | 2 | 2 | 2026-08-12 20:53 |
| vuln_scanner | 0 | 0 | 0 | 2 | 2 | 2026-08-11 08:11 |
| Timpibot | 0 | 0 | 0 | 1 | 1 | 2026-08-07 05:38 |
| OAI-SearchBot | 0 | 0 | 0 | 1 | 1 | 2026-08-01 18:02 |
| CmsScaner | 0 | 0 | 0 | 1 | 1 | 2026-08-03 06:25 |
| IsonSearchBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 09:37 |
| BundlabsBot | 0 | 0 | 0 | 1 | 1 | 2026-08-03 14:44 |
| python-httpx | 0 | 0 | 0 | 1 | 1 | 2026-08-03 18:17 |
| python-urllib3 | 0 | 0 | 0 | 1 | 1 | 2026-08-09 10:01 |
| IonCrawl | 0 | 0 | 0 | 1 | 1 | 2026-08-11 04:55 |
| MoonBrowser | 0 | 0 | 0 | 1 | 1 | 2026-08-12 04:58 |
| annotate_google | 0 | 0 | 0 | 1 | 1 | 2026-08-12 04:58 |
| Dragonfly | 0 | 0 | 0 | 1 | 1 | 2026-08-12 04:58 |
Unknown bots:
✅ 0 /
⚪ 0 /
🟨 0 /
🟥 172 (Summary (not shown in Top list))
ℹ️ Unknown bots =
These are requests we can’t clearly assign to any known crawler—often new, rare, or deliberately obfuscated bots.