7 mins read
Key findings
- AI bots fetched fintechbits.net pages 29,039 times between 10 and 31 October 2026, according to Fintechbits Intelligence crawler logs.
- Amazonbot made 10,431 of those 29,039 fetches (35.9%), more than any other of the AI bots logged.
- OpenAI’s search crawler, OAI-SearchBot, made 2,190 fetches; its training crawler, GPTBot, made 450 (1.5%).
- PerplexityBot made 6,728 fetches, but 3,970 of them (59.0%) came on a single day, 16 October 2026.
Horizontal bar chart of fetches of fintechbits.net by AI agent from 10 to 31 October 2026, with Amazonbot highlighted at 10,431 fetches and GPTBot at 450.
Which AI bots read fintech news, and how often? Fintechbits can answer that for one fintech news site, its own. Between 10 and 31 October 2026, AI bots fetched pages on fintechbits.net 29,039 times. Amazon’s crawler made more than a third of those requests. OpenAI’s training crawler, GPTBot, made 450.
These figures cover fintechbits.net only and come from the first 22 days of the Fintechbits Intelligence crawler log, which starts on 10 October 2026. They describe one site over three weeks. They are not a measure of the web, and three weeks is a snapshot, not a trend. The log records 34 referrals from AI products in the same window; Fintechbits leaves those to a separate piece. For the funding side of the Fintechbits data, see the October 2026 deals tracker.
What it means
The heaviest readers among the AI bots were Amazon’s, Anthropic’s and Perplexity’s, not OpenAI’s. Amazonbot (10,431 fetches), ClaudeBot (6,952) and PerplexityBot (6,728) together made 83.0% of all fetches by AI bots. OpenAI’s three agents made 3,735 between them, 12.9% of the total, which leaves the maker of ChatGPT a distant fourth on this site.
OpenAI’s split is the more useful signal for publishers. OAI-SearchBot, which OpenAI says it uses “to surface websites in search results in ChatGPT’s search features”, made 4.9 times as many fetches as GPTBot, the crawler OpenAI says collects content “that may be used in training”. On this site, at least, OpenAI’s crawling leans towards search rather than training.
Raw fetch counts flatter some AI bots. Over a third of ClaudeBot’s requests (2,469 of 6,952, or 35.5%) went to robots.txt and sitemap files, not to articles. Bytespider made 50 requests, and every one was for robots.txt. Counting pages actually read would shrink both, which is why the table below separates the two.
Which AI bots fetched fintechbits.net the most from 10 to 31 October 2026?
Amazonbot fetched the most, with 10,431 requests from 10 to 31 October 2026, or 35.9% of the 29,039 logged AI fetches. It reached 6,575 distinct content URLs, the widest spread of any of the AI bots, and almost none of its traffic (18 requests) went to robots.txt or sitemaps. ClaudeBot came second with 6,952 and PerplexityBot third with 6,728.
How much do OpenAI’s GPTBot and OAI-SearchBot crawl?
GPTBot made 450 fetches in the window, 1.5% of the total, while OAI-SearchBot made 2,190 (7.5%). ChatGPT-User, the agent ChatGPT may use to visit a page when a user asks it a question, made 1,095. That puts OpenAI fourth among the operators in this log, on this site, behind Amazon (10,431), Anthropic (7,246, ClaudeBot plus Claude-User) and Perplexity (6,728).
Fintechbits analysis
Why does PerplexityBot’s total need a caveat?
PerplexityBot’s total rests on one day. On 16 October 2026 it made 3,970 fetches, 59.0% of its 6,728 for the window. On the other days in the window it made 2,758. That burst also lifted the site-wide total for 16 October to 5,705 fetches, against 481 to 2,221 on every other day in the window. Fintechbits does not know what triggered it, so it is reported here rather than smoothed out.
Are AI bots reading articles or just checking the rules?
Mostly articles: 89.2% of fetches by AI bots in the window went to content pages rather than robots.txt or sitemaps. The mix varies a lot by bot. Amazonbot (0.2%), PerplexityBot (1.6%) and CCBot (0.6%) sent almost nothing to robots.txt or sitemaps. ClaudeBot (35.5%), Claude-User (37.4%) and GPTBot (23.6%) spent a large share of requests on those files. Bytespider spent all 50 of its requests on robots.txt.
Which AI crawlers did not show up?
Anthropic also lists Claude-SearchBot, which it says “navigates the web to improve search result quality for users”, and Amazon lists Amzn-SearchBot. Neither appears among the AI bots in the log for this window. Common Crawl’s CCBot came on only 5 of the 22 days, making 848 fetches, and DuckDuckGo’s DuckAssistBot made one.
Table: AI bot fetches of fintechbits.net by agent, 10 to 31 October 2026
| Agent | Operator | Kind (log label) | Fetches | Share of 29,039 | Robots and sitemaps | Distinct content URLs | Fetches on 16 Oct |
|---|---|---|---|---|---|---|---|
| Amazonbot | Amazon | training | 10,431 | 35.9% | 18 | 6,575 | 1,126 |
| ClaudeBot | Anthropic | training | 6,952 | 23.9% | 2,469 | 3,670 | 203 |
| PerplexityBot | Perplexity | search | 6,728 | 23.2% | 105 | 3,590 | 3,970 |
| OAI-SearchBot | OpenAI | search | 2,190 | 7.5% | 263 | 728 | 93 |
| ChatGPT-User | OpenAI | assistant | 1,095 | 3.8% | 0 | 188 | 25 |
| CCBot | Common Crawl | training | 848 | 2.9% | 5 | 821 | 274 |
| GPTBot | OpenAI | training | 450 | 1.5% | 106 | 343 | 5 |
| Claude-User | Anthropic | assistant | 294 | 1.0% | 110 | 159 | 6 |
| Bytespider | ByteDance | training | 50 | 0.2% | 50 | 0 | 3 |
| DuckAssistBot | DuckDuckGo | assistant | 1 | 0.0% | 1 | 0 | 0 |
| Total | 29,039 | 100% | 3,127 | 5,705 |
Methodology
Data comes from the Fintechbits Intelligence crawler log (table content_ai_traffic), which records daily fetches of fintechbits.net by AI bots and assistants, labelled by agent, platform and kind. The window is 10 to 31 October 2026, 22 days, the full span of October covered by the log. Figures were queried on 4 November 2026. The base for every share is 29,039 fetches (channel “fetch”); the log’s 34 AI referrals are excluded. Training, search and assistant labels are the log’s own: training fetches were 18,731 (64.5%), search 8,918 (30.7%) and assistant 1,390 (4.8%). “Robots and sitemaps” means requests to /robots.txt or to any path containing “sitemap” and ending in .xml; “content URLs” are all other distinct paths. Agent names are as recorded in the log; Fintechbits has not verified each request against the operators’ published IP ranges, and spoofed bots are a known problem (79% of financial firms in a Fingerprint survey Fintechbits covered said they had been hit by AI-spoofed bots). The figures cover fintechbits.net only and say nothing about other publishers.
How to cite
Source: Fintechbits analysis of Fintechbits Intelligence data, 6 November 2026, https://www.fintechbits.net/ai-bots-fintech-news-october-2026
FAQ
Which AI bot crawls fintechbits.net the most?
Amazonbot, with 10,431 fetches from 10 to 31 October 2026, 35.9% of all logged fetches of the site by AI bots.
Does GPTBot crawl fintech news sites?
It crawls this one, but lightly: 450 fetches in 22 days, against 2,190 from OpenAI’s search crawler, OAI-SearchBot.
Is PerplexityBot used to train AI models?
Perplexity says PerplexityBot “is not used to crawl content for AI foundation models” and is designed to surface and link websites in Perplexity’s search results.
Do these figures show AI bot traffic is rising?
No. The log starts on 10 October 2026, so 22 days of data cannot show a trend. A later edition will add November.
Where can I see the related hiring data?
Finjobsly publishes its fintech job market data on its intelligence page, and the Fintechbits October 2026 deals tracker covers the funding side.
Sources
- Fintechbits Intelligence, content_ai_traffic table, queried 4 November 2026.
- OpenAI, Overview of OpenAI Crawlers: https://developers.openai.com/api/docs/bots
- Anthropic, Does Anthropic crawl data from the web, and how can site owners block the crawler?: https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler
- Perplexity, Perplexity Crawlers: https://docs.perplexity.ai/docs/resources/perplexity-crawlers
- Amazon, Amazon Web Search crawlers, Amazonbot: https://developer.amazon.com/amazonbot
