Crawl Activity
Market Invoice — marketinvoice.co.uk
Bing crawl ran 1h ago · 16 May, 13:26 · runs daily 06:00
Cloudflare AI Crawl Control (14d)
Edge-level bot counts, true hits — not sampled
10,286
14 bots tracked
05-09 05-16
Bingbot 3,875
ChatGPT-User 1,814
PerplexityBot 1,594
OAI-SearchBot 608
ClaudeBot 564
1717
Total Bing Crawls
345
Pages Indexed (Bing)
13
AI Bots Allowed
0
AI Bots Blocked
Crawler Activity
Bing (bars, left axis) vs AI bots (lines, right axis)
AI Crawler Access
GPTBot allowed
ChatGPT-User allowed
Google-Extended allowed
GoogleOther allowed
ClaudeBot allowed
Claude-Web not_mentioned
PerplexityBot allowed
Bytespider allowed
CCBot allowed
cohere-ai allowed
Amazonbot allowed
anthropic-ai not_mentioned
FacebookBot allowed
Applebot-Extended allowed
Bingbot allowed
Live Crawler Access Test (HTTP Response)
Tests if each bot actually gets a 200 response when visiting the homepage
GPTBot
ClaudeBot
PerplexityBot
Googlebot
Bingbot
Topic Clusters (40 detected)
/research/
1
pages in cluster
/trust-and-verification/
1
pages in cluster
/specialty-finance/
1
pages in cluster
/pre-shipment-finance/
1
pages in cluster
/why-use-a-broker/
1
pages in cluster
/complaints/
1
pages in cluster
/regions/
21
pages in cluster
/contact/
1
pages in cluster
/tools/
11
pages in cluster
/compare-invoice-finance-providers-uk/
1
pages in cluster
/calculator/
1
pages in cluster
/privacy/
1
pages in cluster
/disclaimer/
1
pages in cluster
/authors/
2
pages in cluster
/cookie-policy/
1
pages in cluster
/recruitment-finance/
5
pages in cluster
/export-finance/
1
pages in cluster
/how-we-are-funded/
1
pages in cluster
/contract-finance/
1
pages in cluster
/providers/
91
pages in cluster
/terms/
1
pages in cluster
/industries/
38
pages in cluster
/best/
72
pages in cluster
/about/
1
pages in cluster
/import-finance/
1
pages in cluster
/invoice-finance-for-small-business-uk/
1
pages in cluster
/blog/
29
pages in cluster
/construction-finance/
10
pages in cluster
/invoice-finance-quote/
1
pages in cluster
/purchase-order-finance/
1
pages in cluster
/guides/
53
pages in cluster
/editorial-policy/
1
pages in cluster
/locations/
51
pages in cluster
/unpaid-invoices/
12
pages in cluster
/compare/
23
pages in cluster
/working-capital/
8
pages in cluster
/trade-credit-vs-invoice-finance/
1
pages in cluster
/accessibility/
1
pages in cluster
/stats/
8
pages in cluster
/questions/
118
pages in cluster
Terminology Consistency (H1 Analysis)
2026
x (%)
finance
x (%)
invoice
x (%)
providers
x (%)
review
x (%)
businesses
x (%)
factoring
x (%)
invoices
x (%)
provider
x (%)
rates
x (%)
best
x (%)
compare
x (%)
payment
x (%)
independent
x (%)
bank
x (%)