TernCrawler

TernCrawler is a web crawler. It fetches public web pages to build a search index. It does not log in, submit forms or create accounts.

How to recognise it

Every request carries this User-Agent header:

Mozilla/5.0 (compatible; TernCrawler/1.0)

TernCrawler sends requests only from the address ranges listed below, also available as ips.json and ips.txt. Updated 2026-11-05T08:14:52Z. A request that claims to be TernCrawler from another address is not from TernCrawler.

How it behaves

At least 1 second between requests to one host name, at most 1 open at a time and no more than 5 requests per second to any one server address.
A Crawl-delay in your robots.txt slows TernCrawler down on your site (honoured up to 1 day between requests, and up to 5 seconds while it reads your homepage for its domain census).
HTTP 429 and 5xx answers and timeouts make it back off (up to 1 hour); a Retry-After is honoured up to 6 hours.

How to stop it

A domain (example.com, which covers every name below it) or an address range (203.0.113.0/24) on the crawler's opt-out list is no longer requested by TernCrawler: within 24 hours of the request arriving, and within 5 minutes once it is recorded. The address that takes these requests is published here once the crawler's domain has its own mailbox.

This page is served from the crawler's own addresses.

Addresses

24.199.103.141/32
46.17.96.12/32
51.15.56.231/32
51.15.107.234/32
51.158.194.92/30
51.158.194.96/31
51.158.194.104/32
51.158.194.111/32
51.158.194.112/29
51.158.194.121/32
51.158.194.122/31
51.158.194.124/31
51.158.194.127/32
51.158.194.128/29
51.158.194.138/31
51.158.194.140/30
51.158.194.144/30
51.158.194.148/31
51.158.205.31/32
51.158.205.49/32
51.158.243.33/32
51.159.119.241/32
51.159.181.199/32
51.159.196.243/32
51.159.198.118/32
51.159.212.56/32
51.159.221.198/32
62.210.100.90/32
62.210.101.194/32
62.210.101.222/31
62.210.101.224/32
62.210.101.241/32
62.210.101.244/32
62.210.102.22/32
62.210.102.48/30
62.210.102.52/31
62.210.102.54/32
62.210.102.69/32
62.210.102.70/32
62.210.102.91/32
62.210.102.93/32
62.210.102.134/31
62.210.102.136/29
62.210.102.144/30
62.210.102.148/31
62.210.102.150/32
66.248.204.15/32
66.248.204.82/32
67.205.170.220/32
78.232.38.152/32
78.232.45.215/32
95.111.221.84/32
146.0.73.88/32
146.0.75.157/32
151.115.52.156/32
151.115.59.120/32
151.115.82.17/32
151.115.82.30/31
151.115.82.33/32
151.115.82.34/31
151.115.82.36/32
151.115.82.42/32
151.115.84.119/32
151.115.89.229/32
152.114.195.57/32
178.62.211.151/32
185.70.186.195/32
185.130.226.86/32
185.130.227.237/32
185.130.227.238/32
213.163.198.3/32

This page has no cookies, scripts or tracking.