Inside the WorldIP Scanner Fleet: How We Map Reverse DNS at Scale
Every reverse-DNS record, FCrDNS check, and per-country breakdown on WorldIP.io is built from data we collect ourselves — with a globally-distributed fleet of scanner nodes that continuously resolves forward and reverse DNS across the IPv4 address space. Here's a high-level look at how it works.
A distributed, region-aware fleet
Our scanners run across multiple continents and providers — a mix of dedicated baremetal and cloud nodes in North America, Europe, and Asia-Pacific. Each node owns a slice of the address space, partitioned by geography and by network block, so they cover the Internet in parallel without stepping on each other. Resolving a region's reverse DNS from a nearby vantage point keeps lookups fast and accurate.
Nodes that tune themselves in real time
DNS at this scale is a balancing act. Push too many concurrent queries and your resolver's request queue overflows — fast failures that look like speed but resolve nothing. Push too few and you crawl. Rather than hand-pick a fixed rate, each node runs an adaptive controller that measures its own useful-resolution throughput and concurrency continuously and rides the peak — climbing when there's headroom, easing off the moment its local resolver shows strain. The result is more useful data per node, without the overload.
Discovering new space, refreshing the known
The fleet does two jobs at once. It systematically discovers never-before-scanned addresses to grow coverage, while re-checking already-known records on a tiered schedule: fresh, frequently-changing records get revisited sooner, and long-dead delegations back off automatically so we don't waste effort chasing them. New address allocations from the regional registries get picked up and scanned within minutes.
Always being tuned
This is live infrastructure, and we're constantly optimizing it — standardizing node hardware profiles, tightening the concurrency controller, and de-duplicating coverage so every node's effort counts. We recently landed a round of changes that significantly increased per-node discovery throughput, and there's more on the way.
Want to see it in action? The live scanner page shows recent resolutions from the fleet as they happen, and the infrastructure page has real-time stats on the dataset and the systems behind it.
