A Gnutella crawler is a software program used to gather statistic information on the Gnutella file sharing network.

Early crawlers used the Ping/Pong messages to discover hosts connected to the network. Although this method is still usable, it is too slow to capture enough data for a topological overview of the Gnutella network as it requires initiating full Gnutella connections; this involves several roundtrips to perform the header processing. An extension has been added to the Gnutella protocol to allow crawlers to quickly access ultrapeers.

Gnutella2 also supports crawlers for the gain of statisitcal data such as the network size or the network composition (clients, versions, usernames and usercountries)^[1]. Right now, there is only one crawler existing on the G2 network, called g2paranha. It is written and maintained by dcat and licensed under the GPL.

References

• Daniel Stutzbach and Reza Rejaie, "Capturing Accurate Snapshots of the Gnutella Network", the Global Internet Symposium, March, 2005.

External links

• The GDF:Communicating Network Topology Information
• g2paranha - G2 Network Crawler