Testing 3 million hyperlinks, lessons learned