These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
Last week, Bob Geldof announced that Band Aid will be revived to raise cash for the fight against Ebola.
Ian Birrell and
Tim Ingham debate the project’s merits
Concert promoters have warned that ticket prices must increase even further to curb the burgeoning resale market.
Tim Ingham and
Jude Rogers debate whether this is fair
The debate Should Band Aid be resurrected?