These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
Skye Sherwin: Words take on a new life in the surreal animation of this London-based artist, returning time and again to the ancient Roman city of Leptis Magna where the modern alphabet began
Skye Sherwin: From Perspex legs to a young Karl Lagerfeld and huge images of John Travolta's sweatband-clad head, exploring this artist's work is like stumbling on to a weird and wonderful theatre set
Skye Sherwin: Dant's fantastic maps, charts and satirical projects – such as 'underneathism', the painstaking depiction of things from below – show a peculiarly British wit
Skye Sherwin: Her rainbow-splashed marionettes are a statement about the lost summer of love generation. And authors from Ali Smith to David Mitchell have written stories about them
Comedy and unchastity are key in this American artist's vivid patchwork paintings and sculptures, which call for social change even as they flag up failures of cultural revolutions past
Skye Sherwin: This American artist's photographs of spindly assemblages, destitute factories and dancers from her hometown seem frozen in time and elusive like memories
Artist of the week 210: Anna Barham