Friday, 11 May 2018

How to move a 120 TB web archive to the cloud in two weeks

Building a resource as big as the UK Government Web Archive takes a lot of storage space. Comprising over 5,000 websites from 1996 to the present, as well as tweets and videos from government social media accounts, the data footprint of the archive in 2018 is over 120TB – far bigger than the average consumer […]