Archived copy. This page was recovered from the Internet Archive snapshot of /display/SP/WCT4 ARC to WARC Migration taken on 2013-02-12. The original wiki at wiki.opf-labs.org is being decommissioned.

WCT4 ARC to WARC Migration

Created by Peter Cliff on Feb 07, 2013 · last edited by Peter Cliff · on Feb 07, 2013 (view history) · 13 versions

Status

Starting

User Story

As the owner of a number of legacy ARC files and a Web Archive currently harvesting WARCS, I need a digital preservation system that can migrate ARCs to WARCs in a timely fashion and ensure the completeness of the migration, so that I can more effectively manage Web Archive content by only having a single format to deal with. This also means I do not have to maintain two playback mechanisms for the long term.

User Requirements/Components

I need a tool that can migrate ARC to WARC files.
I need a tool that can verify that the content of the ARC is the same as the content of the WARC.

Contact

Developer Notes

This scenario appears simple, but seems to require that WCT2 and 3 have been completed first. A QA of the migration could make use of WCT2 - comparing snapshots of each of the sites, it could also take the approach of comparing all the files in each. There may be other aspects of ARCs and WARCs (header information, logs, etc.) that will need checking too. For example, has the log file format changed between the two? Is the WARC structurally sound?, etc.