Powered by OPF
OPF WIKI STATIC ARCHIVE
2,681 pages · 153 spaces · 776 tags · 4,025 history records · 96.2% of the original wiki recovered
Archived copy. This page was recovered from the Internet Archive snapshot of /pages/viewpage.action?pageId=8847469 taken on 2021-05-13. The original wiki at wiki.opf-labs.org is being decommissioned.

LSDRT6 Migrate mp3 to wav

Added by Bjarne Andersen · last edited by Bjarne Andersen · on Sep 29, 2011

Collection:

Unable to render {include} Couldn't find a page to include called: mp3 (128kbit) with Danish Radio broadcasts

Issue:

Title
IS21 Migration of mp3 to wav
Detailed description A large collection of mp3-files (20 Tbytes - 175.000 files) needs to be migrated to wav. Because of the large amount of data we need automatic QA algorithms to ensure that migration went well.
Scalability Challenge
Large amounts of data (20 Tbytes - 175.000 files) - requires both much I/O and CPU for the migration part as well as I/O and CPU for the QA part. Must be carried out on a distributed platform to be realistic.
Issue champion Bjarne Andersen (SB)
Other interested parties
 
Possible Solution approaches
  • SB: develop an audio comparison tool that based on fast-fourier-transformations (FFT) can compare two waveforms
Context
Lessons Learned  
Training Needs
Datasets mp3 (128kbit) with Danish Radio broadcasts
Solutions SO2 xcorrSound QA audio comparison tool
SO4 Audio mp3 to wav Migration and QA Workflow

Evaluation

Objectives This is about scaleability and robustness. 175.000 files need to be migrated and automatically checked content-wise and format-wise
Success criteria We will have a workflow that converts from mp3 to wav. Checks the migrated files for wav-conformance and checks the actual content by comparing the content of the mp3s and the corresponding wavs to ensure that nothing went wrong
Automatic measures 1. Process 20 files per hour per node
Manual assessment 1. If any of the migrated files does not pass the QA-test they should actually have failed the migration.
Actual evaluations links to acutual evaluations of this Issue/Scenario

Solutions: