Powered by OPF
OPF WIKI STATIC ARCHIVE
See the original ↗Page history
2,681 pages · 153 spaces · 776 tags · 4,025 history records · 96.2% of the original wiki recovered
Archived copy. This page was recovered from the Internet Archive snapshot of /display/SP/Ingest of digitized book METSs into Fedora 4 taken on 2016-09-12. The original wiki at wiki.opf-labs.org is being decommissioned.

Ingest of digitized book METSs into Fedora 4

Created by Matthias Hahn on May 07, 2014 · last edited by Matthias Hahn · on May 07, 2014 (view history) · 13 versions

ID

METSFedora4

Status

Active

Contact

Matthias Hahn <[email protected]>

User Story

Ingesting a huge amount of data into a repository could become a difficult task. The increasing amount of data that has to be ingested in a limited time, demands a repository that is able to scale in this respect.

We used the - still in development - Fedora 4 implementation based on an alpha release to measure the performance of the ingest of data provided by the ONB and random generated data.

User Requirements/Components

  1. I need a repository with an ingest throughput of 5000 Google Book Scans per month.

Experiments

We measured the ingest performance with Modeshape, as the underlying JCR repository implementation of Fedora 4, and measured the ingest performance with Fedora 4 without the SCAPE Connector API and with the SCAPE Connector API. All numbers have been distributed to Duraspace and have been discussed with the developers (including Modeshape developers). As a result the scalability and performance of a Fedora 4 cluster has been postponed to the Fedora 4.1 release and will not be part of Fedora 4.0 (the release date is still not known).  All experiments are based on an alpha release of Fedora 4.0.

Related Documents

Scenarios, case studies, etc. that provide background to this story.