Archived copy. This page was recovered from the Internet Archive snapshot of /display/SP/M30 - July 2013 taken on 2016-09-12. The original wiki at wiki.opf-labs.org is being decommissioned.

M30 - July 2013

Created by Peter May on May 21, 2013 · last edited by Sven Schlarb · on Aug 26, 2013 (view history) · 16 versions

(Delete Red/Amber/Green statuses as applicable)

WP4 - PT.WP.1 Platform Design and Deployment All good!

Progress

no progress because of holidays

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP5 - PT.WP.2 Application Provisioning All good! Be aware! Stopped!

Progress

3-4 bullets describing overall progress within WP. Please keep succinct and high-level

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP6 - PT.WP.3 Execution Platform All good! Be aware! Stopped!

Progress

3-4 bullets describing overall progress within WP. Please keep succinct and high-level

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP7 - PT.WP.4 Process Management All good!

Progress

Minimal progress because of conference (with talk + poster on Taverna Components) and some staff holidays
Developer build of Taverna Server 2.5a1
- Currently just waiting for some upstream components to no longer be SNAPSHOTs for finalisation
Improved component repository API being documented

Issues, Blockages and Concerns

CONCERN: Status of PT.WP.3
- Envisaged using PPL to do faster execution of Taverna Workflows, so didn't put any work into that side of things from Taverna perspective
TECH ISSUE: How to do provenance capture
- Not just "what file produced what" and "how long did it take" but also "what version of the software — and its libraries/dependencies — was in use"…
TECH ISSUE: How to ensure that information on characterisation and QA is generally understandable
- Describe just the value or use a tagged format? (Possible tagged formats: XML, JSON, Java properties)

Next Tasks

Document describing how to practically do the TB preservation workflows with characterisation/QA, based on Sven's workflow.
Getting the new component repository API used in the component plugin (with TavWB and TavServ downstream)

WP8 - PT.WP.5 Repository Integration All good!

Progress

Connector API implementation ongoing - implementation will end end of the month - fingers crossed. Test will be performed in August.
Plan Management API implementation - "alpha-Version" released.
Preparation of Cluster setup of Fedora 4 at SCC with Plan Management API and Connector API

Issues, Blockages and Concerns

Checkpoint Report regarding Integration of Preservation Workflows will be delayed (at least 4 weeks)
Loader app to work with latest TCK to be done.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP9 - PC.WP.1 Characterisation Components

Be aware! Stopped!

Due to the sumemr vacations this status is just a repeat from June.

Progress

Research on Information Extraction is active. An article on a real case digital preservation scenario has been accepted for iPRES.
We have started planning how best to utilise the new effort from TUW. TUW is going to work with aligning the output from CC tools.

Issues, Blockages and Concerns

Target tools and tool-types etc for general characterisation will be missing from CP068 (Identification of target tools and tool-types for iteration 03, M29) on account of staffing challenges and sickness. We will try to get a preliminary document ready. The detailed road map will have to be pushed to after the summer vacations. The road map is intended to be complete regarding Information Extraction research and SAZ from MSR.

Next Tasks

During the next four to six weeks we will define the road map for the last iteration.

WP10 - PC.WP.2 Action Services Components All good! Be aware! Stopped!

Progress

Mostly working on meeting MS49 and MS50 (work on research datasets)
Ongoing work on the ARC to WARC migrator
Engament with MSR about bringing SAZ more into project by exposing services and exploit HDInsight platform

Issues, Blockages and Concerns

There might be slight delays in the delivery of MS49 and/or MS50.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP11 - PC.WP.3 Quality Assurance Components All good!

Progress

Minimal progress because of holidays

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

Next Tasks

CP079 Definition of tool interfaces 03 for M31

WP12 - PW.WP.1 Automated Watch All good!

Progress

Presented the whole Planning and Watch lifecycle at the Open Repositories 2013 conference in Charlottetown, Canada
Training on the Planning and Watch WP tools in the DPC event: Digital Preservation Advanced Practitioner Training

Issues, Blockages and Concerns

No issues.

Next Tasks

Working on the iPRES'13 tutorial, demo and paper presentation
Preparing a ready to use VM with C3PO and Scout
Developing user support and new adaptors for Scout

WP13 - PW.WP.2 Policy Representation All good! Be aware! Stopped!

Progress

3-4 bullets describing overall progress within WP. Please keep succinct and high-level

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP14 - PW.WP.3 Automated Planning All good! Be aware! Stopped!

Progress

3-4 bullets describing overall progress within WP. Please keep succinct and high-level

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP15 - TB.WP.1 Web Content Testbed All good!

Progress

Now starting with the ARC2WARC migration, making good progress
Tool called CIPEX should help using different identification tools on scale with ARC container files:https://github.com/shsdev/cipex

Issues, Blockages and Concerns

Reinhard is currently ill, development of ARC2WARC migration tool is stopped

Next Tasks

Continue development of ARC2WARC tool, improve quality assurance
Use CIPEX on a large scale

WP16 - TB.WP.2 Large Scale Digital Repository Testbed Be aware!

Progress

Assigned partners to each of the stories
Partners currently planning workflows and tools
Have identified most of the datasets required

Issues, Blockages and Concerns

Some data unavailable - e.g. ebook test data. Acquiring the data is in progress.
Some tools (components) not easy to build/install - test bed partners working with components partners to resolve these issues.

Next Tasks

List the next and upcoming tasks this WP will be working on.

WP17 - TB.WP.3 Research Datasets Testbed All good!

Progress

STFC: In conjunction with activities reported in PC.AS Milestone 49, have been testing & timing migration workflow

Issues, Blockages and Concerns

STFC: Awaiting approx 1 TB data from our colleagues in the ISIS Department following agreement to provide this

Next Tasks

STFC: Continuing to work on deploying the workflow
Complete discussions with TUW re their contribution to WP17

WP18 - TB.WP.4 Evaluation of Results All good!

Progress

Work on MS78

Questionnaire is used for for feedback
How to evaluate Hadoop-based workflows in TB

Issues, Blockages and Concerns

List any problems, issues or concerns that may be facing this WP.

WP19 - TB.WP.5 Demonstrations All good!

Progress

Not much activity since creating D19.1
Partner institutions are aware of what they are expected to demonstrate according to D19.1 and are in the process of preparing the demos.

Issues, Blockages and Concerns

No issues at the moment.

Next Tasks

Partners are in the process of preparing Task 2: Coordinate installation of demonstration facilities