Powered by OPF
OPF WIKI STATIC ARCHIVE
2,681 pages · 153 spaces · 776 tags · 4,025 history records · 96.2% of the original wiki recovered
Archived copy. This page was recovered from the Internet Archive snapshot of /display/SP/IS32 Basic Migration of RAW to NeXus data taken on 2012-11-27. The original wiki at wiki.opf-labs.org is being decommissioned.

IS32 Basic Migration of RAW to NeXus data

Created by Erica Yang on Jan 30, 2012 · last edited by Bjarne Andersen · on Sep 26, 2012 (view history) · 6 versions
Title
IS32 Basic Migration of RAW to NeXus data
Detailed description obsolescence of RAW files and preference for NeXus as standard
Issue champion Simon Lambert (STFC)
Other interested parties
Any other parties who are also interested in applying Issue Solutions to their Datasets. Identify the party with a link to their contact page on the SCAPE Sharepoint site, as well as identifying their institution in brackets. Eg: Schlarb Sven (ONB)
Possible Solution approaches No suitable solutions exist at present. Hence, a suitable RAW-to-NeXus migration mechanism would need to be developed.
Datasets nexus data files
Solutions Reference to the appropriate Solution page(s), by hyperlink
Evaluation Objectives scaleability, automation
Success criteria Describe the success criteria for solving this issue - what are you able to do? - what does the world look like?
Automatic measures What automated measures would you like the solution to give to evaluate the solution for this specific issue? which measures are important?
If possible specify very specific measures and your goal - e.g.
* handle up to 100Gb files without crashing
* fail safe - even if it fails, it fails gracefully, rather than crashing, i.e. effective error handling should be in place to allow the environment that hosts the tool to capture the error and notify other services that may interact with the tool.
* can migrate very large data files concurrently with migration processing of small files (up to 5 concurrent threads).
* can perform migration with a data rate up to 100MB/s
Manual assessment N.A.
Actual evaluations links to acutual evaluations of this Issue/Scenario