Archived copy. This page was recovered from the Internet Archive snapshot of /display/SP/STFC Scientific Datasets taken on 2016-09-12. The original wiki at wiki.opf-labs.org is being decommissioned.

STFC Scientific Datasets

Created by Erica Yang on Jan 30, 2012 · last edited by Erica Yang · on Aug 30, 2012 (view history) · 13 versions

Title	Scientific datasets relevant to STFC facilities
Description	There are three categories of scientific datasets: Raw data: data files captured from the instruments, they are typically in two formats: raw and NeXus. Nexus data files Catalogue data: each dataset from an experiment is associated with a set of catalogue entries, specified using the Core Scientific MetaData model (CSMD). The available sample catelogue data is XML under CSMD. ICAT data catalogue entries Processed data: data files captured through data reduction and analysis processes. Process datasets and the related context (workflow, software, provenance)
Licensing	See the STFC Data Policy for the SCAPE project
Owner	Research investigators, then, when the data becomes public, it will be owned by the public.
Dataset Location	Raw and catalogue data availability: https://scapeweb.esc.rl.ac.uk/ Processed data is not owned by STFC, so, not available
Collection expert	Erica Yang (STFC)
List of Issues	For 1st and 2nd SCAPE years: IS29 Characterisation and validation of very large data files IS30 Fixity capturing and checking of very large data files IS31 Semantic checking of very large data files IS32 Basic Migration of RAW to NeXus data IS33 Enhanced migration of RAW to NeXus data (Perhaps) for the 3rd SCAPE year and afterwards IS34 ISIS instrument website no longer applicable or available IS35 Mantid website or software no longer applicable or available IS36 Examine the long term value of the preserved datasets IS37 Preserving the verifiability and provenance of processed datasets