Archived copy.
This page was recovered from the Internet Archive snapshot of
/display/SP/Performance evaluation taken on 2016-03-30.
The original wiki at wiki.opf-labs.org is being decommissioned.
Performance evaluation
Evaluator(s)
Ondrej Klima (BUT)
Evaluation points
Assessment of measurable points
- Dependency of memory consumption on input resolution from July 7 - July 25, 2014
| Metric | Description | Metric baseline | Metric goal | resolution 64 points | 128 points | 256 points | 512 points | 1024 points |
|---|---|---|---|---|---|---|---|---|
| average runtime per item in seconds | The average processing time in seconds per item. | - |
- |
2.3 | 1.8 | 2.5 | 6.0 |
29.8 |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | - |
- | true |
true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | - |
- |
0 | 0 |
0 |
0 |
0 |
- Dependency of memory consumption on output resolution from July 7 - July 25, 2014
| Metric | Description | Metric baseline | Metric goal | resolution 64 points | 128 points | 256 points | 512 points |
|---|---|---|---|---|---|---|---|
| average runtime per item in seconds | The average processing time in seconds per item. | - |
- |
0.4 |
4.9 |
55.0 |
673.5 |
| reliable and stable assessment | Manual assessment on if the experiment performed reliable and stable. | - |
- | true | true | true | true |
| number of failed files | Number of files that failed in the workflow. | - |
- |
0 | 0 |
0 |
0 |
Technical details
- The actual wall time was measured. The boost library was used for time measurement.