SCAPE Platform business case template - Revision history

PRWheatley: /* The SCAPE Platform in use */

2014-06-03T12:41:13Z

The SCAPE Platform in use

← Older revision		Revision as of 12:41, 3 June 2014
Line 106:		Line 106:
	During the indexing, you can do more sophisticated analysis, both because you have a lot more ram and the framework. The mere fact that it’s running on multiple machines means that you have more RAM available per document as well as more CPU time. This makes more intensive preservation analysis more plausible than if you were to parallelize the I/O only. For example, we can imagine actually running an embedded browser and rendering some significant fraction of the collection in order to look for access problems (although we don’t do that at present).		During the indexing, you can do more sophisticated analysis, both because you have a lot more ram and the framework. The mere fact that it’s running on multiple machines means that you have more RAM available per document as well as more CPU time. This makes more intensive preservation analysis more plausible than if you were to parallelize the I/O only. For example, we can imagine actually running an embedded browser and rendering some significant fraction of the collection in order to look for access problems (although we don’t do that at present).
	</blockquote>		</blockquote>
			''Also see this [http://openplanetsfoundation.org/blogs/2014-05-28-weekend-nanite blog post] from Per Møldrup-Dalum on using Nanite at the Danish State and University Library

	''For more on the relevance and value of understanding the context to your organisation's business case, see the DPBCT section on [[External context]].''		''For more on the relevance and value of understanding the context to your organisation's business case, see the DPBCT section on [[External context]].''

PRWheatley at 19:28, 21 May 2014

2014-05-21T19:28:19Z

← Older revision		Revision as of 19:28, 21 May 2014
Line 1:		Line 1:
	__NOTOC__		__NOTOC__
	~~<blockquote style="background-color: lightblue; border: solid thick lightblue;">~~
	~~'''This template is a draft and is currently under development by the SCAPE Project!'''~~
	~~</blockquote>~~
	''Use this to help develop a convincing business case for the use of the SCAPE Platform in your organisation.''		''Use this to help develop a convincing business case for the use of the SCAPE Platform in your organisation.''

PRWheatley: /* SCAPE Platform benefits by SCAPE dimensions of scalability */

2014-05-21T17:44:03Z

SCAPE Platform benefits by SCAPE dimensions of scalability

← Older revision		Revision as of 17:44, 21 May 2014
Line 59:		Line 59:
	'''Complexity of objects and Heterogeneity of collections'''		'''Complexity of objects and Heterogeneity of collections'''

	Preservation tools are constantly being enhanced as ~~our~~ understanding of digital preservation improves and knowledge of new formats (and the finer details of existing formats) grows. Being able to re-run preservation processes on large collections therefore becomes a useful capability. This is very dependent on the length of time it takes to execute a process on a large collection. For example, re-running a format identification process when a new set of file format signatures becomes available is clearly desirable, particularly for heterogeneous collections such as web archives. But it's not practical if the process takes weeks or possibly even months to complete.		Preservation tools are constantly being enhanced as the community's understanding of digital preservation improves and knowledge of new formats (and the finer details of existing formats) grows. Being able to re-run preservation processes on large collections therefore becomes a useful capability. This is very dependent on the length of time it takes to execute a process on a large collection. For example, re-running a format identification process when a new set of file format signatures becomes available is clearly desirable, particularly for heterogeneous collections such as web archives. But it's not practical if the process takes weeks or possibly even months to complete.

	Greater computing power enables deeper characterisation to be applied to collections, as long as execution times remain viable. This is essential for complex objects that may have embedded formats, that may be dependent on external content, or may contain a host of other preservation risks that can only be detected via thorough (and therefore typically computationally expensive) characterisation.		Greater computing power enables deeper characterisation to be applied to collections, as long as execution times remain viable. This is essential for complex objects that may have embedded formats, that may be dependent on external content, or may contain a host of other preservation risks that can only be detected via thorough (and therefore typically computationally expensive) characterisation.

PRWheatley: /* SCAPE Platform benefit summary */

2014-05-21T17:43:11Z

SCAPE Platform benefit summary

← Older revision		Revision as of 17:43, 21 May 2014
Line 43:		Line 43:
	*[1] Deeper characterisation may otherwise require such lengthy execution time that it would not be viable		*[1] Deeper characterisation may otherwise require such lengthy execution time that it would not be viable
	*[2] If the execution time is reasonable, re-runs to address bugs or enable refinement of the process to address edge cases becomes more realistic. See [[#The SCAPE Platform in use\|The SCAPE Platform in use]]		*[2] If the execution time is reasonable, re-runs to address bugs or enable refinement of the process to address edge cases becomes more realistic. See [[#The SCAPE Platform in use\|The SCAPE Platform in use]]
	*[3] In particular, use of Taverna		*[3] In particular, use of [http://www.taverna.org.uk/ Taverna]
	*[4] The SCAPE Platform provides the capability for a digital preservation department to exploit an existing organisational hadoop cluster		*[4] The SCAPE Platform provides the capability for a digital preservation department to exploit an existing organisational hadoop cluster

PRWheatley: /* How to use this template */

2014-05-21T17:04:09Z

How to use this template

← Older revision		Revision as of 17:04, 21 May 2014
Line 9:		Line 9:

	====How to use this template====		====How to use this template====
	The sections on benefits, risks and costs can be reused by organisations who would like to create a business case for the use of the SCAPE Platform, but they must be tailored to that organisation's particular needs, aims and contextual situation. The [[#SCAPE Platform business case example\|SCAPE Platform Business Case Example]] shows how the generic business benefits and risks can be adapted to meet the specific needs of ~~an organisation~~ (~~in this case a~~ theoretical ~~one!~~). Developing benefits and risks requires careful analysis, adaptation, use of language and prioritisation as described elsewhere within the [[Digital Preservation Business Case Toolkit]]. The [[Step by step guide to building a business case]] is a good place to start.		The sections on benefits, risks and costs can be reused by organisations who would like to create a business case for the use of the SCAPE Platform, but they must be tailored to that organisation's particular needs, aims and contextual situation. The [[#SCAPE Platform business case example\|SCAPE Platform Business Case Example]] shows how the generic business benefits and risks can be adapted to meet the specific needs of a (theoretical) organisation. Developing benefits and risks requires careful analysis, adaptation, use of language and prioritisation as described elsewhere within the [[Digital Preservation Business Case Toolkit]]. The [[Step by step guide to building a business case]] is a good place to start.

	====About the SCAPE Platform====		====About the SCAPE Platform====

PRWheatley: /* Justifying for the benefits */

2014-05-21T17:00:46Z

Justifying for the benefits

← Older revision		Revision as of 17:00, 21 May 2014
Line 65:		Line 65:
	''For more on developing and articulating your business benefits see the DPBCT sections on [[Benefits]], [[Stakeholder analysis]], [[Who is going to be affected?]] and [[How do I make the case for what I want to do?]]''.		''For more on developing and articulating your business benefits see the DPBCT sections on [[Benefits]], [[Stakeholder analysis]], [[Who is going to be affected?]] and [[How do I make the case for what I want to do?]]''.

	===~~Justifying~~ for the benefits===		===Justification for the benefits===
	The SCAPE Platform is designed to enable the performance of preservation processes to be scaled as per the needs of the situation. Adding additional nodes to a SCAPE platform will scale the performance. Evaluation work conducted by SCAPE provides some illustration of the potential savings that can be made in the execution of typical preservation processes. For example, [http://wiki.opf-labs.org/display/SP/Web+Archive+FITS+Characterisation+using+ToMaR+at+ONB characterising web content] with benchmarking [http://wiki.opf-labs.org/display/SP/EVAL+Taverna-Fits-ToMaR-C3PO showing considerably higher performance] running (the SCAPE Platform) on a small test cluster.		The SCAPE Platform is designed to enable the performance of preservation processes to be scaled as per the needs of the situation. Adding additional nodes to a SCAPE platform will scale the performance. Evaluation work conducted by SCAPE provides some illustration of the potential savings that can be made in the execution of typical preservation processes. For example, [http://wiki.opf-labs.org/display/SP/Web+Archive+FITS+Characterisation+using+ToMaR+at+ONB characterising web content] with benchmarking [http://wiki.opf-labs.org/display/SP/EVAL+Taverna-Fits-ToMaR-C3PO showing considerably higher performance] running (the SCAPE Platform) on a small test cluster.

PRWheatley: /* SCAPE Platform benefits */

2014-05-21T17:00:31Z

SCAPE Platform benefits

← Older revision		Revision as of 17:00, 21 May 2014
Line 64:		Line 64:

	''For more on developing and articulating your business benefits see the DPBCT sections on [[Benefits]], [[Stakeholder analysis]], [[Who is going to be affected?]] and [[How do I make the case for what I want to do?]]''.		''For more on developing and articulating your business benefits see the DPBCT sections on [[Benefits]], [[Stakeholder analysis]], [[Who is going to be affected?]] and [[How do I make the case for what I want to do?]]''.

			===Justifying for the benefits===
			The SCAPE Platform is designed to enable the performance of preservation processes to be scaled as per the needs of the situation. Adding additional nodes to a SCAPE platform will scale the performance. Evaluation work conducted by SCAPE provides some illustration of the potential savings that can be made in the execution of typical preservation processes. For example, [http://wiki.opf-labs.org/display/SP/Web+Archive+FITS+Characterisation+using+ToMaR+at+ONB characterising web content] with benchmarking [http://wiki.opf-labs.org/display/SP/EVAL+Taverna-Fits-ToMaR-C3PO showing considerably higher performance] running (the SCAPE Platform) on a small test cluster.

	==SCAPE Platform cost elements==		==SCAPE Platform cost elements==

PRWheatley: /* Acknowledgements */

2014-05-09T16:27:54Z

Acknowledgements

← Older revision		Revision as of 16:27, 9 May 2014
Line 122:		Line 122:
	{{:ScapePlatformImplementationRisksMitigation}}		{{:ScapePlatformImplementationRisksMitigation}}

	=Acknowledgements=		==Acknowledgements==
	''This business case template was created by the [http://www.scape-project.eu/ SCAPE Project] with the support of the European Union under FP7 ICT-2009.4.1''		''This business case template was created by the [http://www.scape-project.eu/ SCAPE Project] with the support of the European Union under FP7 ICT-2009.4.1''

	[[File:Scape logo.png\|link=http://www.scape-project.eu/]]		[[File:Scape logo.png\|link=http://www.scape-project.eu/]]

PRWheatley: /* About the SCAPE Platform */

2014-05-08T18:40:14Z

About the SCAPE Platform

← Older revision		Revision as of 18:40, 8 May 2014
Line 12:		Line 12:

	====About the SCAPE Platform====		====About the SCAPE Platform====
	The "SCAPE Platform" is an umbrella term for the suite of SCAPE and non-SCAPE tools that enable preservation processes to be run in parallel on a high performance cluster. The term also represents the ethos of leveraging high performance computing to make preservation actions achievable at scale. The SCAPE Platform is centred on the Apache Hadoop Framework and includes new tools and approaches such as ToMaR, Nanite and repository connectors.		The "SCAPE Platform" is an umbrella term for the suite of SCAPE and non-SCAPE tools that enable preservation processes to be run in parallel on a high performance cluster. The term also represents the ethos of leveraging high performance computing to make preservation actions achievable at scale. The SCAPE Platform is centred on the Apache Hadoop Framework and includes new tools and approaches such as [https://github.com/openplanets/ToMaR ToMaR], Nanite and repository connectors.

	This technology enables preservation processes, such as identifying the format of a file, to be run on a high performance computing cluster. This is important when the digital collections to be preserved are large, and execution time on a single computer could take months or even years.		This technology enables preservation processes, such as identifying the format of a file, to be run on a high performance computing cluster. This is important when the digital collections to be preserved are large, and execution time on a single computer could take months or even years.

PRWheatley at 18:37, 8 May 2014

2014-05-08T18:37:33Z

← Older revision		Revision as of 18:37, 8 May 2014
Line 123:		Line 123:

	=Acknowledgements=		=Acknowledgements=
	''This business case template was created by the SCAPE Project with the support of the European Union under FP7 ICT-2009.4.1''		''This business case template was created by the [http://www.scape-project.eu/ SCAPE Project] with the support of the European Union under FP7 ICT-2009.4.1''

	[[File:Scape logo.png]]		[[File:Scape logo.png\|link=http://www.scape-project.eu/]]