A cloud framework for high troughput biological data processing

A cloud framework for high troughput biological data processing

Abstract

The molecular systems biology community has to deal with an increasingly growing amount of data. A recent programming model that addresses the data deluge is MapReduce which facilitates processing of huge data volumes on large sets of computing resources. However, the availability of appropriate local computing resources is often limited. Cloud computing addresses this issue by providing virtually infinite resources on demand, usually following a pay per use model. In this paper we present our cloud based high throughput computing infrastructure which combines the Software as a Service approach with the MapReduce programming model for data-intensive applications, and a configurable distributed file system as provided by the Hadoop framework. Within this infrastructure we realized an application in the field of molecular systems biology which matches tryptic peptide fragmentation mass spectra data against a large scale mass spectral reference database. We evaluate this application on a local cloud resource and study the effects of different configuration parameters as provided by the application, the Hadoop framework, and the available computational and storage resources.

Grafik Top
Authors
  • Köhler, Martin
  • Kaniovskyi, Yuriy
  • Benkner, Siegfried
  • Egelhofer, Volker
  • Weckwerth, Wolfram
Grafik Top
Shortfacts
Category
Paper in Conference Proceedings or in Workshop Proceedings (Paper)
Event Title
International Symposium on Grids and Clouds, PoS(ISGC 2011 & OGF 31)069
Divisions
Scientific Computing
Event Location
Taipei, Taiwan
Event Type
Conference
Date
March 2011
Export
Grafik Top