Please use this identifier to cite or link to this item:
http://hdl.handle.net/10071/14481
Author(s): | Abreu, P. Fonseca, R. A. Silva, L. O. |
Date: | 2008 |
Title: | Migrating large output applications to Grid environments: a simple library for threaded transfers with gLite |
Pages: | 311-322 |
Event title: | IBERGRID 2008 - The 2nd Iberian Grid Infrastructure Conference |
Reference: | Abreu, P., Fonseca, R. A. & Silva, L. O. (2008). Migrating large output applications to Grid environments: a simple library for threaded transfers with gLite. In Fernando Silva, Gaspar Barreira and Lígia Ribeiro (Ed.), IBERGRID 2008 - The 2nd Iberian Grid Infrastructure Conference. (pp. 311-322). Porto: Netbiblo. |
ISBN: | 9788497452885 |
Abstract: | As the EGEE infrastructure and middleware matures, it is becoming increasingly attractive to different kinds of user applications than it was initially planned for. In particular, it starts to attract users of the application paradigm where, from a relatively small input data set, a large set of data is produced, like it is common in several types of simulations. In this paper we present a simple library based on EGEE middleware function calls, in particular lcg utils, that handles the transfer of large data file sets from the local storage of the Worker Node to an EGEE Storage Element in a way that is simple, robust, transparent to the user and minimizes performance impact. The library is very easy to integrate into non-Grid/legacy code and it is flexible enough to allow for overlapping of several data transfers and computation. We also present a carefull analysis of the performance impact on several application scenarios. Finally, we analyse the use of the library in a real case scenario, where it is used in a high-performance plasma simulation code. |
Peerreviewed: | yes |
Access type: | Open Access |
Appears in Collections: | CTI-CRI - Comunicações a conferências internacionais |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Ibergrid - 2nd Iberian Grid Infrastructure Conference 2008 Fonseca.pdf | 406,4 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.