Szczegóły publikacji
Opis bibliograficzny
Transparent data access for scientific workflows across clouds / Michał ORZECHOWSKI, Bartosz BALIŚ, Łukasz DUTKA, Renata G. SŁOTA, Jacek KITOWSKI // W: Euro-Par 2019: parallel processing workshops : Euro-Par 2019 international workshops : Göttingen, Germany, August 26–30, 2019 : revised selected papers / eds. Ulrich Schwardmann, [et al.]. — Cham : Springer Nature Switzerland AG, cop. 2020. — (Lecture Notes in Computer Science ; ISSN 0302-9743 ; LNCS 11997. Theoretical Computer Science and General Issues ; ISSN 0302-9743). — ISBN: 978-3-030-48339-5; e-ISBN: 978-3-030-48340-1. — S. 751–755. — Bibliogr. s. 754–755, Abstr. — Publikacja dostępna online od: 2020-05-29. — J. Kitowski - dod. afiliacja: ACK Cyfronet AGH
Autorzy (5)
Słowa kluczowe
Dane bibliometryczne
| ID BaDAP | 129060 |
|---|---|
| Data dodania do BaDAP | 2020-06-24 |
| Tekst źródłowy | URL |
| DOI | 10.1007/978-3-030-48340-1_62 |
| Rok publikacji | 2020 |
| Typ publikacji | materiały konferencyjne (aut.) |
| Otwarty dostęp |  |
| Wydawca | Springer |
| Konferencja | International Conference on Parallel and Distributed Computing |
| Czasopisma/serie | Theoretical Computer Science and General Issues, Lecture Notes in Computer Science |
Abstract
We present a scientific workflow data management solution that combines global data access with a block-level optimization of data transfer, wherein only the data blocks that are used by a remote job are transferred over the network, significantly reducing data movement for specific common data access patterns. We propose the implementation of the solution based on the HyperFlow workflow management system and the Onedata data management platform. Preliminary results confirm the advantages of the proposed solution.