Szczegóły publikacji
Opis bibliograficzny
Harmonizing sequential and random access to datasets in organizationally distributed environments / Michał WRZESZCZ, Łukasz OPIOŁA, Bartosz KRYZA, Łukasz DUTKA, Renata G. SŁOTA, Jacek KITOWSKI // W: Computational Science – ICCS 2019 : 19th International Conference : Faro, Portugal, June 12–14, 2019 : proceedings, Pt. 1 / eds. João M. F. Rodrigues, [et al.]. — Cham : Springer Nature Switzerland AG, cop. 2019. — (Lecture Notes in Computer Science ; ISSN 0302-9743 ; 11536. Theoretical Computer Science and General Issues ; ISSN 0302-9743). — ISBN: 978-3-030-22733-3; e-ISBN: 978-3-030-22734-0. — S. 295–308. — Bibliogr. s. 307–308, Abstr. — M. Wrzeszcz, Ł. Opioła, J. Kitowski - dod. afiliacja: CYFRONET AGH
Autorzy (6)
Słowa kluczowe
Dane bibliometryczne
| ID BaDAP | 122344 |
|---|---|
| Data dodania do BaDAP | 2019-07-05 |
| Tekst źródłowy | URL |
| DOI | 10.1007/978-3-030-22734-0_22 |
| Rok publikacji | 2019 |
| Typ publikacji | materiały konferencyjne (aut.) |
| Otwarty dostęp |  |
| Wydawca | Springer |
| Konferencja | International Conference on Computational Science 2019 |
| Czasopisma/serie | Theoretical Computer Science and General Issues, Lecture Notes in Computer Science |
Abstract
Computational science is rapidly developing, which pushes the boundaries in data management concerning the size and structure of datasets, data processing patterns, geographical distribution of data and performance expectations. In this paper we present a solution for harmonizing data access performance, i.e. finding a compromise between local and remote read/write efficiency that would fit those evolving requirements. It is based on variable-size logical data-chunks (in contrast to fixed-size blocks), direct storage access and several mechanisms improving remote data access performance. The solution is implemented in the Onedata system and suited to its multi-layer architecture, supporting organizationally distributed environments – with limited trust between data providers. The solution is benchmarked and compared to XRootD + XCache, which offers similar functionalities. The results show that the performance of both systems is comparable, although overheads in local data access are visibly lower in Onedata.
