Szczegóły publikacji
Opis bibliograficzny
Global access to legacy data-sets in multi-cloud applications with onedata / Michał ORZECHOWSKI, Michał WRZESZCZ, Bartosz KRYZA, Łukasz DUTKA, Renata G. SŁOTA, Jacek KITOWSKI // W: Parallel Processing and Applied Mathematics : 14th international Conference, PPAM 2022 : Gdansk, Poland, September 11–14, 2022 : revised selected papers, Pt. 1 / eds. Roman Wyrzykowski [et al.]. — Cham : Springer Nature Switzerland, cop. 2023. — (Lecture Notes in Computer Science ; ISSN 0302-9743 ; LNCS 13826). — ISBN: 978-3-031-30441-5; e-ISBN: 978-3-031-30442-2. — S. 305–317. — Bibliogr., Abstr. — Publikacja dostępna online od: 2023-04-28. — J. Kitowski - dod. afiliacja: Academic Computer Centre CYFRONET AGH
Autorzy (6)
Słowa kluczowe
Dane bibliometryczne
| ID BaDAP | 147818 |
|---|---|
| Data dodania do BaDAP | 2023-09-06 |
| DOI | 10.1007/978-3-031-30442-2_23 |
| Rok publikacji | 2023 |
| Typ publikacji | materiały konferencyjne (aut.) |
| Otwarty dostęp |  |
| Wydawca | Springer |
| Konferencja | International Conference on Parallel Processing and Applied Mathematics 2022 |
| Czasopismo/seria | Lecture Notes in Computer Science |
Abstract
Data access and management for multi-cloud applications proves challenging where there is a need for efficient access to large pre-existing, legacy data-sets. To address this problem, we created an indexing subsystem incorporated into Onedata data management system achieving a global multi-cloud integration of legacy storage systems containing large data-sets. The solution is based on metadata management, organization and periodic monitoring of legacy data-sets, what makes possible scheme-less co-existence a legacy storage system and Onedata for managing the same data collections. Thanks to block based data transfer provided by Onedata large files stored on legacy storage systems can be efficiently accessed from the cloud. The approach has been initially evaluated in a multi-cloud deployment scenario, where a large data collection stored on legacy storage system located in a super-computing center is processed on a commercial cloud.
