Szczegóły publikacji

Opis bibliograficzny

Model and system for scientific workflows represented in file system directory tree / Mieszko MAKUCH, Maciej MALAWSKI, Joanna KOCOT, Tomasz SZEPIENIEC // Future Generation Computer Systems ; ISSN 0167-739X. — 2022 — vol. 133, s. 378-394. — Bibliogr. s. 393-394, Abstr. — Publikacja dostępna online od: 2022-03-23. — M. Makuch - dod. afiliacja: AGH University of Science and Technology, Institute of Computer Science

Autorzy (4)

Słowa kluczowe

complexity managementscience gatewaystree structureworkflow compositionscientific workflow

Dane bibliometryczne

ID BaDAP139855
Data dodania do BaDAP2022-04-19
Tekst źródłowyURL
DOI10.1016/j.future.2022.03.023
Rok publikacji2022
Typ publikacjiartykuł w czasopiśmie
Otwarty dostęptak
Creative Commons
Czasopismo/seriaFuture Generation Computer Systems

Abstract

In this paper, we present a new workflow representation model which is based on directory trees. We show the implementation of the model inside the EPISODES Platform — a portal for analyses related to anthropogenic hazards. Most workflow management systems use a DAG or custom programming language to encode a workflow. While this works well in many cases, we believe that there is a class of applications for which our approach is a better fit. This paper demonstrates how workflows can be efficiently represented in a file system tree. In our model, each workflow step is encoded as a directory. This enables natural encapsulation and modularity of the data alongside the workflow structure. We show how fundamental patterns such as sequence, merge, fork, and cycle are encoded. We believe that the presented directory tree-based representation is well suited for workflow systems that emphasize interactive composition processes. By implementing a rich GUI with built-in data visualization tools it may be particularly useful for exploratory programming where interactivity, dynamicity, and extensibility are crucial. The solution supports multi-level workflow nesting, reuse, sharing, and live collaboration in the workflow design process. The integrated workflow execution engine is scalable and supports automatic execution on high-performance distributed infrastructure. Our model was implemented and evaluated within the EPISODES Platform (Orlecka-Sikora et al., 2020), a workflow management system used by over 1400 users interested in research into anthropogenic hazards.

Publikacje, które mogą Cię zainteresować

fragment książki
#135366Data dodania: 26.7.2021
Applying workflows to scientific projects represented in file system directory tree / Mieszko Makuch, Maciej MALAWSKI, Joanna KOCOT, Tomasz SZEPIENIEC // W: WORKS 2020 [Dokument elektroniczny] : proceedings of the 15th Workshop on Workflows in Support of Large-Scale Science conjunction with SC20: the international conference for High Performance Computing, Networking, Storage and Analysis : virtual conference, November 9-19, 2020. — Wersja do Windows. — Dane tekstowe. — Piscataway : The Institute of Electrical and Electronics Engineers, cop. 2020. — e-ISBN: 978-1-6654-0452-5. — S. 25–32. — Wymagania systemowe: Adobe Reader. — Bibliogr. s. 32, Abstr.
artykuł
#103380Data dodania: 23.1.2017
HyperFlow: a model of computation, programming approach and enactment engine for complex distributed workflows / Bartosz BALIŚ // Future Generation Computer Systems ; ISSN 0167-739X. — 2016 — vol. 55, s. 147–162. — Bibliogr. s. 161–162, Abstr. — Publikacja dostępna online od: 2015-09-26