Szczegóły publikacji
Opis bibliograficzny
Improving prediction of computational job execution times with machine learning / Bartosz BALIŚ, Tomasz LELEK, Jakub Bodera, Michał Grabowski, Costin Grigoras // Concurrency and Computation : Practice and Experience ; ISSN 1532-0626. — 2024 — vol. 36 iss. 2 art. no. e7905, s. 1–19. — Bibliogr. s. 18–19, Summ. — Publikacja dostępna online od: 2023-09-12
Autorzy (5)
Słowa kluczowe
Dane bibliometryczne
| ID BaDAP | 151093 |
|---|---|
| Data dodania do BaDAP | 2024-02-13 |
| Tekst źródłowy | URL |
| DOI | 10.1002/cpe.7905 |
| Rok publikacji | 2024 |
| Typ publikacji | artykuł w czasopiśmie |
| Otwarty dostęp |  |
| Czasopismo/seria | Concurrency and Computation : Practice & Experience |
Abstract
Predicting resource consumption and run time of computational workloads is crucial for efficient resource allocation, or cost and energy optimization. In this paper, we evaluate various machine learning techniques to predict the execution time of computational jobs. For experiments we use datasets from two application areas: scientific workflow management and data processing in the ALICE experiment at CERN. We apply a two-stage prediction method and evaluate its performance. Other evaluated aspects include: (1) comparing performance of global (per-workflow) versus specialized (per-job) models; (2) impact of prediction granularity in the first stage of the two-stage method; (3) using various feature sets, feature selection, and feature importance analysis; (4) applying symbolic regression in addition to classical regressors. Our results provide new valuable insights on using machine learning techniques to predict the runtime behavior of computational jobs.