Szczegóły publikacji
Opis bibliograficzny
Towards a scalable distributed fitness evaluation service / Włodzimierz FUNIKA, Paweł Koperek // W: Parallel Processing and Applied Mathematics : 11th international conference, PPAM 2015 : Krakow, Poland, September 6–9, 2015 : revised selected papers, Pt. 1 / eds. Roman Wyrzykowski, [et al.]. — Swizerland : Springer International Publishing, cop. 2016. — (Lecture Notes in Computer Science ; ISSN 0302-9743 ; 9573). — ISBN: 978-3-319-32148-6; e-ISBN: 978-3-319-32149-3. — S. 493–502. — Bibliogr. s. 502, Abstr.
Autorzy (2)
Słowa kluczowe
Dane bibliometryczne
| ID BaDAP | 97602 |
|---|---|
| Data dodania do BaDAP | 2016-05-10 |
| DOI | 10.1007/978-3-319-32149-3_46 |
| Rok publikacji | 2016 |
| Typ publikacji | materiały konferencyjne (aut.) |
| Otwarty dostęp |  |
| Konferencja | International Conference on Parallel Processing and Applied Mathematics 2015 |
| Czasopisma/serie | Lecture Notes in Computer Science, Theoretical Computer Science and General Issues |
Abstract
Organizations across the globe gather more and more data. Large datasets require new approaches to analysis and processing, which include methods based on machine learning. In particular, the symbolic regression can provide many useful insights. Unfortunately, due to high resource requirements, the use of this method for large datasets might be unfeasible. In this paper we analyze a bottleneck in an open-source implementation of this method, we call hubert. We identify that the evaluation of individuals is the most costly operation. As a solution to this problem, we propose a new evaluation service based on the Apache Spark framework, which attempts to speed up computations by distributing them on a cluster of machines. We compare the performance of the service by analyzing the execution time for a number of samples with use of both implementations. Then we discuss how the computation time improves with increased amount of resources. Finally we draw conclusions and outline plans for further research.
