Szczegóły publikacji
Opis bibliograficzny
Cassiopeia – towards a distributed and composable crawling platform / Leszek SIWIK, Robert MARCJAN, Kamil Włodarczyk // Journal of Telecommunications and Information Technology ; ISSN 1509-4553. — 2014 — nr 2, s. 79–89. — Bibliogr. s. 88–89, Abstr.
Autorzy (3)
Słowa kluczowe
Dane bibliometryczne
| ID BaDAP | 82620 |
|---|---|
| Data dodania do BaDAP | 2014-08-26 |
| Tekst źródłowy | URL |
| Rok publikacji | 2014 |
| Typ publikacji | artykuł w czasopiśmie |
| Otwarty dostęp |  |
| Creative Commons | |
| Czasopismo/seria | Journal of Telecommunications and Information Technology |
Abstract
When it comes to designing and implementing crawling systems or Internet robots, it is of the utmost importance to first address efficiency and scalability issues (from a technical and architectural point of view), due to the enormous size and unimaginable structural complexity of the World Wide Web. There are, however, a significant number of users for whom flexibility and ease of execution are as important as efficiency. Running, defining, and composing Internet robots and crawlers according to dynamically-changing requirements and use-cases in the easiest possible way (e.g. in a graphical, drag & drop manner) is necessary especially for criminal analysts. The goal of this paper is to present the idea, design, crucial architectural elements, Proof-of-Concept (PoC) implementation, and preliminary experimental assessment of Cassiopeia framework, i.e. an all-in-one studio addressing both of the above-mentioned aspects.
