|
Peer-to-peer Network for Decentralized File Storage and Distributed Task Processing
Mirbauer, Martin ; Zavoral, Filip (advisor) ; Jiráček, Zbyněk (referee)
Peer-to-peer networks allow development of high-performance, scalable and fault-tolerant applications. The most widely used peer-to-peer networks are mostly single-purpose (e.g. file-sharing) and usually lack countermeasures aga- inst sybil nodes; typical task distribution systems are centralized, which limits their performance. In this work we have analyzed the usability of peer-to-peer architecture for task distribution and designed the required infrastructure (file storage and search) including evaluation of possible security features. In order to evaluate the proposed design's usability we have implemented a client ap- plication (node) participating in the network's function, allowing access to files shared by other nodes and task distribution within the network. The resulting application is multi-platform and can be extended with more functionality.
|
|
Captured Communication Processing on Distributed System
Hvězda, Matěj ; Lichtner, Ondrej (referee) ; Pluskal, Jan (advisor)
When you need to assess or troubleshoot network by analysing capture file, you want it done as fast as possible and you do not always have a high-performance computer. Here comes the distributed system, which allows you to use his high computing power and lot of available memory. I introduce distributed application, which is scalable, extensible and capable of processing captured network communication and is developed for Windows platform. That provides technology, like Microsoft HPC Pack and Windows Communication foundation. The application supports multiple capture formats. In parallel system (cluster), exists database in order to save statistics and data of captured communication in order to save user's computer memory so client's application can be used for low-performance computers or make data available to a client after distributed processing.
|
|
Build Parallelization in Jenkins Environmnent
Lukášová, Michaela ; Zachariášová, Marcela (referee) ; Dolíhal, Luděk (advisor)
The goal of this bachelor's thesis is parallelization of building Codasip Studio, highly automated developement environment. It focuses on parallelization in Jenkins environment. The implemented solution is mainly focused on speeding up the actual build process. The solution uses a number of Jenkins plugins and several shell scripts, which ensures start of compilation, installation or creation of the final package.
|
| |
|
Velký mnohojazyčný korpus
Majliš, Martin ; Žabokrtský, Zdeněk (advisor) ; Spousta, Miroslav (referee)
This thesis introduces the W2C Corpus which contains 97 languages with more than 10 million words for each of these languages, with the total size 10.5 billion words. The corpus was built by crawling the Internet. This work describes the methods and tools used for its construction. The complete process consisted of building an initial corpus from Wikipedia, developing a language recognizer for 122 languages, implementing a distributed system for crawling and parsing webpages and finally, the reduction of duplicities. A comparative analysis of the texts of Wikipedia and the Internet is provided at the end of this thesis. The analysis is based on basic statistics such as average word and sentence length, conditional entropy and perplexity. 1
|
|
Peer-to-peer Network for Decentralized File Storage and Distributed Task Processing
Mirbauer, Martin ; Zavoral, Filip (advisor) ; Jiráček, Zbyněk (referee)
Peer-to-peer networks allow development of high-performance, scalable and fault-tolerant applications. The most widely used peer-to-peer networks are mostly single-purpose (e.g. file-sharing) and usually lack countermeasures aga- inst sybil nodes; typical task distribution systems are centralized, which limits their performance. In this work we have analyzed the usability of peer-to-peer architecture for task distribution and designed the required infrastructure (file storage and search) including evaluation of possible security features. In order to evaluate the proposed design's usability we have implemented a client ap- plication (node) participating in the network's function, allowing access to files shared by other nodes and task distribution within the network. The resulting application is multi-platform and can be extended with more functionality.
|
|
Velký mnohojazyčný korpus
Majliš, Martin ; Žabokrtský, Zdeněk (advisor) ; Spousta, Miroslav (referee)
This thesis introduces the W2C Corpus which contains 97 languages with more than 10 million words for each of these languages, with the total size 10.5 billion words. The corpus was built by crawling the Internet. This work describes the methods and tools used for its construction. The complete process consisted of building an initial corpus from Wikipedia, developing a language recognizer for 122 languages, implementing a distributed system for crawling and parsing webpages and finally, the reduction of duplicities. A comparative analysis of the texts of Wikipedia and the Internet is provided at the end of this thesis. The analysis is based on basic statistics such as average word and sentence length, conditional entropy and perplexity. 1
|
|
Build Parallelization in Jenkins Environmnent
Lukášová, Michaela ; Zachariášová, Marcela (referee) ; Dolíhal, Luděk (advisor)
The goal of this bachelor's thesis is parallelization of building Codasip Studio, highly automated developement environment. It focuses on parallelization in Jenkins environment. The implemented solution is mainly focused on speeding up the actual build process. The solution uses a number of Jenkins plugins and several shell scripts, which ensures start of compilation, installation or creation of the final package.
|
|
Captured Communication Processing on Distributed System
Hvězda, Matěj ; Lichtner, Ondrej (referee) ; Pluskal, Jan (advisor)
When you need to assess or troubleshoot network by analysing capture file, you want it done as fast as possible and you do not always have a high-performance computer. Here comes the distributed system, which allows you to use his high computing power and lot of available memory. I introduce distributed application, which is scalable, extensible and capable of processing captured network communication and is developed for Windows platform. That provides technology, like Microsoft HPC Pack and Windows Communication foundation. The application supports multiple capture formats. In parallel system (cluster), exists database in order to save statistics and data of captured communication in order to save user's computer memory so client's application can be used for low-performance computers or make data available to a client after distributed processing.
|
| |