|
|
Neural Language Model Acceleration
Labaš, Dominik ; Černocký, Jan (referee) ; Beneš, Karel (advisor)
This work adresses the topic of neural language model acceleration. The aim of this work is to optimize model of a feed-forward neural network. In accelerating of the neural network we used a change of activation function, pre-calculation of matrices for calculationg the hidden layer, implementation of the model's history cache and unnormalized model. The best-performing model was accelerated by 75.3\%.
|
|
|
Algorithmic Trading Using Artificial Neural Networks
Poláček, Samuel ; Beneš, Karel (referee) ; Szőke, Igor (advisor)
Algorithmic trading of many kinds of assets is not a new field at all. Domain of neural networks provides many tools, which are usefull in this field. This bachelor thesis discusses cryptocurrency trading algorithms using artificial neural network. In theoretical section of this thesis the basic theory and terms the stock market trading is based on is discussed. After the basic idea of cryptocurrencies is defined and used technical tools are introduced, the practical section starts. Sufficient configuration of neural network topology and hyperparameters values are obtained by many experiments. Subsequently after many experiments with indicators of technical analysis, acceptable neural network input configuration is obtained. Created neural network model combined with defined trading strategy generates profit.
|
|
|
Artificial Intelligence for a Board Game
Tureček, Dominik ; Baskar, Murali Karthick (referee) ; Beneš, Karel (advisor)
This work proposes and implements AI agents for the game Dice Wars. Dice Wars is turn-based, zero-sum game with non-deterministic move results. Several AI agents were created using rule-based approach, expectiminimax algorithm, and logistic regression. To evaluate the performance of proposed agents, an implementation of the game was created. Results of the experiments have shown that it's preferable to play aggressively in two-player games and make more optimal moves in games played with more players. The agent using expectiminimax is able to win more than 60 % of games in 8-player games against random players and wins 21.4 % of games played against a mix of seven other agents created in this work. In two-player setups, the agent using logistic regression with numbers of players' scores and number of dice as features has the best performance and wins 59.4 % of games in average.
|
|
|
Chatbot Based on Artificial Neural Networks
Čechák, Jiří ; Beneš, Karel (referee) ; Szőke, Igor (advisor)
The thesis describes an implementation and the way generative chatbot operates. The chatbot was implemented in Python using artificial neural networks and is based on a sequence-to-sequence principle. The final chatbot contains three models, which can be trained and used for conversations in a created GUI. After training of all three models, the chatbot was then tested by using BLEU metric. It was also tested by some users who compared the quality of its generated answers with the quality of answers created by already an existing chatbot Cleverbot. For a better understanding of the given problematics, there is a simple description of the basic terms, such as artificial intelligence, artificial neural networks, the difference between closed and open domain, word embedding and a basic description of the chatbots and their types, including their advantages, disadvantages and usage.
|
|
|
Acoustic Scene Classification from Speech
Grepl, Filip ; Beneš, Karel (referee) ; Matějka, Pavel (advisor)
This thesis deals with creating a system whose task is to recognize what type of location the recording was created at by analyzing the audio signal. The classifier is based on a multi-layer, fully connected neural network. The topology of the neural network is based on the baseline system provided for the DCASE competition. A dataset from this competition is also used for training and evaluating the neural network. The experiments are performed in particular with the representation of the properties of the audio records and with the format of the input data of the neural network. For this purpose, Mel-filter bank, block Mel-filter bank and MFCC flags are used. The experiments performed in this thesis brought a classification accuracy increased by 6.5 % compared to the baseline system of DCASE. Overall system success rate reached 67.5 %.
|
|
|
Modelling Music Waveforms Using Wavenet
Slanináková, Terézia ; Landini, Federico Nicolás (referee) ; Beneš, Karel (advisor)
This thesis focuses on exploring the possibilities of modelling music and speech with WaveNet, a deep neural network for generating raw audio waveforms. Using existing implementations, WaveNet was trained on multiple datasets and produced several audio files. Multiple experiments were carried out with various hyperparameter setups of WaveNet to find the optimal settings for the best results. Furthermore, multiple generation schemes were used, each having varying impact on the quality of generated audio. This quality was evaluated using human assessment via a questionnaire, where the musical samples were rated with a score 2-3.1818 on a 5 point scale, which is comparable to the rating of referential audio from the original WaveNet paper (3.1818).
|
|
|
Linear Logistic Regression Demo
Bak, Adam ; Kesiraju, Santosh (referee) ; Beneš, Karel (advisor)
This bachelor's thesis deals with the machine learning model logistic regression.The aim is to closely inspect and analyze the workings of this model for classification, in order to be able to provide a learning tool in the form of demonstrative application. All of the mathematical formulae, logistic sigmoid, cross entropy error function and gradient are derived and explained in a concise manner. This thesis also provides some insight into the form of the cross entropy error function in the case of linear logistic regression.
|
|
|
Chatbot Based on Artificial Neural Networks
Richtarik, Lukáš ; Beneš, Karel (referee) ; Szőke, Igor (advisor)
This work deals with the issue of chatbots, which are based on artificial neural networks and generative models. It also describes options and process of designing the chatbot as well as an implementation and testing using BLEU metrics. The work contains multiple experiments with different models of chatbots, their performance evaluation and comparison, user experience and several suggestions for future enhancements.
|
|
|
Machine Translation Using Artificial Neural Networks
Holcner, Jonáš ; Beneš, Karel (referee) ; Szőke, Igor (advisor)
The goal of this thesis is to describe and build a system for neural machine translation. System is built with recurrent neural networks - encoder-decoder architecture in particular. The result is a nmt library used to conduct experiments with different model parameters. Results of the experiments are compared with system built with the statistical tool Moses.
|
|
|
Detection of Malicious Websites using Machine Learning
Šulák, Ladislav ; Černocký, Jan (referee) ; Beneš, Karel (advisor)
Táto práca sa zaoberá problematikou škodlivého kódu na webe so zameraním na analýzu a detekciu škodlivého JavaScriptu umiestneného na strane klienta s využitím strojového učenia. Navrhnutý prístup využíva známe i nové pozorovania s ohľadom na rozdiely medzi škodlivými a legitímnymi vzorkami. Tento prístup má potenciál detekovať nové exploity i zero-day útoky. Systém pre takúto detekciu bol implementovaný a využíva modely strojového učenia. Výkon modelov bol evaluovaný pomocou F1-skóre na základe niekoľkých experimentov. Použitie rozhodovacích stromov sa podľa experimentov ukázalo ako najefektívnejšia možnosť. Najefektívnejším modelom sa ukázal byť Adaboost klasifikátor s dosiahnutým F1-skóre až 99.16 %. Tento model pracoval s 200 inštanciami randomizovaného rozhodovacieho stromu založeného na algoritme Extra-Trees. Viacvrstvový perceptrón bol druhým najlepším modelom s dosiahnutým F1-skóre 97.94 %.
|
guest ::
RSS feed.