|
|
Bayesian and Neural Networks
Hložek, Bohuslav ; Rozman, Jaroslav (referee) ; Zbořil, František (advisor)
This paper introduces Bayesian neural network based on Occams razor. Basic knowledge about neural networks and Bayes rule is summarized in the first part of this paper. Principles of Occams razor and Bayesian neural network are explained. A real case of use is introduced (about predicting landslide). The second part of this paper introduces how to construct Bayesian neural network in Python. Such an application is shown. Typical behaviour of Bayesian neural networks is demonstrated using example data.
|
|
|
Neural Network Letter Recognition
Kluknavský, František ; Hradiš, Michal (referee) ; Šilhavá, Jana (advisor)
This work uses handwritten character recognition as a model problem for using multilayer perceptron, error backpropagation learning algorithm and finding their optimal parameters, hidden layer size, learning rate and length, ability to handle damaged data. Results were acquired by repeated simulation and testing the neural network using 52,152 English lowercase letters. Best results, smallest network and shortest learning time was at 60 neurons in the hidden layer and learning rate of 0.01. Bigger networks achieved the same ability to recognize unknown patterns and higher robustness at highly damaged data processing.
|
|
|
Techniques For Avoiding Model Overfitting On Small Dataset
Kratochvila, Lukas
Building a deep learning model based on small dataset is difficult, even impossible. Toavoiding overfitting, we must constrain model, which we train. Techniques as data augmentation,regularization or data normalization could be crucial. We have created a benchmark with a simpleCNN image classifier in order to find the best techniques. As a result, we compare different types ofdata augmentation and weights regularization and data normalization on a small dataset.
|
|
|
Bayesian and Neural Networks
Hložek, Bohuslav ; Rozman, Jaroslav (referee) ; Zbořil, František (advisor)
This paper introduces Bayesian neural network based on Occams razor. Basic knowledge about neural networks and Bayes rule is summarized in the first part of this paper. Principles of Occams razor and Bayesian neural network are explained. A real case of use is introduced (about predicting landslide). The second part of this paper introduces how to construct Bayesian neural network in Python. Such an application is shown. Typical behaviour of Bayesian neural networks is demonstrated using example data.
|
|
|
Neural Network Letter Recognition
Kluknavský, František ; Hradiš, Michal (referee) ; Šilhavá, Jana (advisor)
This work uses handwritten character recognition as a model problem for using multilayer perceptron, error backpropagation learning algorithm and finding their optimal parameters, hidden layer size, learning rate and length, ability to handle damaged data. Results were acquired by repeated simulation and testing the neural network using 52,152 English lowercase letters. Best results, smallest network and shortest learning time was at 60 neurons in the hidden layer and learning rate of 0.01. Bigger networks achieved the same ability to recognize unknown patterns and higher robustness at highly damaged data processing.
|
guest ::
