|
|
Active learning for Bayesian neural networks in image classification
Belák, Michal ; Šabata, Tomáš (advisor) ; Vomlelová, Marta (referee)
In the past few years, complex neural networks have achieved state of the art results in image classification. However, training these models requires large amounts of labelled data. Whereas unlabelled images are often readily available in large quantities, obtaining l abels takes considerable human effort. Active learning reduces the required labelling effort by selecting the most informative instances to label. The most popular active learning query strategy framework, uncertainty sampling, uses uncertainty estimates of the model being trained to select instances for labelling. However, modern classification neural networks often do not provide good uncertainty estimates. Baye sian neural networks model uncertainties over model parameters, which can be used to obtain uncertainties over model predictions. Exact Bayesian inference is intractable for neural networks, however several approximate methods have been proposed. We experiment with three such methods using various uncertainty sampling active learning query strategies.
|
|
|
Historical curriculum at primary school
Šulcová, Jana ; Dvořáková, Michaela (advisor) ; Stará, Jana (referee)
This thesis discusses the historical curriculum in primary school and looking for ways to teach it effectively. Its aim is to analyze the educational goals of the historical curriculum of primary school. The introduction deals with the question of why history should be part of education in the first grade of primary school. Furthermore, it compares the historical conception of education at primary school in our conditions with the concept of the state, whose aims and methods of historical thinking are inspiring for us. Based on the findings and recommendations of domestic and foreign researches are in the empirical part of the thesis didactic designed tutorials selected topic historical subject matter with regard to diagnosis and development of historical thinking. Proposed lessons were implemented in the second year of primary school. At the end of each lesson is to evaluate the effectiveness of proposed schemes through analysis worksheets and comparing the results of the input and output mind maps and chalk talk. The entire set of lessons is evaluated through analysis of the final evaluation sheets pupils.
|
|
| |
|
| |
|
|
Active Learning for Processing of Archive Sources
Hříbek, David ; Zbořil, František (referee) ; Rozman, Jaroslav (advisor)
This work deals with the creation of a system that allows uploading and annotating scans of historical documents and subsequent active learning of models for character recognition (OCR) on available annotations (marked lines and their transcripts). The work describes the process, classifies the techniques and presents an existing system for character recognition. Above all, emphasis is placed on machine learning methods. Furthermore, the methods of active learning are explained and a method of active learning of available OCR models from annotated scans is proposed. The rest of the work deals with a system design, implementation, available datasets, evaluation of self-created OCR model and testing of the entire system.
|
|
|
Active learning for Bayesian neural networks in image classification
Belák, Michal ; Šabata, Tomáš (advisor) ; Vomlelová, Marta (referee)
In the past few years, complex neural networks have achieved state of the art results in image classification. However, training these models requires large amounts of labelled data. Whereas unlabelled images are often readily available in large quantities, obtaining l abels takes considerable human effort. Active learning reduces the required labelling effort by selecting the most informative instances to label. The most popular active learning query strategy framework, uncertainty sampling, uses uncertainty estimates of the model being trained to select instances for labelling. However, modern classification neural networks often do not provide good uncertainty estimates. Baye sian neural networks model uncertainties over model parameters, which can be used to obtain uncertainties over model predictions. Exact Bayesian inference is intractable for neural networks, however several approximate methods have been proposed. We experiment with three such methods using various uncertainty sampling active learning query strategies.
|
|
|
Active Learning with Neural Networks
Bureš, Tomáš ; Kolář, Martin (referee) ; Hradiš, Michal (advisor)
The topic of this thesis in active learning in conjunction with neural networks. First, it deals with theory of active learning and strategies used in real life scenarios. Followed by practical part, experimenting with active learning strategie and evaluating those experiments.
|
|
|
Active Learning for OCR
Kohút, Jan ; Kolář, Martin (referee) ; Hradiš, Michal (advisor)
The aim of this Master's thesis is to design methods of active learning and to experiment with datasets of historical documents. A large and diverse dataset IMPACT of more than one million lines is used for experiments. I am using neural networks to check the readability of lines and correctness of their annotations. Firstly, I compare architectures of convolutional and recurrent neural networks with bidirectional LSTM layer. Next, I study different ways of learning neural networks using methods of active learning. Mainly I use active learning to adapt neural networks to documents that the neural networks do not have in the original training dataset. Active learning is thus used for picking appropriate adaptation data. Convolutional neural networks achieve 98.6\% accuracy, recurrent neural networks achieve 99.5\% accuracy. Active learning decreases error by 26\% compared to random pick of adaptations data.
|
|
|
Experience with the Implementation of the Toddler's University - the Discovery Island Program
KORBELOVÁ, Markéta
The main objective of this bachelor thesis is to describe experience with realization of The Toddler's University, specifically with the Discovery Island Program. The other objective of this thesis is to show the issues of development and active learning of two years old children. The theoretic part of this bachelor thesis involves the specifics of working with children in the age of 1-3 with focus to mental, social and cognitive development of their personality. It also mentions general characteristics of the Discovery Island Program. Third, it talks about methods used in toddlers' development in this program. The practical part shows the strengths and weaknesses of the Discovery Island Program from the point of view of both parents and instructors.
|
|
|
Active Learning with Neural Networks
Beneš, Štěpán ; Fajčík, Martin (referee) ; Hradiš, Michal (advisor)
The topic of this thesis is the combination of active learning strategies used in conjunction with deep convolutional networks in image recognition tasks. The goal is to observe the behaviour of selected active learning strategies in a wider array of conditions. The first section of the thesis is dedicated to the theory of active learning, followed by the motivation and challenges of combining them with convolutional neural networks. The goal of this thesis is achieved by a series of experiments, in which the behaviour of active learning strategies is tested for dependencies on the difficulty of the dataset, quality of the learning model, number of training epochs, the size of a batch of samples added in each iteration, the oracle's consistency and the usage of pseudo-labeling technique. The results show the dependency of continuous active learning on the number of training epochs in each iteration and the difficulty of a given dataset. Chosen strategies also seem somewhat resistant to the oracle's faults. The benefits of using pseudo-labeling come hand in hand with the quality of the learning model. Finally, traditional active learning strategies have shown in some cases that they are capable of keeping the pace with modern, tailored strategies.
|
guest ::
