|
|
Evolutionary Algorithms for Neural Networks Learning
Vosol, David ; Rozman, Jaroslav (referee) ; Zbořil, František (advisor)
Main point of this thesis is to find and compare posibilities of cooperation between evolutionary algorithms and neural network learning and their comparison with classical learning technique called backpropagation. This comparison is demonstrated with deep feed-forward neural network which is used for classification tasks. The process of optimalization is via search of optimal values of weights and biases within neural network with fixed topology. We chose three evolutionary approaches. Genetic algorithm, differential evolution and particle swarm optimization algorithm. These three approaches are also compared between each other. The demonstrating program is implemented in Python3 programming language without usage of any third parties libraries focused on deep learning.
|
|
|
Evolutionary Algorithms in Convolutional Neural Network Design
Badáň, Filip ; Vašíček, Zdeněk (referee) ; Sekanina, Lukáš (advisor)
This work focuses on automatization of neural network design via the so-called neuroevolution, which employs evolutionary algorithms to construct artificial neural networks or optimise their parameters. The goal of the project is to design and implement an evolutionary algorithm which can be used in the process of designing and optimizing topologies of convolutional neural networks. The effectiveness of the proposed framework was experimentally evaluated on tasks of image classification on datasets MNIST and CIFAR10 and compared with relevant solutions. The results showed that neuroevolution has a potential to successfully find accurate and effective convolutional neural network architectures.
|
|
|
Deep Learning AI in Game Environments
Glós, Kristián ; Bobák, Petr (referee) ; Polášek, Tomáš (advisor)
This thesis is focused on analysing deep learning algorithms and their ability to complete given tasks implemented in game environments created via the Unity game engine. Secondary objective was to research and specify possible use-cases of deep learning during game development. The algorithms used fall into Reinforcement learning, Imitation learning and Neuroevolution, while Reinforcement learning was used throughout the whole game scene development cycle. Analysis and results were collected through training the networks in different game scene states and other factors.
|
|
|
Neuroevolution Principles and Applications
Herec, Jan ; Strnadel, Josef (referee) ; Bidlo, Michal (advisor)
The theoretical part of this work deals with evolutionary algorithms (EA), neural networks (NN) and their synthesis in the form of neuroevolution. From a practical point of view, the aim of the work is to show the application of neuroevolution on two different tasks. The first task is the evolutionary design of the convolutional neural network (CNN) architecture that would be able to classify handwritten digits (from the MNIST dataset) with a high accurancy. The second task is the evolutionary optimization of neurocontroller for a simulated Falcon 9 rocket landing. Both tasks are computationally demanding and therefore have been solved on a supercomputer. As a part of the first task, it was possible to design such architectures which, when properly trained, achieve an accuracy of 99.49%. It turned out that it is possible to automate the design of high-quality architectures with the use of neuroevolution. Within the second task, the neuro-controller weights have been optimized so that, for defined initial conditions, the model of the Falcon booster can successfully land. Neuroevolution succeeded in both tasks.
|
|
|
Evolutionary Design of Convolutional Neural Networks
Pristaš, Ján ; Mrázek, Vojtěch (referee) ; Sekanina, Lukáš (advisor)
The aim of this Master's thesis is to describe basic technics of evolutionary computing, convolutional neural networks (CNN), and automated design of neural networks using neuroevolution ( NAS - Neural Architecture Search ). NAS techniques are currently being researched more and more, as they speed up and simplify the lengthy and complicated process of designing artificial neural networks. These techniques are also able to search for unconventional architectures that would not be found by classic methods. The work also contains the design and implementation of software capable of automated development of convolutional neural networks using the open-source library TensorFlow. The program uses a multiobjective NSGA-II algorithm for designing accurate and compact CNNs.
|
|
|
Evolutionary Design of Convolutional Neural Networks
Piňos, Michal ; Vašíček, Zdeněk (referee) ; Sekanina, Lukáš (advisor)
The aim of this work is to design and implement a program for automated design of convolutional neural networks (CNN) with the use of evolutionary computing techniques. From a practical point of view, this approach reduces the requirements for the human factor in the design of CNN architectures, and thus eliminates the tedious and laborious process of manual design. This work utilizes a special form of genetic programming, called Cartesian genetic programming, which uses a graph representation for candidate solution encoding.This technique enables the user to parameterize the CNN search process and focus on architectures, that are interesting from the view of used computational units, accuracy or number of parameters. The proposed approach was tested on the standardized CIFAR-10dataset, which is often used by researchers to compare the performance of their CNNs. The performed experiments showed, that this approach has both research and practical potential and the implemented program opens up new possibilities in automated CNN design.
|
|
|
Neural Networks and Genetic Algorithm
Karásek, Štěpán ; Snášelová, Petra (referee) ; Zbořil, František (advisor)
This thesis deals with evolutionary and genetic algorithms and the possible ways of combining them. The theoretical part of the thesis describes genetic algorithms and neural networks. In addition, the possible combinations and existing algorithms are presented. The practical part of this thesis describes the implementation of the algorithm NEAT and the experiments performed. A combination with differential evolution is proposed and tested. Lastly, NEAT is compared to the algorithms backpropagation (for feed-forward neural networks) and backpropagation through time (for recurrent neural networks), which are used for learning neural networks. Comparison is aimed at learning speed, network response quality and their dependence on network size.
|
|
|
Prediktory přesnosti konvolučních neuronových sítí
Karásek, Daniel ; Mrázek, Vojtěch (referee) ; Piňos, Michal (advisor)
V posledním desetiletí došlo k obrovskému skoku v pokroku neuronových sítí, a to především díky možnosti učit větší sítě než kdy dřív. Pouhé zvětšování velikosti sítí ale není dostatečným prostředkem k jejich dalšímu zefektivnění. Z tohoto důvodu dochází ke komplexnějšímu výzkumu architektur sítí. Jeho velkou slabinou je potřeba natrénovat každou architekturu pro zjištění jejího výkonu na daném problému. To může v některých případech zabírat i dny. Alternativou k učení může být využití prediktoru přesnosti neuronové sítě. Tato práce se zabývá zhodnocením a reimplementací několika vybraných prediktorů určených pro klasifikační konvoluční sítě.
|
|
|
Visualizing Neuroevolution in Neural Network Learning
Bednář, Martin ; Janoušek, Vladimír (referee) ; Zbořil, František (advisor)
This thesis examines options for neural network learning achieved by means of neuroevolution, examines general functioning of neuroevolution, design and implementation of neuroevolution and marginally deals with design and implementation of feed-forward neural networks with fully connected layers. The goal of this thesis is to introduce program, that executes neuroevolutionary algorithm and separate graphic application, which encapsulates this program for easier use and for display of graphic output of the program visualizing problem-solving capabilities of neural networks created by neuroevolution. The end part of the thesis is devoted to experiments done on the created program.
|
|
|
Evolutionary Design of Convolutional Neural Networks
Pristaš, Ján ; Mrázek, Vojtěch (referee) ; Sekanina, Lukáš (advisor)
The aim of this Master's thesis is to describe basic technics of evolutionary computing, convolutional neural networks (CNN), and automated design of neural networks using neuroevolution ( NAS - Neural Architecture Search ). NAS techniques are currently being researched more and more, as they speed up and simplify the lengthy and complicated process of designing artificial neural networks. These techniques are also able to search for unconventional architectures that would not be found by classic methods. The work also contains the design and implementation of software capable of automated development of convolutional neural networks using the open-source library TensorFlow. The program uses a multiobjective NSGA-II algorithm for designing accurate and compact CNNs.
|
guest ::
