|
|
Neuroevolution Principles and Applications
Herec, Jan ; Strnadel, Josef (referee) ; Bidlo, Michal (advisor)
The theoretical part of this work deals with evolutionary algorithms (EA), neural networks (NN) and their synthesis in the form of neuroevolution. From a practical point of view, the aim of the work is to show the application of neuroevolution on two different tasks. The first task is the evolutionary design of the convolutional neural network (CNN) architecture that would be able to classify handwritten digits (from the MNIST dataset) with a high accurancy. The second task is the evolutionary optimization of neurocontroller for a simulated Falcon 9 rocket landing. Both tasks are computationally demanding and therefore have been solved on a supercomputer. As a part of the first task, it was possible to design such architectures which, when properly trained, achieve an accuracy of 99.49%. It turned out that it is possible to automate the design of high-quality architectures with the use of neuroevolution. Within the second task, the neuro-controller weights have been optimized so that, for defined initial conditions, the model of the Falcon booster can successfully land. Neuroevolution succeeded in both tasks.
|
|
|
Maximizing Computational Power by Neuroevolution
Matzner, Filip ; Mráz, František (advisor) ; Pilát, Martin (referee)
Echo state networks represent a special type of recurrent neural networks. Recent papers stated that the echo state networks maximize their computational performance on the transition between order and chaos, the so-called edge of chaos. This work confirms this statement in a comprehensive set of experiments. Afterwards, the best performing echo state network is compared to a network evolved via neuroevolution. The evolved network outperforms the best echo state network, however, the evolution consumes significant computational resources. By combining the best of both worlds, the simplicity of echo state networks and the performance of evolved networks, a new model called locally connected echo state networks is proposed. The results of this thesis may have an impact on future designs of echo state networks and efficiency of their implementation. Furthermore, the findings may improve the understanding of biological brain tissue. 1
|
|
|
Neural Networks and Genetic Algorithm
Karásek, Štěpán ; Snášelová, Petra (referee) ; Zbořil, František (advisor)
This thesis deals with evolutionary and genetic algorithms and the possible ways of combining them. The theoretical part of the thesis describes genetic algorithms and neural networks. In addition, the possible combinations and existing algorithms are presented. The practical part of this thesis describes the implementation of the algorithm NEAT and the experiments performed. A combination with differential evolution is proposed and tested. Lastly, NEAT is compared to the algorithms backpropagation (for feed-forward neural networks) and backpropagation through time (for recurrent neural networks), which are used for learning neural networks. Comparison is aimed at learning speed, network response quality and their dependence on network size.
|
|
|
Nature inspired search algorithms and their applications
Neruda, Roman
Basic principles of evolutionary algorithms and genetic search of parameter spaces are described in this paper. We explain the approaches common for genetic algorithms, evolutionary strategies, evolutionary programming, genetic programming, swarm algorithms, and neuroevolution. Published in proceedings Analýza dat 2013. Statistické metody pro technologii a výzkum. Pardubice : TriloByte Statistical Software, 2013, p. 69-80. ISSN 1805-6903. Presented as invited talk at the conference Analýza dat 2013.
|
guest ::
