|
Optimization of control using reinforcement learning on the Robocode platform
Pastušek, Václav ; Myška, Vojtěch (referee) ; Burget, Radim (advisor)
This master's thesis focuses on optimizing the control of a tank robot in the Robocode environment using reinforcement learning. The complexity of this problem falls into the EXPSPACE class, presenting a challenge that cannot be underestimated. The theoretical part of the thesis meticulously examines the Robocode platform, concepts of reinforcement learning, and relevant algorithms, while the practical part focuses on optimizing the agent, implementing reinforcement learning algorithms, and creating a user-friendly interface for easy training and testing of models. A total of 64 models were trained and tested as part of the thesis, with their data and parameters compared and presented in accompanying databases and graphs. The best results in terms of average hits per episode were achieved by models labeled v0.8.0 and v1.0.0. The first model exhibited a certain ability to evade shots, while the second model showed more successful hits.
|
|
One-trial association task as a basic biological model of episodic memory in rats
Radostová, Dominika ; Stuchlík, Aleš (advisor) ; Horáček, Jiří (referee) ; Telenský, Petr (referee)
One-trial association task as a basic biological model of episodic memory in rats Abstract A very important structure in the animal and human brain is the hippocampus. The study one of its many functions, episodic memory, is facing with the limited possibilities of non-invasive methods. In this regard, animal models are helpful. In order to study the individual components of such a complex ability in detail, a new behavioral task testing the association of temporally close but separate stimuli was developed. The test animals were exposed to a sequence of a sound conditioned stimulus and an unconditioned electric shock, between which there was a delay of 2 seconds. 59% of the rats successfully learned the association as well as the correct escape reaction to solve the task. Based on the results, the so-called One-Trial Trace Escape Reaction task could be a very valuable tool for a more detailed understanding of animals' incidental one-trial learning important for episodic memory. Another important phenomenon investigated in this work is the development of new neurons in the hippocampus in adulthood and its influence on learning and flexibility. After blocking the animals' neurogenesis with the temozolomide, the animals' ability to learn to avoid an invisible sector in the active avoidance task was tested....
|
|
Ontogeny of neural mechanisms of episodic memory
Šafová, Lucie ; Nekovářová, Tereza (advisor) ; Blahna, Karel (referee)
Two brain structures in particular - the hippocampus and the prefrontal cortex (PFC) - are essential for episodic memory, the ability to recall personal experiences with details of time, place, and event. It is their developmental changes that contribute significantly to the progressive development of episodic memory. The hippocampus is a complex structure composed of several subregions that is crucial to the function of the neural basis of episodic memory. Findings show that both neuronal changes within the hippocampus and changes in its volume and the volume of hippocampal subfields influence episodic memory. As in the hippocampus, changes in the prefrontal cortex also affect episodic memory, with the PFC being among the last regions to fully mature and affecting the accuracy of recalling contextual details of episodic memories. The transfer of information between brain regions is also crucial for episodic memories, and is provided by white matter connections (fornix, cingulum, uncinate fasciculus). This thesis summarizes the knowledge about the structures and mechanisms involved in the development of episodic memory and mentions the factors that influence its development. Keywords: episodic memory, ontogeny, hippocampus, prefrontal cortex, synaptic plasticity
|
|
Factors of cognitive superaging - a systematic review
Thompsonová, Eliška ; Daďová, Klára (advisor) ; Šteffl, Michal (referee)
Title: Lifestyle Factors and Successful Ageing: A Systematic Review on the SuperAger Phenomenon Background: As the world's population continues to age, the importance of studying the elders becomes more relevant. Age is one of the most prominent risk factors for diseases and understanding how to overcome or prevent the onset of any of them should be the goal for us as health promoting professionals. One of the straight-forward preventive measures is lifestyle. Objectives: The aim of this thesis was to assemble lifestyle factors that potentially contribute to the successful ageing of SuperAgers. Methods: A total of 6 databases were systematically reviewed using keywords established to help answer the review question. 654 studies were identified through the primary search and 10 studies were identified by hand search. After removing the duplicates, another 590 studies were excluded and 20 studies were selected for further eligibility. These studies were assessed using the Newcastle Ottawa Scale. Results: The number of studies finally retrieved from the systematic search was 20. Physical activity was identified as the most likely lifestyle factor to be positively associated with SuperAgeing. Social engagement, diet and adherence to cognitive activities were also found to be influential, as opposed to...
|
| |
|
Generating life episodes for the purpose of testing of episodic memory models
Běhan, Zdeněk ; Kadlec, Rudolf (advisor) ; Bída, Michal (referee)
The goal of this work is to create a generator that provides a corpora of input episodes in the specified format, which can be used as an input to test episodic memory models. More specifically, the methods used should ensure the scope to be in years up to a possible lifetime of a typical human agent. It also attempts to verify this on an actual episodic memory model, and test if the generated data has high enough quality to be used for testing psychological paradigms on memory models.
|
|
Ontogenesis of episodic memory in preschool children
Píšová, Martina ; Nekovářová, Tereza (advisor) ; Petrásek, Tomáš (referee)
Episodic memory enables us to remember and recall life events from the past. Episodic memory is a specific type of long-term declarative memory, which undergoes changes in ontogeny. To examinate of episodic memory, "episodic-like memory model", was developed. This model focuses on three basic components of episodic memory: "What happened", "Where did it happen" and "When did it happen". The aim of this diploma thesis is to develop and to validate of particular tests of episodic memory with consideration for their feasibility for preschool children. In order to study episodic memory we used an "episodic-like memory model" and experiments which focused on: children's verbal ability, differentiation of two perspectives during remembering of events and timing memories on an autobiographical axis. We aimed to inspect the effect of age on performance in these tests, possible links between performance in these experiments and the effect of level and the three components of episodic memory on number of errors made. In our dataset we found a significant effect of the age of children in Sentence repetition test and in test of Object collection in the virtual house, in the same test we found a effect of the level on number of errors. We also found a significant correlation between correct responses in verbal...
|
| |
|
Episodická pamäť virtuálnych agentov: Klamné spomienky
Čermák, Michal ; Brom, Cyril (advisor) ; Pešková, Klára (referee)
The goal of this work is to design a model of episodic memory for virtual agents capable of creating false memories and implement its prototype. The model architecture is inspired by present day knowledge about human episodic memory. Core structures in our model are the chronobags storing details of experienced episodes, and the schemabag storing the general scripts for all experienced events. The episodes are stored in the form of AND-OR trees and it is possible to derive missing details from the stored scripts during recall. We followed the work of Burkert and implemented a prototype of designed memory model in Java using the Pogamut 3 Framework. The model is parameterizable and it is evaluated in several experiments. In these experiments we looked on the trends in correct and incorrect recalls over time and we simulated the experiment demonstrating existence of room schemata. We compared the results produced by our model with the data from psychological researches and we showed that our model can produce false memories similar to false memories recollected by humans.
|
|
Ontogenesis of episodic memory in preschool children
Píšová, Martina ; Nekovářová, Tereza (advisor) ; Petrásek, Tomáš (referee)
Episodic memory enables us to remember and recall life events from the past. Episodic memory is a specific type of long-term declarative memory, which undergoes changes in ontogeny. To examinate of episodic memory, "episodic-like memory model", was developed. This model focuses on three basic components of episodic memory: "What happened", "Where did it happen" and "When did it happen". The aim of this diploma thesis is to develop and to validate of particular tests of episodic memory with consideration for their feasibility for preschool children. In order to study episodic memory we used an "episodic-like memory model" and experiments which focused on: children's verbal ability, differentiation of two perspectives during remembering of events and timing memories on an autobiographical axis. We aimed to inspect the effect of age on performance in these tests, possible links between performance in these experiments and the effect of level and the three components of episodic memory on number of errors made. In our dataset we found a significant effect of the age of children in Sentence repetition test and in test of Object collection in the virtual house, in the same test we found a effect of the level on number of errors. We also found a significant correlation between correct responses in verbal...
|