|
|
Using of Reinforcement Learning for Four Legged Robot Control
Ondroušek, Vít ; Maga,, Dušan (referee) ; Maňas, Pavel (referee) ; Singule, Vladislav (referee) ; Březina, Tomáš (advisor)
The Ph.D. thesis is focused on using the reinforcement learning for four legged robot control. The main aim is to create an adaptive control system of the walking robot, which will be able to plan the walking gait through Q-learning algorithm. This aim is achieved using the design of the complex three layered architecture, which is based on the DEDS paradigm. The small set of elementary reactive behaviors forms the basis of proposed solution. The set of composite control laws is designed using simultaneous activations of these behaviors. Both types of controllers are able to operate on the plain terrain as well as on the rugged one. The model of all possible behaviors, that can be achieved using activations of mentioned controllers, is designed using an appropriate discretization of the continuous state space. This model is used by the Q-learning algorithm for finding the optimal strategies of robot control. The capabilities of the control unit are shown on solving three complex tasks: rotation of the robot, walking of the robot in the straight line and the walking on the inclined plane. These tasks are solved using the spatial dynamic simulations of the four legged robot with three degrees of freedom on each leg. Resulting walking gaits are evaluated using the quantitative standardized indicators. The video files, which show acting of elementary and composite controllers as well as the resulting walking gaits of the robot, are integral part of this thesis.
|
|
|
Industrial TwinCAT based diagnostics application
Zigo, Ľubomír ; Ondroušek, Vít (referee) ; Krejsa, Jiří (advisor)
This bachelor´s thesis describes designing of diagnostics application for press controlled by Beckhoff TwinCAT. Application monitors press regularly and informs staff in case of breakdown. Diagnostics application is created in high-level programming language Visual C++ in Microsoft Visual Studio environment. Application communicates with TwinCAT via .NET Framework library TwinCAT::Ads, which is part of TwinCAT. Breakdown texts are read from database via Microsoft OLE DB interface using SQL.
|
|
|
Using ODE for Design of Dynamic Model of a Four-legged Robot
Seriš, Richard ; Krejsa, Jiří (referee) ; Ondroušek, Vít (advisor)
The objective of this bachelor‘s thesis is to design the dynamic model of four-legged robot Qasimodo by using ODE and programming languange Python, based on analysed parameters and known walking gait parameters. Forward dynamic walking gait task is used to comapare behavior of the model with the real robot Qasimodo. Strike a balance and review of ODE usability for this task. This thesis also reviews suitability and complexity of using ODE for dynamic simulation of the walking gaits of the robot.
|
|
|
Utilisations of the “Open Dynamics Engine” for modelling of mobile robots
Kovář, Jiří ; Ondroušek, Vít (referee) ; Houška, Pavel (advisor)
This diploma thesis deals with the problems of virtual physical modelling of mobile robots for the needs of their real-time control. To create a virtual physical world, an open-source project OPEN DYNAMICS ENGINE (ODE) was used, the results were displayed facilitating DirectX graphical interface. Simulated systems in ODE were written in C# on Microsoft.NET platform. The properites and qualities in ODE were verified by simulation in several types of simple systems and on a simplified robot model "Kracmera I.". Subsequently, the usability of ODE for its control was being verified.
|
|
|
Computations in Physics Using Graphic Card Procesor
Hlůšek, Bronislav ; Poliščuk, Radek (referee) ; Ondroušek, Vít (advisor)
This work deals with issue of general purpose computation on graphics processing units. It provides basic information about the graphics hardware. It also describes CUDA and CTM programming interface, that are intended specially for these calculations and features and alternative methods solving. There are as well mentioned possibilities their usage and several practical instances calculations.
|
|
|
Implementaion of the controllers of a mobile walking robot
Krajíček, Lukáš ; Věchet, Stanislav (referee) ; Ondroušek, Vít (advisor)
This diploma thesis deals with design and implementation of the controllers of a mobile walking robot. The advantage of these controllers are their kinematics and geometrics independent representation, which allow to use them for different robot types and tasks. In this thesis the contact controller is designed, which minimizes residual forces and torques at the robot's center of gravity, and thereby stabilize robot's body. Next the thesis deals with a posture controller, which maximizes a heuristic posture measure to optimize posture of robot body. Because of this optimization, legs are moved away from their limits and therefore they have more working space for next move. Implementation of the chosen solution is made on the robot's MATLAB mathematical model. Controllers are composed into a control basis, that allows to solve general control tasks by simultaneous combination of contained controllers. The algorithm was created for that simultaneous activation and its operation was explained on flow charts.
|
|
|
The Software for Experiments Control on Biomechanical Machine.
Hejč, Tomáš ; Březina, Tomáš (referee) ; Ondroušek, Vít (advisor)
The main aim of this masters thesis is the design and the realization of graphical user interface for constructionally-advanced prototype of biochemical device, which was realized in terms of the cooperation of ISMMB (Institute of Solid Mechanics, Mechatronics and Biomechanics) and IAI (Institute of Automation and Computer Science). The NI LabVIEW developing suite has been used as the main design tool of this software. This experimental device is used to investigate characteristics of spinal vertebra. The main aim of this thesis is to realize the control software, which is able to plan, initialize and record the long-term experiments on this device. This thesis is divided into theoretical and practical part. First part is focused on the description of the experimental device and sums all apointed requirements. This part also includes characterization of software tools, that has been used to realization in NI LabVIEW 8.6 development suite. The practical part deals with the design and successive realization of the developed application used for planning and controlling experiments, and also describes performed long-term tests. The solutions of a few fundamental problems, which were shown during these tests, are also included.
|
|
|
The Design and Realization of the Lowest Level Layer of the Control Unit for a Walking Robot
Olša, Petr ; Andrš, Ondřej (referee) ; Ondroušek, Vít (advisor)
This BA thesis is focused on the project and realization of the lowest layer of manipulation of the walking robot. The realization of the lowest layer contains: •installation of the coordinated systems •the solution of the inverse task of kinematics of the robot •creation of the simulative and communicative program •implementation of the inverse task of kinematics into the microcontroller •incorporation of serial communication between the PC and robot into the controlling system •realization of robot’s walking In the end, the ability of the controlling system to accomplish the orders in real time is tested.
|
|
|
Possibilities of implementation parallel task in programming languages
Zejda, Václav ; Ondroušek, Vít (referee) ; Houška, Pavel (advisor)
This work deals with the problem of implementation of parallel tasks in various programming environments. First part of the work follows the basics of parallelisation. It features especially when the parallelisation is suitable, what kinds of parallelisation are used and differences between architecture of various systems. Following parts describes various techniques in developing applications with the parallelisation support. From parallelisation support for common programming languages to graphics development tools and to environments that uses graphic processing unit (GPU) in combination with central processing unit (CPU).
|
|
|
The Study of Controllers for Four-legged Walking Robots
Klvaňa, Roman ; Věchet, Stanislav (referee) ; Ondroušek, Vít (advisor)
This work is based on literary search and is focused on description of various approaches in walking gait generation for four-legged walking robots. There are six various groups of aprroaches described in this thesis. Main functional principles as well as one representative robot of each approach is described. The summarize of advantages and disadvanteges of each approach is used to apoint an appropriate control approach for robot Quasimodo walking gait generation in the conclusion chapter of this bachleor thesis.
|
guest ::
