|
|
Meta-Learning in the Area of Data Mining
Kučera, Petr ; Hlosta, Martin (referee) ; Bartík, Vladimír (advisor)
This paper describes the use of meta-learning in the area of data mining. It describes the problems and tasks of data mining where meta-learning can be applied, with a focus on classification. It provides an overview of meta-learning techniques and their possible application in data mining, especially model selection. It describes design and implementation of meta-learning system to support classification tasks in data mining. The system uses statistics and information theory to characterize data sets stored in the meta-knowledge base. The meta-classifier is created from the base and predicts the most suitable model for the new data set. The conclusion discusses results of the experiments with more than 20 data sets representing clasification tasks from different areas and suggests possible extensions of the project.
|
|
|
Evolutionary Algorithms for Multiobjective Optimization
Pilát, Martin ; Neruda, Roman (advisor) ; Schoenauer, Marc (referee) ; Pošík, Petr (referee)
Multi-objective evolutionary algorithms have gained a lot of atten- tion in the recent years. They have proven to be among the best multi-objective optimizers and have been used in many industrial ap- plications. However, their usability is hindered by the large number of evaluations of the objective functions they require. These can be expensive when solving practical tasks. In order to reduce the num- ber of objective function evaluations, surrogate models can be used. These are a simple and fast approximations of the real objectives. In this work we present the results of research made between the years 2009 and 2013. We present a multi-objective evolutionary algo- rithm with aggregate surrogate model, its newer version, which also uses a surrogate model for the pre-selection of individuals. In the next part we discuss the problem of selection of a particular type of model. We show which characteristics of the various models are im- portant and desirable and provide a framework which combines sur- rogate modeling with meta-learning. Finally, in the last part, we ap- ply multi-objective optimization to the problem of hyper-parameters tuning. We show that additional objectives can make finding of good parameters for classifiers faster. 1
|
|
|
Sparse restricted perception equilibrium
Audzei, Volha ; Slobodyan, Sergey
In this paper we study model selection under bounded rationality and the impact of monetary policy on the equilibrium choice of forecasting models. We use the concept of sparse rationality (developed recently by Gabaix, 2014), where paying attention to all possible variables is costly and agents can choose to over- or under-emphasize particular variables, even fully excluding some of them. Our main question is whether an initially mis-specified equilibrium (the restricted perceptions equilibrium, or RPE) is compatible with the equilibrium choice of sparse weights describing the allocation of attention to different variables by the agents inhabiting this RPE. In a simple New Keynesian model, we find that the agents stick to their initial mis-specified AR(1) forecasting model choice when monetary policy is less aggressive or inflation is more persistent. We also identify a region in the parameter space where the agents find it advantageous to pay attention to no variable at all.
Fulltext:  PDF
|
|
| |
|
|
Evolutionary Algorithms for Multiobjective Optimization
Pilát, Martin ; Neruda, Roman (advisor) ; Schoenauer, Marc (referee) ; Pošík, Petr (referee)
Multi-objective evolutionary algorithms have gained a lot of atten- tion in the recent years. They have proven to be among the best multi-objective optimizers and have been used in many industrial ap- plications. However, their usability is hindered by the large number of evaluations of the objective functions they require. These can be expensive when solving practical tasks. In order to reduce the num- ber of objective function evaluations, surrogate models can be used. These are a simple and fast approximations of the real objectives. In this work we present the results of research made between the years 2009 and 2013. We present a multi-objective evolutionary algo- rithm with aggregate surrogate model, its newer version, which also uses a surrogate model for the pre-selection of individuals. In the next part we discuss the problem of selection of a particular type of model. We show which characteristics of the various models are im- portant and desirable and provide a framework which combines sur- rogate modeling with meta-learning. Finally, in the last part, we ap- ply multi-objective optimization to the problem of hyper-parameters tuning. We show that additional objectives can make finding of good parameters for classifiers faster. 1
|
|
|
Meta-Learning in the Area of Data Mining
Kučera, Petr ; Hlosta, Martin (referee) ; Bartík, Vladimír (advisor)
This paper describes the use of meta-learning in the area of data mining. It describes the problems and tasks of data mining where meta-learning can be applied, with a focus on classification. It provides an overview of meta-learning techniques and their possible application in data mining, especially model selection. It describes design and implementation of meta-learning system to support classification tasks in data mining. The system uses statistics and information theory to characterize data sets stored in the meta-knowledge base. The meta-classifier is created from the base and predicts the most suitable model for the new data set. The conclusion discusses results of the experiments with more than 20 data sets representing clasification tasks from different areas and suggests possible extensions of the project.
|
|
|
Utilizing Bootstrap and Cross-validation for prediction error estimation in regression models
Lepša, Ondřej ; Bašta, Milan (advisor) ; Malá, Ivana (referee)
Finding a well-predicting model is one of the main goals of regression analysis. However, to evaluate a model's prediction abilities, it is a normal practice to use criteria which either do not serve this purpose, or criteria of insufficient reliability. As an alternative, there are relatively new methods which use repeated simulations for estimating an appropriate loss function -- prediction error. Cross-validation and bootstrap belong to this category. This thesis describes how to utilize these methods in order to select a regression model that best predicts new values of the response variable.
|
guest ::
