Edwin Lughofer, Ramin Nikzad-Langerodi,
"Robust Generalized Fuzzy Systems Training from High-Dimensional Time-Series Data using Local Structure Preserving PLS"
, in IEEE Transaction on Fuzzy Systems, IEEE Press, 2019
Robust Generalized Fuzzy Systems Training from High-Dimensional Time-Series Data using Local Structure Preserving PLS
Sprache des Titels:
Establishing fuzzy models from time-series data with predictive capabilities for numerical targets typically requires dimension reduction techniques to overcome red the severe curse of dimensionality effects. Linear projections do not reveal the inherent (non-linear, local) cluster structure of the data and are thus not ideally suited for the identification of fuzzy rule bases. To overcome this limitation, we here present a new fuzzy modeling approach that combines generalized fuzzy systems modeling with a local structure preserving variant of partial least squares (PLS). In contrast to ordinary PLS, our approach maps a weighted (adjacency) graph on the directions associated with high co-variance with the response in order to emphasizes local data structures when constructing the latent variable (LV) space. This operates into the direction from which the (training of the) fuzzy model benefits, as therein local regions are represented by sub-models in form of generalized TS fuzzy rules. The local structure preserving LV space is obtained by solving a new penalized objective function, which assures $global\ optimality$ of the solutions by virtue of the specific properties of the Laplacian matrix. Local regions are characterized in two ways, i.) through nearest neighbor points (assuming fixed local region sizes) and ii.) through density regions identified by clustering (achieving variable local region sizes). To establish a robust time-series based forecast model, the training of a generalized TS fuzzy model is conducted in the LV space with reduced dimensionality. It is realized by an iterative robust version of Gen-Smart-EFS. Consequent parameters are estimated by a fuzzily weighted elastic net approach, embedding a convex combination of ridge regression and Lasso to achieve robust solutions also in case of ill-posed problems. The new approach is termed as LS-PLS-Fuzzy.