Sample records for supervised support vector

  1. Quintic spline smooth semi-supervised support vector classification machine

    Xiaodan Zhang; Jinggai Ma; Aihua Li; Ang Li


    A semi-supervised vector machine is a relatively new learning method using both labeled and unlabeled data in classifi-cation. Since the objective function of the model for an unstrained semi-supervised vector machine is not smooth, many fast opti-mization algorithms cannot be applied to solve the model. In order to overcome the difficulty of dealing with non-smooth objective functions, new methods that can solve the semi-supervised vector machine with desired classification accuracy are in great demand. A quintic spline function with three-times differentiability at the ori-gin is constructed by a general three-moment method, which can be used to approximate the symmetric hinge loss function. The approximate accuracy of the quintic spline function is estimated. Moreover, a quintic spline smooth semi-support vector machine is obtained and the convergence accuracy of the smooth model to the non-smooth one is analyzed. Three experiments are performed to test the efficiency of the model. The experimental results show that the new model outperforms other smooth models, in terms of classification performance. Furthermore, the new model is not sensitive to the increasing number of the labeled samples, which means that the new model is more efficient.

  2. Semi-supervised least squares support vector machine algorithm: application to offshore oil reservoir

    Luo, Wei-Ping; Li, Hong-Qi; Shi, Ning


    At the early stages of deep-water oil exploration and development, fewer and further apart wells are drilled than in onshore oilfields. Supervised least squares support vector machine algorithms are used to predict the reservoir parameters but the prediction accuracy is low. We combined the least squares support vector machine (LSSVM) algorithm with semi-supervised learning and established a semi-supervised regression model, which we call the semi-supervised least squares support vector machine (SLSSVM) model. The iterative matrix inversion is also introduced to improve the training ability and training time of the model. We use the UCI data to test the generalization of a semi-supervised and a supervised LSSVM models. The test results suggest that the generalization performance of the LSSVM model greatly improves and with decreasing training samples the generalization performance is better. Moreover, for small-sample models, the SLSSVM method has higher precision than the semi-supervised K-nearest neighbor (SKNN) method. The new semisupervised LSSVM algorithm was used to predict the distribution of porosity and sandstone in the Jingzhou study area.

  3. TV-SVM: Total Variation Support Vector Machine for Semi-Supervised Data Classification

    Bresson, Xavier; Zhang, Ruiliang


    We introduce semi-supervised data classification algorithms based on total variation (TV), Reproducing Kernel Hilbert Space (RKHS), support vector machine (SVM), Cheeger cut, labeled and unlabeled data points. We design binary and multi-class semi-supervised classification algorithms. We compare the TV-based classification algorithms with the related Laplacian-based algorithms, and show that TV classification perform significantly better when the number of labeled data is small.

  4. Semi-Supervised and Unsupervised Novelty Detection using Nested Support Vector Machines

    de Morsier, Frank; Borgeaud, Maurice; Gass, Volker; Küchler, Christoph; Thiran, Jean-Philippe


    Very often in change detection only few labels or even none are available. In order to perform change detection in these extreme scenarios, they can be considered as novelty detection problems, semi-supervised (SSND) if some labels are available otherwise unsupervised (UND). SSND can be seen as an unbalanced classification between labeled and unlabeled samples using the Cost-Sensitive Support Vector Machine (CS-SVM). UND assumes novelties in low density regions and can be approached using th...

  5. Target Localization in Wireless Sensor Networks Using Online Semi-Supervised Support Vector Regression

    Jaehyun Yoo


    Full Text Available Machine learning has been successfully used for target localization in wireless sensor networks (WSNs due to its accurate and robust estimation against highly nonlinear and noisy sensor measurement. For efficient and adaptive learning, this paper introduces online semi-supervised support vector regression (OSS-SVR. The first advantage of the proposed algorithm is that, based on semi-supervised learning framework, it can reduce the requirement on the amount of the labeled training data, maintaining accurate estimation. Second, with an extension to online learning, the proposed OSS-SVR automatically tracks changes of the system to be learned, such as varied noise characteristics. We compare the proposed algorithm with semi-supervised manifold learning, an online Gaussian process and online semi-supervised colocalization. The algorithms are evaluated for estimating the unknown location of a mobile robot in a WSN. The experimental results show that the proposed algorithm is more accurate under the smaller amount of labeled training data and is robust to varying noise. Moreover, the suggested algorithm performs fast computation, maintaining the best localization performance in comparison with the other methods.

  6. A Novel Classification Algorithm Based on Incremental Semi-Supervised Support Vector Machine

    Gao, Fei; Mei, Jingyuan; Sun, Jinping; Wang, Jun; Yang, Erfu; Hussain, Amir


    For current computational intelligence techniques, a major challenge is how to learn new concepts in changing environment. Traditional learning schemes could not adequately address this problem due to a lack of dynamic data selection mechanism. In this paper, inspired by human learning process, a novel classification algorithm based on incremental semi-supervised support vector machine (SVM) is proposed. Through the analysis of prediction confidence of samples and data distribution in a changing environment, a “soft-start” approach, a data selection mechanism and a data cleaning mechanism are designed, which complete the construction of our incremental semi-supervised learning system. Noticeably, with the ingenious design procedure of our proposed algorithm, the computation complexity is reduced effectively. In addition, for the possible appearance of some new labeled samples in the learning process, a detailed analysis is also carried out. The results show that our algorithm does not rely on the model of sample distribution, has an extremely low rate of introducing wrong semi-labeled samples and can effectively make use of the unlabeled samples to enrich the knowledge system of classifier and improve the accuracy rate. Moreover, our method also has outstanding generalization performance and the ability to overcome the concept drift in a changing environment. PMID:26275294

  7. A Novel Classification Algorithm Based on Incremental Semi-Supervised Support Vector Machine.

    Fei Gao

    Full Text Available For current computational intelligence techniques, a major challenge is how to learn new concepts in changing environment. Traditional learning schemes could not adequately address this problem due to a lack of dynamic data selection mechanism. In this paper, inspired by human learning process, a novel classification algorithm based on incremental semi-supervised support vector machine (SVM is proposed. Through the analysis of prediction confidence of samples and data distribution in a changing environment, a "soft-start" approach, a data selection mechanism and a data cleaning mechanism are designed, which complete the construction of our incremental semi-supervised learning system. Noticeably, with the ingenious design procedure of our proposed algorithm, the computation complexity is reduced effectively. In addition, for the possible appearance of some new labeled samples in the learning process, a detailed analysis is also carried out. The results show that our algorithm does not rely on the model of sample distribution, has an extremely low rate of introducing wrong semi-labeled samples and can effectively make use of the unlabeled samples to enrich the knowledge system of classifier and improve the accuracy rate. Moreover, our method also has outstanding generalization performance and the ability to overcome the concept drift in a changing environment.

  8. A semi-supervised support vector machine approach for parameter setting in motor imagery-based brain computer interfaces

    Long, Jinyi; Yu, Zhuliang


    Parameter setting plays an important role for improving the performance of a brain computer interface (BCI). Currently, parameters (e.g. channels and frequency band) are often manually selected. It is time-consuming and not easy to obtain an optimal combination of parameters for a BCI. In this paper, motor imagery-based BCIs are considered, in which channels and frequency band are key parameters. First, a semi-supervised support vector machine algorithm is proposed for automatically selecting a set of channels with given frequency band. Next, this algorithm is extended for joint channel-frequency selection. In this approach, both training data with labels and test data without labels are used for training a classifier. Hence it can be used in small training data case. Finally, our algorithms are applied to a BCI competition data set. Our data analysis results show that these algorithms are effective for selection of frequency band and channels when the training data set is small. PMID:21886673

  9. Automated cell analysis tool for a genome-wide RNAi screen with support vector machine based supervised learning

    Remmele, Steffen; Ritzerfeld, Julia; Nickel, Walter; Hesser, Jürgen


    RNAi-based high-throughput microscopy screens have become an important tool in biological sciences in order to decrypt mostly unknown biological functions of human genes. However, manual analysis is impossible for such screens since the amount of image data sets can often be in the hundred thousands. Reliable automated tools are thus required to analyse the fluorescence microscopy image data sets usually containing two or more reaction channels. The herein presented image analysis tool is designed to analyse an RNAi screen investigating the intracellular trafficking and targeting of acylated Src kinases. In this specific screen, a data set consists of three reaction channels and the investigated cells can appear in different phenotypes. The main issue of the image processing task is an automatic cell segmentation which has to be robust and accurate for all different phenotypes and a successive phenotype classification. The cell segmentation is done in two steps by segmenting the cell nuclei first and then using a classifier-enhanced region growing on basis of the cell nuclei to segment the cells. The classification of the cells is realized by a support vector machine which has to be trained manually using supervised learning. Furthermore, the tool is brightness invariant allowing different staining quality and it provides a quality control that copes with typical defects during preparation and acquisition. A first version of the tool has already been successfully applied for an RNAi-screen containing three hundred thousand image data sets and the SVM extended version is designed for additional screens.

  10. Clustering Categories in Support Vector Machines

    Carrizosa, Emilio; Nogales-Gómez, Amaya; Morales, Dolores Romero


    The support vector machine (SVM) is a state-of-the-art method in supervised classification. In this paper the Cluster Support Vector Machine (CLSVM) methodology is proposed with the aim to increase the sparsity of the SVM classifier in the presence of categorical features, leading to a gain in in...

  11. Support vector machines applications

    Guo, Guodong


    Support vector machines (SVM) have both a solid mathematical background and good performance in practical applications. This book focuses on the recent advances and applications of the SVM in different areas, such as image processing, medical practice, computer vision, pattern recognition, machine learning, applied statistics, business intelligence, and artificial intelligence. The aim of this book is to create a comprehensive source on support vector machine applications, especially some recent advances.

  12. Boosting Support Vector Machines

    Elkin Eduardo García Díaz


    Full Text Available En este artículo, se presenta un algoritmo de clasificación binaria basado en Support Vector Machines (Máquinas de Vectores de Soporte que combinado apropiadamente con técnicas de Boosting consigue un mejor desempeño en cuanto a tiempo de entrenamiento y conserva características similares de generalización con un modelo de igual complejidad pero de representación más compacta./ In this paper we present an algorithm of binary classification based on Support Vector Machines. It is combined with a modified Boosting algorithm. It run faster than the original SVM algorithm with a similar generalization error and equal complexity model but it has more compact representation.

  13. Support Vector Components Analysis

    van der Ree, Michiel; Roerdink, Johannes; Phillips, Christophe; Garraux, Gaetan; Salmon, Eric; Wiering, Marco


    In this paper we propose a novel method for learning a distance metric in the process of training Support Vector Machines (SVMs) with the radial basis function kernel. A transformation matrix is adapted in such a way that the SVM dual objective of a classification problem is optimized. By using a wi

  14. Prototype Vector Machine for Large Scale Semi-Supervised Learning

    Zhang, Kai; Kwok, James T.; Parvin, Bahram


    Practicaldataminingrarelyfalls exactlyinto the supervisedlearning scenario. Rather, the growing amount of unlabeled data poses a big challenge to large-scale semi-supervised learning (SSL). We note that the computationalintensivenessofgraph-based SSLarises largely from the manifold or graph regularization, which in turn lead to large models that are dificult to handle. To alleviate this, we proposed the prototype vector machine (PVM), a highlyscalable,graph-based algorithm for large-scale SSL. Our key innovation is the use of"prototypes vectors" for effcient approximation on both the graph-based regularizer and model representation. The choice of prototypes are grounded upon two important criteria: they not only perform effective low-rank approximation of the kernel matrix, but also span a model suffering the minimum information loss compared with the complete model. We demonstrate encouraging performance and appealing scaling properties of the PVM on a number of machine learning benchmark data sets.

  15. The Neural Support Vector Machine

    Wiering, Marco; van der Ree, Michiel; Embrechts, Mark; Stollenga, Marijn; Meijster, Arnold; Nolte, A; Schomaker, Lambertus


    This paper describes a new machine learning algorithm for regression and dimensionality reduction tasks. The Neural Support Vector Machine (NSVM) is a hybrid learning algorithm consisting of neural networks and support vector machines (SVMs). The output of the NSVM is given by SVMs that take a

  16. The Neural Support Vector Machine

    Wiering, Marco; van der Ree, Michiel; Embrechts, Mark; Stollenga, Marijn; Meijster, Arnold; Nolte, A; Schomaker, Lambertus


    This paper describes a new machine learning algorithm for regression and dimensionality reduction tasks. The Neural Support Vector Machine (NSVM) is a hybrid learning algorithm consisting of neural networks and support vector machines (SVMs). The output of the NSVM is given by SVMs that take a centr

  17. Evaluating automatically parallelized versions of the support vector machine

    Codreanu, Valeriu; Droge, Bob; Williams, David; Yasar, Burhan; Yang, Fo; Liu, Baoquan; Dong, Feng; Surinta, Olarik; Schomaker, Lambertus; Roerdink, Jos; Wiering, Marco


    The support vector machine (SVM) is a supervised learning algorithm used for recognizing patterns in data. It is a very popular technique in machine learning and has been successfully used in applications such as image classification, protein classification, and handwriting recognition. However, the

  18. Learning with Support Vector Machines

    Campbell, Colin


    Support Vectors Machines have become a well established tool within machine learning. They work well in practice and have now been used across a wide range of applications from recognizing hand-written digits, to face identification, text categorisation, bioinformatics, and database marketing. In this book we give an introductory overview of this subject. We start with a simple Support Vector Machine for performing binary classification before considering multi-class classification and learning in the presence of noise. We show that this framework can be extended to many other scenarios such a

  19. Supporting Early Childhood Practitioners through Relationship-Based, Reflective Supervision

    Bernstein, Victor J.; Edwards, Renee C.


    Reflective supervision is a relationship-based practice that supports the professional development of early childhood practitioners. Reflective supervision helps practitioners cope with the intense feelings and stress that are generated when working with at-risk children and families. It allows them to focus on the purpose and goals of the program…

  20. Supernova Recognition using Support Vector Machines

    Romano, Raquel A.; Aragon, Cecilia R.; Ding, Chris


    We introduce a novel application of Support Vector Machines(SVMs) to the problem of identifying potential supernovae usingphotometric and geometric features computed from astronomical imagery.The challenges of this supervised learning application are significant:1) noisy and corrupt imagery resulting in high levels of featureuncertainty,2) features with heavy-tailed, peaked distributions,3)extremely imbalanced and overlapping positiveand negative data sets, and4) the need to reach high positive classification rates, i.e. to find allpotential supernovae, while reducing the burdensome workload of manuallyexamining false positives. High accuracy is achieved viaasign-preserving, shifted log transform applied to features with peaked,heavy-tailed distributions. The imbalanced data problem is handled byoversampling positive examples,selectively sampling misclassifiednegative examples,and iteratively training multiple SVMs for improvedsupernovarecognition on unseen test data. We present crossvalidationresults and demonstrate the impact on a largescale supernova survey thatcurrently uses the SVM decision value to rank-order 600,000 potentialsupernovae each night.

  1. Supporting Placement Supervision in Clinical Exercise Physiology

    Sealey, Rebecca M.; Raymond, Jacqueline; Groeller, Herb; Rooney, Kieron; Crabb, Meagan; Watt, Kerrianne


    The continued engagement of the professional workforce as supervisors is critical for the sustainability and growth of work-integrated learning activities in university degrees. This study investigated factors that influence the willingness and ability of clinicians to continue to supervise clinical exercise physiology work-integrated learning…


    STEINWART, INGO [Los Alamos National Laboratory; HUSH, DON [Los Alamos National Laboratory; SCOVEL, CLINT [Los Alamos National Laboratory; LIST, NICOLAS [Los Alamos National Laboratory


    We show that the stopping criteria used in many support vector machine (SVM) algorithms working on the dual can be interpreted as primal optimality bounds which in turn are known to be important for the statistical analysis of SVMs. To this end we revisit the duality theory underlying the derivation of the dual and show that in many interesting cases primal optimality bounds are the same as known dual optimality bounds.

  3. On Weighted Support Vector Regression

    Han, Xixuan; Clemmensen, Line Katrine Harder


    We propose a new type of weighted support vector regression (SVR), motivated by modeling local dependencies in time and space in prediction of house prices. The classic weights of the weighted SVR are added to the slack variables in the objective function (OF‐weights). This procedure directly...... the differences and similarities of the two types of weights by demonstrating the connection between the Least Absolute Shrinkage and Selection Operator (LASSO) and the SVR. We show that an SVR problem can be transformed to a LASSO problem plus a linear constraint and a box constraint. We demonstrate...

  4. Quantum support vector machine for big data classification.

    Rebentrost, Patrick; Mohseni, Masoud; Lloyd, Seth


    Supervised machine learning is the classification of new data based on already classified training examples. In this work, we show that the support vector machine, an optimized binary classifier, can be implemented on a quantum computer, with complexity logarithmic in the size of the vectors and the number of training examples. In cases where classical sampling algorithms require polynomial time, an exponential speedup is obtained. At the core of this quantum big data algorithm is a nonsparse matrix exponentiation technique for efficiently performing a matrix inversion of the training data inner-product (kernel) matrix.

  5. Differentially Private Support Vector Machines

    Sarwate, Anand; Monteleoni, Claire


    This paper addresses the problem of practical privacy-preserving machine learning: how to detect patterns in massive, real-world databases of sensitive personal information, while maintaining the privacy of individuals. Chaudhuri and Monteleoni (2008) recently provided privacy-preserving techniques for learning linear separators via regularized logistic regression. With the goal of handling large databases that may not be linearly separable, we provide privacy-preserving support vector machine algorithms. We address general challenges left open by past work, such as how to release a kernel classifier without releasing any of the training data, and how to tune algorithm parameters in a privacy-preserving manner. We provide general, efficient algorithms for linear and nonlinear kernel SVMs, which guarantee $\\epsilon$-differential privacy, a very strong privacy definition due to Dwork et al. (2006). We also provide learning generalization guarantees. Empirical evaluations reveal promising performance on real and...

  6. Virtual screening with support vector machines and structure kernels

    Mahé, Pierre


    Support vector machines and kernel methods have recently gained considerable attention in chemoinformatics. They offer generally good performance for problems of supervised classification or regression, and provide a flexible and computationally efficient framework to include relevant information and prior knowledge about the data and problems to be handled. In particular, with kernel methods molecules do not need to be represented and stored explicitly as vectors or fingerprints, but only to be compared to each other through a comparison function technically called a kernel. While classical kernels can be used to compare vector or fingerprint representations of molecules, completely new kernels were developed in the recent years to directly compare the 2D or 3D structures of molecules, without the need for an explicit vectorization step through the extraction of molecular descriptors. While still in their infancy, these approaches have already demonstrated their relevance on several toxicity prediction and s...

  7. Recursive support vector machines for dimensionality reduction.

    Tao, Qing; Chu, Dejun; Wang, Jue


    The usual dimensionality reduction technique in supervised learning is mainly based on linear discriminant analysis (LDA), but it suffers from singularity or undersampled problems. On the other hand, a regular support vector machine (SVM) separates the data only in terms of one single direction of maximum margin, and the classification accuracy may be not good enough. In this letter, a recursive SVM (RSVM) is presented, in which several orthogonal directions that best separate the data with the maximum margin are obtained. Theoretical analysis shows that a completely orthogonal basis can be derived in feature subspace spanned by the training samples and the margin is decreasing along the recursive components in linearly separable cases. As a result, a new dimensionality reduction technique based on multilevel maximum margin components and then a classifier with high accuracy are achieved. Experiments in synthetic and several real data sets show that RSVM using multilevel maximum margin features can do efficient dimensionality reduction and outperform regular SVM in binary classification problems.

  8. A New Incremental Support Vector Machine Algorithm

    Wenjuan Zhao


    Full Text Available Support vector machine is a popular method in machine learning. Incremental support vector machine algorithm is ideal selection in the face of large learning data set. In this paper a new incremental support vector machine learning algorithm is proposed to improve efficiency of large scale data processing. The model of this incremental learning algorithm is similar to the standard support vector machine. The goal concept is updated by incremental learning. Each training procedure only includes new training data. The time complexity is independent of whole training set. Compared with the other incremental version, the training speed of this approach is improved and the change of hyperplane is reduced.

  9. Image Reconstruction Using Pixel Wise Support Vector Machine SVM Classification.

    Mohammad Mahmudul Alam Mia


    Full Text Available Abstract Image reconstruction using support vector machine SVM has been one of the major parts of image processing. The exactness of a supervised image classification is a function of the training data used in its generation. In this paper we studied support vector machine for classification aspects and reconstructed an image using support vector machine. Firstly value of the random pixels is used as the SVM classifier. Then the SVM classifier is trained by using those values of the random pixels. Finally the image is reconstructed after cross-validation with the trained SVM classifier. Matlab result shows that training with support vector machine produce better results and great computational efficiency with only a few minutes of runtime is necessary for training. Support vector machine have high classification accuracy and much faster convergence. Overall classification accuracy is 99.5. From our experiment It can be seen that classification accuracy mostly depends on the choice of the kernel function and best estimation of parameters for kernel is critical for a given image.

  10. Deep Support Vector Machines for Regression Problems

    Wiering, Marco; Schutten, Marten; Millea, Adrian; Meijster, Arnold; Schomaker, Lambertus


    In this paper we describe a novel extension of the support vector machine, called the deep support vector machine (DSVM). The original SVM has a single layer with kernel functions and is therefore a shallow model. The DSVM can use an arbitrary number of layers, in which lower-level layers contain su

  11. Deep Support Vector Machines for Regression Problems

    Wiering, Marco; Schutten, Marten; Millea, Adrian; Meijster, Arnold; Schomaker, Lambertus


    In this paper we describe a novel extension of the support vector machine, called the deep support vector machine (DSVM). The original SVM has a single layer with kernel functions and is therefore a shallow model. The DSVM can use an arbitrary number of layers, in which lower-level layers contain

  12. Cascade Support Vector Machines with Dimensionality Reduction

    Oliver Kramer


    Full Text Available Cascade support vector machines have been introduced as extension of classic support vector machines that allow a fast training on large data sets. In this work, we combine cascade support vector machines with dimensionality reduction based preprocessing. The cascade principle allows fast learning based on the division of the training set into subsets and the union of cascade learning results based on support vectors in each cascade level. The combination with dimensionality reduction as preprocessing results in a significant speedup, often without loss of classifier accuracies, while considering the high-dimensional pendants of the low-dimensional support vectors in each new cascade level. We analyze and compare various instantiations of dimensionality reduction preprocessing and cascade SVMs with principal component analysis, locally linear embedding, and isometric mapping. The experimental analysis on various artificial and real-world benchmark problems includes various cascade specific parameters like intermediate training set sizes and dimensionalities.

  13. Emotional Literacy Support Assistants' Views on Supervision Provided by Educational Psychologists: What EPs Can Learn from Group Supervision

    Osborne, Cara; Burton, Sheila


    The Educational Psychology Service in this study has responsibility for providing group supervision to Emotional Literacy Support Assistants (ELSAs) working in schools. To date, little research has examined this type of inter-professional supervision arrangement. The current study used a questionnaire to examine ELSAs' views on the supervision…

  14. Robust Pseudo-Hierarchical Support Vector Clustering

    Hansen, Michael Sass; Sjöstrand, Karl; Olafsdóttir, Hildur


    Support vector clustering (SVC) has proven an efficient algorithm for clustering of noisy and high-dimensional data sets, with applications within many fields of research. An inherent problem, however, has been setting the parameters of the SVC algorithm. Using the recent emergence of a method...... for calculating the entire regularization path of the support vector domain description, we propose a fast method for robust pseudo-hierarchical support vector clustering (HSVC). The method is demonstrated to work well on generated data, as well as for detecting ischemic segments from multidimensional myocardial...


    Zhang Xinfeng; Shen Lansun


    The hypersphere support vector machine is a new algorithm in pattern recognition. By studying three kinds ofhypersphere support vector machines, it is found that their solutions are identical and the margin between two classes of samples is zero or is not unique. In this letter, a new kind ofhypersphere support vector machine is proposed. By introducing a parameter n(n>l), a unique solution of the margin can be obtained.Theoretical analysis and experimental results show that the proposed algorithm can achieve better generalization performance.

  16. New approach to training support vector machine

    Tang Faming; Chen Mianyun; Wang Zhongdong


    Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very large quadratic programming problem. Traditional optimization methods cannot be directly applied due to memory restrictions. Up to now, several approaches exist for circumventing the above shortcomings and work well. Another learning algorithm, particle swarm optimization, for training SVM is introduted. The method is tested on UCI datasets.

  17. Support vector machine applied in QSAR modelling

    MEI Hu; ZHOU Yuan; LIANG Guizhao; LI Zhiliang


    Support vector machine (SVM), partial least squares (PLS), and Back-Propagation artificial neural network (ANN) were employed to establish QSAR models of 2 dipeptide datasets. In order to validate predictive capabilities on external dataset of the resulting models, both internal and external validations were performed. The division of dataset into both training and test sets was carried out by D-optimal design. The results showed that support vector machine (SVM) behaved well in both calibration and prediction. For the dataset of 48 bitter tasting dipeptides (BTD), the results obtained by support vector regression (SVR) were superior to that by PLS in both calibration and prediction. When compared with BP artificial neural network, SVR showed less calibration power but more predictive capability. For the dataset of angiotensin-converting enzyme (ACE) inhibitors, the results obtained by support vector machine (SVM) regression were equivalent to those by PLS and BP artificial neural network. In both datasets, SVR using linear kernel function behaved well as that using radial basis kernel function. The results showed that there is wide prospect for the application of support vector machine (SVM) into QSAR modeling.

  18. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods

    Zhang, Tong


    This book is an introduction to support vector machines and related kernel methods in supervised learning, whose task is to estimate an input-output functional relationship from a training set of examples. A learning problem is referred to as classification if its output take discrete values in a set of possible categories and regression if it has continuous real-valued output.

  19. Masquerade Detection Using Support Vector Machine

    YANG Min; WANG Li-na; ZHANG Huan-guo; CHEN Wei


    A new method using support vector data description (SVDD) to distinguish legitimate users from masqueraders based on UNIX user command sequences is proposed. Sliding windows are used to get low detection delay.Experiments demonstrate that the detection effect using en riched sequences is better than that of using truncated sequences. As a SVDD profile is composed of a small amount of support vectors, our SVDD-based method can achieve computation and storage advantage when the detection performance is similar to existing method.

  20. An Improved Support Vector Machines: NNSVM

    LIHonglian; WANGChunhua; YUANBaozong


    In this paper we propose an improved support vector machine: NNSVM. It first prunes the training set, reserves or deletes a sample according to whether its nearest neighbor has same class label with itself or not,then trains the new set with standard SVM to obtain a classifier. Experimental results show that NNSVM is better than SVM in speed and accuracy of classiflcation.

  1. Weighted Twin Support Vector Machine with Universum

    Shuxia Lu

    Full Text Available Universum is a new concept proposed recently, which is defined to be the sample that does not belong to any classes concerned. Support Vector Machine with Universum (..-SVM is a new algorithm, which can exploit Universum samples to improve the classifica ...

  2. Efficient Multiplicative Updates for Support Vector Machines

    Potluru, Vamsi K.; Plis, Sergie N; Mørup, Morten


    The dual formulation of the support vector machine (SVM) objective function is an instance of a nonnegative quadratic programming problem. We reformulate the SVM objective function as a matrix factorization problem which establishes a connection with the regularized nonnegative matrix factorization...

  3. Efficient Multiplicative Updates for Support Vector Machines

    Potluru, Vamsi K.; Plis, Sergie N; Mørup, Morten


    The dual formulation of the support vector machine (SVM) objective function is an instance of a nonnegative quadratic programming problem. We reformulate the SVM objective function as a matrix factorization problem which establishes a connection with the regularized nonnegative matrix factorization...

  4. Sensitivity of Support Vector Machine Classification to Various Training Features

    Fuling Bian


    Full Text Available Remote sensing image classification is one of the most important techniques in image interpretation, which can be used for environmental monitoring, evaluation and prediction. Many algorithms have been developed for image classification in the literature. Support vector machine (SVM is a kind of supervised classification that has been widely used recently. The classification accuracy produced by SVM may show variation depending on the choice of training features. In this paper, SVM was used for land cover classification using Quickbird images. Spectral and textural features were extracted for the classification and the results were analyzed thoroughly. Results showed that the number of features employed in SVM was not the more the better. Different features are suitable for different type of land cover extraction. This study verifies the effectiveness and robustness of SVM in the classification of high spatial resolution remote sensing images.    

  5. Online support vector regression for reinforcement learning

    Yu Zhenhua; Cai Yuanli


    The goal in reinforcement learning is to learn the value of state-action pair in order to maximize the total reward. For continuous states and actions in the real world, the representation of value functions is critical. Furthermore, the samples in value functions are sequentially obtained. Therefore, an online support vector regression (OSVR) is set up, which is a function approximator to estimate value functions in reinforcement learning. OSVR updates the regression function by analyzing the possible variation of support vector sets after new samples are inserted to the training set. To evaluate the OSVR learning ability, it is applied to the mountain-car task. The simulation results indicate that the OSVR has a preferable convergence speed and can solve continuous problems that are infeasible using lookup table.

  6. Support vector machine for automatic pain recognition

    Monwar, Md Maruf; Rezaei, Siamak


    Facial expressions are a key index of emotion and the interpretation of such expressions of emotion is critical to everyday social functioning. In this paper, we present an efficient video analysis technique for recognition of a specific expression, pain, from human faces. We employ an automatic face detector which detects face from the stored video frame using skin color modeling technique. For pain recognition, location and shape features of the detected faces are computed. These features are then used as inputs to a support vector machine (SVM) for classification. We compare the results with neural network based and eigenimage based automatic pain recognition systems. The experiment results indicate that using support vector machine as classifier can certainly improve the performance of automatic pain recognition system.

  7. Computerized Interactive Gaming via Supporting Vector Machines

    Jiang, Yang; Jiang, Jianmin; Palmer, Ian


    Computerized interactive gaming requires automatic processing of large volume of random data produced by players on spot, such as shooting, football kicking, and boxing. This paper describes a supporting vector machine-based artificial intelligence algorithm as one of the possible solutions to the problem of random data processing and the provision of interactive indication for further actions. In comparison with existing techniques, such as rule-based and neural networks, and so forth, our S...

  8. Image Segmentation Based on Support Vector Machine

    XU Hai-xiang; ZHU Guang-xi; TIAN Jin-wen; ZHANG Xiang; PENG Fu-yuan


    Image segmentation is a necessary step in image analysis. Support vector machine (SVM) approach is proposed to segment images and its segmentation performance is evaluated.Experimental results show that: the effects of kernel function and model parameters on the segmentation performance are significant; SVM approach is less sensitive to noise in image segmentation; The segmentation performance of SVM approach is better than that of back-propagation multi-layer perceptron (BP-MLP) approach and fuzzy c-means (FCM) approach.

  9. Supervising undergraduate research: a collective approach utilising groupwork and peer support.

    Baker, Mary-Jane; Cluett, Elizabeth; Ireland, Lorraine; Reading, Sheila; Rourke, Susan


    Nursing education now requires graduate entry for professional registration. The challenge is to ensure that students develop independence and team working in a resource effective manner. The dissertation is one opportunity for this. To evaluate changing from individual dissertation supervision to group peer supervision. Group supervision was implemented for one cohort. Dissertation outcomes were compared with two previous cohorts. Student evaluative data was assessed. Group supervision did not adversely affect dissertation outcomes (p=0.85). 88% of students reported peer supervision to be helpful, with themes being 'support and sharing', and 'progress and moving forward'. Peer group support provided consistent supervision harnessing the energy and resources of the students and Faculty, without adversely affecting outcomes. Copyright © 2013 Elsevier Ltd. All rights reserved.

  10. When Family-Supportive Supervision Matters: Relations between Multiple Sources of Support and Work-Family Balance

    Greenhaus, Jeffrey H.; Ziegert, Jonathan C.; Allen, Tammy D.


    This study examines the mechanisms by which family-supportive supervision is related to employee work-family balance. Based on a sample of 170 business professionals, we found that the positive relation between family-supportive supervision and balance was fully mediated by work interference with family (WIF) and partially mediated by family…

  11. Support Vector Machine%支持向量机

    张浩然; 韩正之; 李昌刚


    This paper gives a introduction of the basic ideas, basic theory, key techniques, and application of the sup-port vector machine (SVM), and indicates the similarities and differences between support vector machines and neuralnetworks.


    Olga V. Kitova


    Full Text Available Possibilities of applying intelligent machine learning technique based on support vectors for predicting investment measures are considered in the article. The base features of support vector method over traditional econometric techniques for improving the forecast quality are described. Computer modeling results in terms of tuning support vector machine models developed with programming language Python for predicting some investment measures are shown.

  13. Supporting and Supervising Teachers Working With Adults Learning English. CAELA Network Brief

    Young, Sarah


    This brief provides an overview of the knowledge and skills that administrators need in order to support and supervise teachers of adult English language learners. It begins with a review of resources and literature related to teacher supervision in general and to adult ESL education. It continues with information on the background and…

  14. Incremental Support Vector Learning for Ordinal Regression.

    Gu, Bin; Sheng, Victor S; Tay, Keng Yeow; Romano, Walter; Li, Shuo


    Support vector ordinal regression (SVOR) is a popular method to tackle ordinal regression problems. However, until now there were no effective algorithms proposed to address incremental SVOR learning due to the complicated formulations of SVOR. Recently, an interesting accurate on-line algorithm was proposed for training ν -support vector classification (ν-SVC), which can handle a quadratic formulation with a pair of equality constraints. In this paper, we first present a modified SVOR formulation based on a sum-of-margins strategy. The formulation has multiple constraints, and each constraint includes a mixture of an equality and an inequality. Then, we extend the accurate on-line ν-SVC algorithm to the modified formulation, and propose an effective incremental SVOR algorithm. The algorithm can handle a quadratic formulation with multiple constraints, where each constraint is constituted of an equality and an inequality. More importantly, it tackles the conflicts between the equality and inequality constraints. We also provide the finite convergence analysis for the algorithm. Numerical experiments on the several benchmark and real-world data sets show that the incremental algorithm can converge to the optimal solution in a finite number of steps, and is faster than the existing batch and incremental SVOR algorithms. Meanwhile, the modified formulation has better accuracy than the existing incremental SVOR algorithm, and is as accurate as the sum-of-margins based formulation of Shashua and Levin.

  15. A Fast Algorithm for Support Vector Clustering

    吕常魁; 姜澄宇; 王宁生


    Support Vector Clustering (SVC) is a kernel-based unsupervised learning clustering method. The main drawback of SVC is its high computational complexity in getting the adjacency matrix describing the connectivity for each pairs of points. Based on the proximity graph model[3] , the Euclidean distance in Hilbert space is calculated using a Gaussian kernel, which is the right criterion to generate a minimum spanning tree using Kruskal's algorithm. Then the connectivity estimation is lowered by only checking the linkages between the edges that construct the main stem of the MST (Minimum Spanning Tree), in which the non-compatibility degree is originally defined to support the edge selection during linkage estimations. This new approach is experimentally analyzed.The results show that the revised algorithm has a better performance than the proximity graph model with faster speed, optimized clustering quality and strong ability to noise suppression, which makes SVC scalable to large data sets.

  16. Impeccable Advice: Supporting Women Academics through Supervision and Mentoring

    Ali, Suki; Coate, Kelly


    At the time when Diana was writing " A Woman's Guide to Doctoral Studies" (2001), she was supervising a number of female doctoral students. She drew on some of their experiences in the writing of the book, and they in return benefited from the extensive insights she had about the politics of academic life that she portrays in her…

  17. Support vector machines with a reject option

    Wegkamp, Marten; 10.3150/10-BEJ320


    This paper studies $\\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of misclassification). The procedure can be conveniently implemented as a linear program and computed using standard software. We prove that the minimizer of the penalized population risk favors sparse solutions and show that the behavior of the empirical risk minimizer mimics that of the population risk minimizer. We also introduce a notion of classification complexity and prove that our minimizers adapt to the unknown complexity. Using a novel oracle inequality for the excess risk, we identify situations where fast rates of convergence occur.

  18. Support Vector Machines and Generalisation in HEP

    Bethani, A.; Bevan, A. J.; Hays, J.; Stevenson, T. J.


    We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than those other algorithms are to over training. This issue is related to the generalisation of a multivariate algorithm (MVA); a problem that has often been overlooked in particle physics. We discuss cross validation and how this can be used to improve the generalisation of a MVA in the context of High Energy Physics analyses. The examples presented use the Toolkit for Multivariate Analysis (TMVA) based on ROOT and describe our improvements to the SVM functionality and new tools introduced for cross validation within this framework.

  19. Mechanical Fault Diagnosis Using Support Vector Machine

    LI Ling-jun; ZHANG Zhou-suo; HE Zheng-jia


    The Support Vector Machine (SVM) is a machine learning algorithm based on the Statistical Learning Theory ( SLT) , which can get good classification effects even with a few learning samples. SVM represents a new approach to pattern classification and has been shown to be particularly successful in many fields such as image identification and face recognition. It also provides us with a new method to develop intelligent fault diagnosis. This paper presents a SVM-based approach for fault diagnosis of rolling bearings. Experimentation with vibration signals of bearings is conducted. The vibration signals acquired from the bearings are used directly in the calculating without the preprocessing of extracting its features. Compared with the methods based on Artificial Neural Network (ANN), the SVM-based meth-od has desirable advantages. It is applicable for on-line diagnosis of mechanical systems.

  20. Color Image Classification Using Support Vector Machines



    An efficient method using various histogram-based (high-dimensional) image content descriptors for automatically classifying general color photos into relevant categories is presented. Principal component analysis(PCA) is used to project the original high dimensional histograms onto their eigenspaees. Lower dimensional eigenfeatures are then used to train support vector machines(SVMs) to classify images into their categories. Experimental results show that even though different descriptors perform differently,they are all highly redundant. It is shown that the dimensionality of all these descriptors,regardless of their performances,can be significantly reduced without affecting classification accuracy, Such scheme would be useful when it is used in an interactive setting for relevant feedback in content-based image retrieval,where low dimensional content descriptors will enable fast online learning and reclassification of results.

  1. Support Vector Machines and Generalisation in HEP

    Bethani, A; Hays, J; Stevenson, T J


    We review the concept of support vector machines (SVMs) and discuss examples of their use. One of the benefits of SVM algorithms, compared with neural networks and decision trees is that they can be less susceptible to over fitting than those other algorithms are to over training. This issue is related to the generalisation of a multivariate algorithm (MVA); a problem that has often been overlooked in particle physics. We discuss cross validation and how this can be used to improve the generalisation of a MVA in the context of High Energy Physics analyses. The examples presented use the Toolkit for Multivariate Analysis (TMVA) based on ROOT and describe our improvements to the SVM functionality and new tools introduced for cross validation within this framework.

  2. Applications of Support Vector Machines in Astronomy

    Zhang, Y.; Zhao, Y.


    We review Support Vector Machines (SVMs) as applied in astronomy. SVMs are mainly used for solving the and regression issues. Take classification for example, selecting of cataclysmic variables from large spectroscopic survey, detecting quasar candidates from multiwavelength photometric data, identification of blue horizontal branch stars from photometric data, classification of galactic spectra, supernova search; for regression problem, photometric redshift estimation of galaxies and quasars, physical parameter measurement (metallicity, gravity, effective temperature) of stars. Comparatively, SVMs show better performance in classification than in regression. Nevertheless, SVMs has its disadvantages, which needs large computation cost on training. Based on this problem, CUDA-Accelerated SVMs is put forward. As for accuracy of SVMs, SVMs combined with other algorithms has further improvement, such as SVM-KNN.

  3. Ultrasonic fluid quantity measurement in dynamic vehicular applications a support vector machine approach

    Terzic, Jenny; Nagarajah, Romesh; Alamgir, Muhammad


    Accurate fluid level measurement in dynamic environments can be assessed using a Support Vector Machine (SVM) approach. SVM is a supervised learning model that analyzes and recognizes patterns. It is a signal classification technique which has far greater accuracy than conventional signal averaging methods. Ultrasonic Fluid Quantity Measurement in Dynamic Vehicular Applications: A Support Vector Machine Approach describes the research and development of a fluid level measurement system for dynamic environments. The measurement system is based on a single ultrasonic sensor. A Support Vector Machines (SVM) based signal characterization and processing system has been developed to compensate for the effects of slosh and temperature variation in fluid level measurement systems used in dynamic environments including automotive applications. It has been demonstrated that a simple ν-SVM model with Radial Basis Function (RBF) Kernel with the inclusion of a Moving Median filter could be used to achieve the high levels...

  4. Variance inflation in high dimensional Support Vector Machines

    Abrahamsen, Trine Julie; Hansen, Lars Kai


    Many important machine learning models, supervised and unsupervised, are based on simple Euclidean distance or orthogonal projection in a high dimensional feature space. When estimating such models from small training sets we face the problem that the span of the training data set input vectors...... is not the full input space. Hence, when applying the model to future data the model is effectively blind to the missed orthogonal subspace. This can lead to an inflated variance of hidden variables estimated in the training set and when the model is applied to test data we may find that the hidden variables...... follow a different probability law with less variance. While the problem and basic means to reconstruct and deflate are well understood in unsupervised learning, the case of supervised learning is less well understood. We here investigate the effect of variance inflation in supervised learning including...

  5. Incremental Support Vector Machine Framework for Visual Sensor Networks

    Yuichi Motai


    Full Text Available Motivated by the emerging requirements of surveillance networks, we present in this paper an incremental multiclassification support vector machine (SVM technique as a new framework for action classification based on real-time multivideo collected by homogeneous sites. The technique is based on an adaptation of least square SVM (LS-SVM formulation but extends beyond the static image-based learning of current SVM methodologies. In applying the technique, an initial supervised offline learning phase is followed by a visual behavior data acquisition and an online learning phase during which the cluster head performs an ensemble of model aggregations based on the sensor nodes inputs. The cluster head then selectively switches on designated sensor nodes for future incremental learning. Combining sensor data offers an improvement over single camera sensing especially when the latter has an occluded view of the target object. The optimization involved alleviates the burdens of power consumption and communication bandwidth requirements. The resulting misclassification error rate, the iterative error reduction rate of the proposed incremental learning, and the decision fusion technique prove its validity when applied to visual sensor networks. Furthermore, the enabled online learning allows an adaptive domain knowledge insertion and offers the advantage of reducing both the model training time and the information storage requirements of the overall system which makes it even more attractive for distributed sensor networks communication.

  6. Fast and Accurate Support Vector Machines on Large Scale Systems

    Vishnu, Abhinav; Narasimhan, Jayenthi; Holder, Larry; Kerbyson, Darren J.; Hoisie, Adolfy


    Support Vector Machines (SVM) is a supervised Machine Learning and Data Mining (MLDM) algorithm, which has become ubiquitous largely due to its high accuracy and obliviousness to dimensionality. The objective of SVM is to find an optimal boundary --- also known as hyperplane --- which separates the samples (examples in a dataset) of different classes by a maximum margin. Usually, very few samples contribute to the definition of the boundary. However, existing parallel algorithms use the entire dataset for finding the boundary, which is sub-optimal for performance reasons. In this paper, we propose a novel distributed memory algorithm to eliminate the samples which do not contribute to the boundary definition in SVM. We propose several heuristics, which range from early (aggressive) to late (conservative) elimination of the samples, such that the overall time for generating the boundary is reduced considerably. In a few cases, a sample may be eliminated (shrunk) pre-emptively --- potentially resulting in an incorrect boundary. We propose a scalable approach to synchronize the necessary data structures such that the proposed algorithm maintains its accuracy. We consider the necessary trade-offs of single/multiple synchronization using in-depth time-space complexity analysis. We implement the proposed algorithm using MPI and compare it with libsvm--- de facto sequential SVM software --- which we enhance with OpenMP for multi-core/many-core parallelism. Our proposed approach shows excellent efficiency using up to 4096 processes on several large datasets such as UCI HIGGS Boson dataset and Offending URL dataset.

  7. Support vector machines optimization based theory, algorithms, and extensions

    Deng, Naiyang; Zhang, Chunhua


    Support Vector Machines: Optimization Based Theory, Algorithms, and Extensions presents an accessible treatment of the two main components of support vector machines (SVMs)-classification problems and regression problems. The book emphasizes the close connection between optimization theory and SVMs since optimization is one of the pillars on which SVMs are built.The authors share insight on many of their research achievements. They give a precise interpretation of statistical leaning theory for C-support vector classification. They also discuss regularized twi

  8. The entire regularization path for the support vector domain description

    Sjöstrand, Karl; Larsen, Rasmus


    -class support vector machine classifier. Recently, it was shown that the regularization path of the support vector machine is piecewise linear, and that the entire path can be computed efficiently. This pa- per shows that this property carries over to the support vector domain description. Using our results......The support vector domain description is a one-class classi- fication method that estimates the shape and extent of the distribution of a data set. This separates the data into outliers, outside the decision boundary, and inliers on the inside. The method bears close resemblance to the two...

  9. Density Based Support Vector Machines for Classification

    Zahra Nazari


    Full Text Available Support Vector Machines (SVM is the most successful algorithm for classification problems. SVM learns the decision boundary from two classes (for Binary Classification of training points. However, sometimes there are some less meaningful samples amongst training points, which are corrupted by noises or misplaced in wrong side, called outliers. These outliers are affecting on margin and classification performance, and machine should better to discard them. SVM as a popular and widely used classification algorithm is very sensitive to these outliers and lacks the ability to discard them. Many research results prove this sensitivity which is a weak point for SVM. Different approaches are proposed to reduce the effect of outliers but no method is suitable for all types of data sets. In this paper, the new method of Density Based SVM (DBSVM is introduced. Population Density is the basic concept which is used in this method for both linear and non-linear SVM to detect outliers. Experiments on artificial data sets, real high-dimensional benchmark data sets of Liver disorder and Heart disease, and data sets of new and fatigued banknotes’ acoustic signals can prove the efficiency of this method on noisy data classification and the better generalization that it can provide compared to the standard SVM.

  10. Ranking Support Vector Machine with Kernel Approximation.

    Chen, Kai; Li, Rongchun; Dou, Yong; Liang, Zhengfa; Lv, Qi


    Learning to rank algorithm has become important in recent years due to its successful application in information retrieval, recommender system, and computational biology, and so forth. Ranking support vector machine (RankSVM) is one of the state-of-art ranking models and has been favorably used. Nonlinear RankSVM (RankSVM with nonlinear kernels) can give higher accuracy than linear RankSVM (RankSVM with a linear kernel) for complex nonlinear ranking problem. However, the learning methods for nonlinear RankSVM are still time-consuming because of the calculation of kernel matrix. In this paper, we propose a fast ranking algorithm based on kernel approximation to avoid computing the kernel matrix. We explore two types of kernel approximation methods, namely, the Nyström method and random Fourier features. Primal truncated Newton method is used to optimize the pairwise L2-loss (squared Hinge-loss) objective function of the ranking model after the nonlinear kernel approximation. Experimental results demonstrate that our proposed method gets a much faster training speed than kernel RankSVM and achieves comparable or better performance over state-of-the-art ranking algorithms.


    LI Hong-shuang; L(U) Zhen-zhou; YUE Zhu-feng


    Support vector machine (SVM) was introduced to analyze the reliability of the implicit performance function, which is difficult to implement by the classical methods such as the first order reliability method (FORM) and the Monte Carlo simulation (MCS). As a classification method where the underlying structural risk minimization inference rule is employed, SVM possesses excellent learning capacity with a small amount of information and good capability of generalization over the complete data. Hence,two approaches, i.e., SVM-based FORM and SVM-based MCS, were presented for the structural reliability analysis of the implicit limit state function. Compared to the conventional response surface method (RSM) and the artificial neural network (ANN), which are widely used to replace the implicit state function for alleviating the computation cost,the more important advantages of SVM are that it can approximate the implicit function with higher precision and better generalization under the small amount of information and avoid the "curse of dimensionality". The SVM-based reliability approaches can approximate the actual performance function over the complete sampling data with the decreased number of the implicit performance function analysis (usually finite element analysis), and the computational precision can satisfy the engineering requirement, which are demonstrated by illustrations.

  12. Face Behavior Recognition Through Support Vector Machines

    Haval A. Ahmed


    Full Text Available Communication between computers and humans has grown to be a major field of research. Facial Behavior Recognition through computer algorithms is a motivating and difficult field of research for establishing emotional interactions between humans and computers. Although researchers have suggested numerous methods of emotion recognition within the literature of this field, as yet, these research works have mainly focused on one method for their system output i.e. used one facial database for assessing their works. This may diminish the generalization method and additionally it might shrink the comparability range. A proposed technique for recognizing emotional expressions that are expressed through facial aspects of still images is presented. This technique uses the Support Vector Machines (SVM as a classifier of emotions. Substantive problems are considered such as diversity in facial databases, the samples included in each database, the number of facial expressions experienced an accurate method of extracting facial features, and the variety of structural models. After many experiments and the results of different models being compared, it is determined that this approach produces high recognition rates.

  13. Support Vector Machine for mechanical faults classification

    JIANG Zhi-qiang; FU Han-guang; LI Ling-jun


    Support Vector Machine (SVM) is a machine learning algorithm based on the Statistical Learning Theory (SLT), which can get good classification effects with a few learning samples. SVM represents a new approach to pattern classification and has been shown to be particularly successful in many fields such as image identification and face recognition. It also provides us with a new method to develop intelligent fault diagnosis. This paper presents an SVM based approach for fault diagnosis of rolling bearings. Experimentation with vibration signals of bearing was conducted. The vibration signals acquired from the bearings were directly used in the calculating without the preprocessing of extracting its features. Compared with the Artificial Neural Network (ANN) based method, the SVM based method has desirable advantages. Also a multi-fault SVM classifier based on binary classifier is constructed for gear faults in this paper. Other experiments with gear fault samples showed that the multi-fault SVM classifier has good classification ability and high efficiency in mechanical system. It is suitable for online diagnosis for mechanical system.

  14. Digital communication to support clinical supervision: considering the human factors.

    Mather, Carey; Marlow, Annette; Cummings, Elizabeth


    During the last three years the School of Nursing and Midwifery at the University of Tasmania has used a needs assessment survey to explore the needs of organizations and nursing professionals that facilitate and clinically supervise Bachelor of Nursing students in the workplace. Findings from the survey indicated that staff at healthcare organizations wanted a communication strategy that was easily accessible by clinicians who supervised students during work integrated learning placements. In particular they wanted to receive timely information related to the role and function of supervisors in practice. The development of the digital strategy to strengthen the development of a community of practice between the University, organizations, facilities and clinical supervisors was identified as the key method of improving communication. Blogging and micro blogging were selected as methods of choice for the implementation of the digital strategy because they were easy to set up, use and enable equity of access to geographically dispersed practitioners in urban and rural areas. Change champions were identified to disseminate information about the strategy within their workplaces. Although clinicians indicated electronic communication as their preferred method, there were a number of human factors at a systems and individual level identified to be challenges when communicating with clinical supervisors who were based off-campus. Information communication technology policies and embedded culture towards social presence were impediments to using this approach in some organizations. Additionally, it was found that it is necessary for this group of clinicians to be educated about using digital methods to undertake their role as clinical supervisors in their varied clinical practice environments.

  15. The Use of E-supervision to Support Speech-Language Pathology Graduate Students during Student Teaching Practica.

    Carlin, Charles H; Boarman, Katie; Carlin, Emily; Inselmann, Karissa


    In the present feasibility study, e-supervision was used to provide university liaison supervision to speech-language pathology (SLP) graduate students enrolled in student teaching practica. Utilizing a mixed methodology approach, interview and survey data were compared in order to identify similarities and differences between in-person and e-supervision, and guide future practice. Results showed e-supervised graduate students perceived that they received adequate supervision, feedback, support, and communication. Further, e-supervision provided additional benefits to supervisors, children on the caseload, and universities. Despite the benefits, disadvantages emerged. Implications for future practice and limitations of the study were identified.

  16. The Use of E-supervision to Support Speech-Language Pathology Graduate Students during Student Teaching Practica

    Charles H. Carlin


    Full Text Available In the present feasibility study, e-supervision was used to provide university liaison supervision to SLP graduate students enrolled in student teaching practica. Utilizing a mixed methodology approach, interview and survey data were compared in order to identify similarities and differences between face-to-face and e-supervision and guide future practice. Results showed e-supervised graduate students received adequate supervision, feedback, support, and communication. Further, e-supervision provided additional benefits to supervisors, children on the caseload, and universities. Despite the benefits, disadvantages emerged. Implications for future practice and limitations of the study were identified.

  17. An Ambient Awareness Tool for Supporting Supervised Collaborative Problem Solving

    Alavi, H. S.; Dillenbourg, P.


    We describe an ambient awareness tool, named "Lantern", designed for supporting the learning process in recitation sections, (i.e., when students work in small teams on the exercise sets with the help of tutors). Each team is provided with an interactive lamp that displays their work status: the exercise they are working on, if they have…

  18. Ozone Monitoring Using Support Vector Machine and K-Nearest Neighbors Methods

    FALEH Rabeb


    Full Text Available Due to health impacts caused by the pollutant gases, monitoring and controlling air quality is an important field of interest. This paper deals with ozone monitoring in four stations measuring air quality located in many Tunisian cities using numerous measuring instruments and polluting gas analyzers. Prediction of ozone concentrations in two Tunisian cities, Tunis and Sfax is screened based on supervised classification models. The K -Nearest neighbors results reached 98.7 % success rate in the recognition and ozone identification. Support Vector Machines (SVM with the linear, polynomial and RBF kernel were applied to build a classifier and full accuracy (100% was again achieved with the RBF kernel.

  19. Applying the Support Vector Machine Method to Matching IRAS and SDSS Catalogues

    Chen Cao


    Full Text Available This paper presents results of applying a machine learning technique, the Support Vector Machine (SVM, to the astronomical problem of matching the Infra-Red Astronomical Satellite (IRAS and Sloan Digital Sky Survey (SDSS object catalogues. In this study, the IRAS catalogue has much larger positional uncertainties than those of the SDSS. A model was constructed by applying the supervised learning algorithm (SVM to a set of training data. Validation of the model shows a good identification performance (∼ 90% correct, better than that derived from classical cross-matching algorithms, such as the likelihood-ratio method used in previous studies.

  20. Weighted K-means support vector machine for cancer prediction

    Kim, Sunghwan


    To date, the support vector machine (SVM) has been widely applied to diverse bio-medical fields to address disease subtype identification and pathogenicity of genetic variants. In this paper, I propose the weighted K-means support vector machine (wKM-SVM) and weighted support vector machine (wSVM), for which I allow the SVM to impose weights to the loss term. Besides, I demonstrate the numerical relations between the objective function of the SVM and weights. Motivated by general ensemble tec...

  1. Support vector regression model for complex target RCS predicting

    Wang Gu; Chen Weishi; Miao Jungang


    The electromagnetic scattering computation has developed rapidly for many years; some computing problems for complex and coated targets cannot be solved by using the existing theory and computing models. A computing model based on data is established for making up the insufficiency of theoretic models. Based on the "support vector regression method", which is formulated on the principle of minimizing a structural risk, a data model to predicate the unknown radar cross section of some appointed targets is given. Comparison between the actual data and the results of this predicting model based on support vector regression method proved that the support vector regression method is workable and with a comparative precision.

  2. Support Vector Machine Optimized by Improved Genetic Algorithm

    Xiang Chang Sheng


    Full Text Available Parameters of support vector machines (SVM which is optimized by standard genetic algorithm is easy to trap into the local minimum, in order to get the optimal parameters of support vector machine, this paper proposed a parameters optimization method for support vector machines based on improved genetic algorithm, the simulation experiment is carried out on 5 benchmark datasets. The simulation show that the proposed method not only can assure the classification precision, but also can reduce training time markedly compared with standard genetic algorithm.

  3. Peer Support in Negotiating Multiple Relationships within Supervision among Counselor Education Doctoral Students

    Minor, Amanda J.; Pimpleton, Asher; Stinchfield, Tracy; Stevens, Heath; Othman, Nor Asma


    Counselor education doctoral students (CEDSs), like other doctoral students, need assistance and support to ensure their self-care. One area markedly affecting self-care is one's relationships with others. The purpose of this article is to examine the multiple relationships involved within CEDSs supervision, the potential areas to utilize peer…

  4. Fuzzy rule-based support vector regression system

    Ling WANG; Zhichun MU; Hui GUO


    In this paper,we design a fuzzy rule-based support vector regression system.The proposed system utilizes the advantages of fuzzy model and support vector regression to extract support vectors to generate fuzzy if-then rules from the training data set.Based on the first-order linear Tagaki-Sugeno (TS) model,the structure of rules is identified by the support vector regression and then the consequent parameters of rules are tuned by the global least squares method.Our model is applied to the real world regression task.The simulation results gives promising performances in terms of a set of fuzzy rules,which can be easily interpreted by humans.

  5. DNA regulatory motif selection based on support vector machine ...

    DNA regulatory motif selection based on support vector machine (SVM) and its application in microarray ... African Journal of Biotechnology ... experiments to explore the underlying relationships between motif types and gene functions.

  6. An Introduction to Support Vector Machines: A Review

    Chen, Yiling; Councill, Isaac G.


    Review of "An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Nello Cristianini and John Shawe-Taylor, New York, Cambridge University Press, 2000, 189 pp., $45, ISBN 0-521-78019-5.

  7. A support vector machine approach to the development of an ...

    PROMOTING ACCESS TO AFRICAN RESEARCH ... Abstract. This paper demonstrated the use of support vector machine (SVM) model to develop an ... system application and implementation was carried out with java programming language.

  8. Prediction in Marketing Using the Support Vector Machine

    Dapeng Cui; David Curry


    Many marketing problems require accurately predicting the outcome of a process or the future state of a system. In this paper, we investigate the ability of the support vector machine to predict outcomes in emerging environments in marketing, such as automated modeling, mass-produced models, intelligent software agents, and data mining. The support vector machine (SVM) is a semiparametric technique with origins in the machine-learning literature of computer science. Its approach to prediction...


    阎威武; 陈治纲; 邵惠鹤


    Support Vector Machines (SVM) is a powerful machine learning method developed from statistical learning theory and is currently an active field in artificial intelligent technology. SVM is sensitive to noise vectors near hyperplane since it is determined only by few support vectors. In this paper, Multi SVM decision model(MSDM)was proposed. MSDM consists of multiple SVMs and makes decision by synthetic information based on multi SVMs. MSDM is applied to heart disease diagnoses based on UCI benchmark data set. MSDM somewhat inproves the robust of decision system.

  10. Classification of Regional Ionospheric Disturbances Based on Support Vector Machines

    Begüm Terzi, Merve; Arikan, Feza; Arikan, Orhan; Karatay, Secil


    Ionosphere is an anisotropic, inhomogeneous, time varying and spatio-temporally dispersive medium whose parameters can be estimated almost always by using indirect measurements. Geomagnetic, gravitational, solar or seismic activities cause variations of ionosphere at various spatial and temporal scales. This complex spatio-temporal variability is challenging to be identified due to extensive scales in period, duration, amplitude and frequency of disturbances. Since geomagnetic and solar indices such as Disturbance storm time (Dst), F10.7 solar flux, Sun Spot Number (SSN), Auroral Electrojet (AE), Kp and W-index provide information about variability on a global scale, identification and classification of regional disturbances poses a challenge. The main aim of this study is to classify the regional effects of global geomagnetic storms and classify them according to their risk levels. For this purpose, Total Electron Content (TEC) estimated from GPS receivers, which is one of the major parameters of ionosphere, will be used to model the regional and local variability that differs from global activity along with solar and geomagnetic indices. In this work, for the automated classification of the regional disturbances, a classification technique based on a robust machine learning technique that have found wide spread use, Support Vector Machine (SVM) is proposed. SVM is a supervised learning model used for classification with associated learning algorithm that analyze the data and recognize patterns. In addition to performing linear classification, SVM can efficiently perform nonlinear classification by embedding data into higher dimensional feature spaces. Performance of the developed classification technique is demonstrated for midlatitude ionosphere over Anatolia using TEC estimates generated from the GPS data provided by Turkish National Permanent GPS Network (TNPGN-Active) for solar maximum year of 2011. As a result of implementing the developed classification

  11. Retinal blood vessel segmentation using line operators and support vector classification.

    Ricci, Elisa; Perfetti, Renzo


    In the framework of computer-aided diagnosis of eye diseases, retinal vessel segmentation based on line operators is proposed. A line detector, previously used in mammography, is applied to the green channel of the retinal image. It is based on the evaluation of the average grey level along lines of fixed length passing through the target pixel at different orientations. Two segmentation methods are considered. The first uses the basic line detector whose response is thresholded to obtain unsupervised pixel classification. As a further development, we employ two orthogonal line detectors along with the grey level of the target pixel to construct a feature vector for supervised classification using a support vector machine. The effectiveness of both methods is demonstrated through receiver operating characteristic analysis on two publicly available databases of color fundus images.

  12. Supportive supervision for volunteers to deliver reproductive health education: a cluster randomized trial.

    Singh, Debra; Negin, Joel; Orach, Christopher Garimoi; Cumming, Robert


    Community Health Volunteers (CHVs) can be effective in improving pregnancy and newborn outcomes through community education. Inadequate supervision of CHVs, whether due to poor planning, irregular visits, or ineffective supervisory methods, is, however, recognized as a weakness in many programs. There has been little research on best practice supervisory or accompaniment models. From March 2014 to February 2015 a proof of concept study was conducted to compare training alone versus training and supportive supervision by paid CHWs (n = 4) on the effectiveness of CHVs (n = 82) to deliver education about pregnancy, newborn care, family planning and hygiene. The pair-matched cluster randomized trial was conducted in eight villages (four intervention and four control) in Budondo sub-county in Jinja, Uganda. Increases in desired behaviors were seen in both the intervention and control arms over the study period. Both arms showed high retention rates of CHVs (95 %). At 1 year follow-up there was a significantly higher prevalence of installed and functioning tippy taps for hand washing (p reproductive health care by addressing cultural norms and scientific misconceptions. Having a team of 2 CHWs to 40 CHVs enables close to community access to information, conversation and services. Supportive supervision involves creating a non-threatening, empowering environment in which both the CHV and the supervising CHW learn together and overcome obstacles that might otherwise demotivate the CHV. While the results seem promising for added value with supportive supervision for CHVs undertaking reproductive health activities, further research on a larger scale will be needed to substantiate the effect.

  13. Least squares twin support vector machine with Universum data for classification

    Xu, Yitian; Chen, Mei; Li, Guohui


    Universum, a third class not belonging to either class of the classification problem, allows to incorporate the prior knowledge into the learning process. A lot of previous work have demonstrated that the Universum is helpful to the supervised and semi-supervised classification. Moreover, Universum has already been introduced into the support vector machine (SVM) and twin support vector machine (TSVM) to enhance the generalisation performance. To further increase the generalisation performance, we propose a least squares TSVM with Universum data (?-TSVM) in this paper. Our ?-TSVM possesses the following advantages: first, it exploits Universum data to improve generalisation performance. Besides, it implements the structural risk minimisation principle by adding a regularisation to the objective function. Finally, it costs less computing time by solving two small-sized systems of linear equations instead of a single larger-sized quadratic programming problem. To verify the validity of our proposed algorithm, we conduct various experiments around the size of labelled samples and the number of Universum data on data-sets including seven benchmark data-sets, Toy data, MNIST and Face images. Empirical experiments indicate that Universum contributes to making prediction accuracy improved even stable. Especially when fewer labelled samples given, ?-TSVM is far superior to the improved LS-TSVM (ILS-TSVM), and slightly superior to the ?-TSVM.

  14. A Comparison of Supervised Machine Learning Algorithms and Feature Vectors for MS Lesion Segmentation Using Multimodal Structural MRI

    Sweeney, Elizabeth M.; Vogelstein, Joshua T.; Cuzzocreo, Jennifer L.; Calabresi, Peter A.; Reich, Daniel S.; Crainiceanu, Ciprian M.; Shinohara, Russell T.


    Machine learning is a popular method for mining and analyzing large collections of medical data. We focus on a particular problem from medical research, supervised multiple sclerosis (MS) lesion segmentation in structural magnetic resonance imaging (MRI). We examine the extent to which the choice of machine learning or classification algorithm and feature extraction function impacts the performance of lesion segmentation methods. As quantitative measures derived from structural MRI are important clinical tools for research into the pathophysiology and natural history of MS, the development of automated lesion segmentation methods is an active research field. Yet, little is known about what drives performance of these methods. We evaluate the performance of automated MS lesion segmentation methods, which consist of a supervised classification algorithm composed with a feature extraction function. These feature extraction functions act on the observed T1-weighted (T1-w), T2-weighted (T2-w) and fluid-attenuated inversion recovery (FLAIR) MRI voxel intensities. Each MRI study has a manual lesion segmentation that we use to train and validate the supervised classification algorithms. Our main finding is that the differences in predictive performance are due more to differences in the feature vectors, rather than the machine learning or classification algorithms. Features that incorporate information from neighboring voxels in the brain were found to increase performance substantially. For lesion segmentation, we conclude that it is better to use simple, interpretable, and fast algorithms, such as logistic regression, linear discriminant analysis, and quadratic discriminant analysis, and to develop the features to improve performance. PMID:24781953

  15. Improved Support Vector Machine Approach Based on Determining Thresholds Automatically

    WANG Xiao-hua; YAN Xue-mei; WANG Xiao-guang


    To improve the training speed of support vector machine (SVM), a method called improved center distance ratio method (ICDRM) with determining thresholds automatically is presented here without reduce the identification rate. In this method border vectors are chosen from the given samples by comparing sample vectors with center distance ratio in advance. The number of training samples is reduced greatly and the training speed is improved. This method is used to the identification for license plate characters. Experimental results show that the improved SVM method-ICDRM does well at identification rate and training speed.

  16. Estimation of sand liquefaction based on support vector machines

    苏永华; 马宁; 胡检; 杨小礼


    The origin and influence factors of sand liquefaction were analyzed, and the relation between liquefaction and its influence factors was founded. A model based on support vector machines (SVM) was established whose input parameters were selected as following influence factors of sand liquefaction: magnitude (M), the value of SPT, effective pressure of superstratum, the content of clay and the average of grain diameter. Sand was divided into two classes: liquefaction and non-liquefaction, and the class label was treated as output parameter of the model. Then the model was used to estimate sand samples, 20 support vectors and 17 borderline support vectors were gotten, then the parameters were optimized, 14 support vectors and 6 borderline support vectors were gotten, and the prediction precision reaches 100%. In order to verify the generalization of the SVM method, two other practical samples’ data from two cities, Tangshan of Hebei province and Sanshui of Guangdong province, were dealt with by another more intricate model for polytomies, which also considered some influence factors of sand liquefaction as the input parameters and divided sand into four liquefaction grades: serious liquefaction, medium liquefaction, slight liquefaction and non-liquefaction as the output parameters. The simulation results show that the latter model has a very high precision, and using SVM model to estimate sand liquefaction is completely feasible.

  17. Predicting domain-domain interaction based on domain profiles with feature selection and support vector machines

    Liao Li


    Full Text Available Abstract Background Protein-protein interaction (PPI plays essential roles in cellular functions. The cost, time and other limitations associated with the current experimental methods have motivated the development of computational methods for predicting PPIs. As protein interactions generally occur via domains instead of the whole molecules, predicting domain-domain interaction (DDI is an important step toward PPI prediction. Computational methods developed so far have utilized information from various sources at different levels, from primary sequences, to molecular structures, to evolutionary profiles. Results In this paper, we propose a computational method to predict DDI using support vector machines (SVMs, based on domains represented as interaction profile hidden Markov models (ipHMM where interacting residues in domains are explicitly modeled according to the three dimensional structural information available at the Protein Data Bank (PDB. Features about the domains are extracted first as the Fisher scores derived from the ipHMM and then selected using singular value decomposition (SVD. Domain pairs are represented by concatenating their selected feature vectors, and classified by a support vector machine trained on these feature vectors. The method is tested by leave-one-out cross validation experiments with a set of interacting protein pairs adopted from the 3DID database. The prediction accuracy has shown significant improvement as compared to InterPreTS (Interaction Prediction through Tertiary Structure, an existing method for PPI prediction that also uses the sequences and complexes of known 3D structure. Conclusions We show that domain-domain interaction prediction can be significantly enhanced by exploiting information inherent in the domain profiles via feature selection based on Fisher scores, singular value decomposition and supervised learning based on support vector machines. Datasets and source code are freely available on


    Svetlana A. Mukhortova


    Full Text Available Improving the quality of medical care is a priority in countries with developed and developing health care system. There are various approaches to improve the quality and safety of patient’s care, as well as various strategies to encourage hospitals to achieve this goal. The purpose of the presented literature review was to analyze existing experience of the implementation of technology of supportive supervision in health care facilities to improve the quality of hospital care delivery. The data sources for publication were obtained from the following medical databases: PubMed, Cochrane Library, Medscape, e-library, and books on the topic of the review written by experts. The article discusses the results of the research studies demonstrating the successes and failures of supportive supervision technology application. Implementation of supportive supervision in medical facilities based on generalized experience of different countries is a promising direction in improving the quality of medical care delivery. This technology opens up opportunities to improve skills and work quality of the staff at pediatric hospitals in the Russian Federation.

  19. Modelling habitat requirements of white-clawed crayfish (Austropotamobius pallipes using support vector machines

    Favaro L.


    Full Text Available The white-clawed crayfish’s habitat has been profoundly modified in Piedmont (NW Italy due to environmental changes caused by human impact. Consequently, native populations have decreased markedly. In this research project, support vector machines were tested as possible tools for evaluating the ecological factors that determine the presence of white-clawed crayfish. A system of 175 sites was investigated, 98 of which recorded the presence of Austropotamobius pallipes. At each site 27 physical-chemical, environmental and climatic variables were measured according to their importance to A. pallipes. Various feature selection methods were employed. These yielded three subsets of variables that helped build three different types of models: (1 models with no variable selection; (2 models built by applying Goldberg’s genetic algorithm after variable selection; (3 models built by using a combination of four supervised-filter evaluators after variable selection. These different model types helped us realise how important it was to select the right features if we wanted to build support vector machines that perform as well as possible. In addition, support vector machines have a high potential for predicting indigenous crayfish occurrence, according to our findings. Therefore, they are valuable tools for freshwater management, tools that may prove to be much more promising than traditional and other machine-learning techniques.

  20. Relationship Between Support Vector Set and Kernel Functions in SVM

    张铃; 张钹


    Based on a constructive learning approach, covering algorithms, we investigatethe relationship between support vector sets and kernel functions in support vector machines(SVM). An interesting result is obtained. That is, in the linearly non-separable case, any sampleof a given sample set K can become a support vector under a certain kernel function. The resultshows that when the sample set K is linearly non-separable, although the chosen kernel functionsatisfies Mercer's condition its corresponding support vector set is not necessarily the subsetof K that plays a crucial role in classifying K. For a given sample set, what is the subsetthat plays the crucial role in classification? In order to explore the problem, a new concept,boundary or boundary points, is defined and its properties are discussed. Given a sample setK, we show that the decision functions for classifying the boundary points of K are the sameas that for classifying the K itself. And the boundary points of K only depend on K and thestructure of the space at which K is located and independent of the chosen approach for findingthe boundary. Therefore, the boundary point set may become the subset of K that plays acrucial role in classification. These results are of importance to understand the principle of thesupport vector machine (SVM) and to develop new learning algorithms.

  1. Image denoising using least squares wavelet support vector machines

    Guoping Zeng; Ruizhen Zhao


    We propose a new method for image denoising combining wavelet transform and support vector machines (SVMs). A new image filter operator based on the least squares wavelet support vector machines (LSWSVMs) is presented. Noisy image can be denoised through this filter operator and wavelet thresholding technique. Experimental results show that the proposed method is better than the existing SVM regression with the Gaussian radial basis function (RBF) and polynomial RBF. Meanwhile, it can achieve better performance than other traditional methods such as the average filter and median filter.

  2. An extended Lagrangian support vector machine for classifications

    YANG Xiaowei; SHU Lei; HAO Zhifeng; LIANG Yanchun; LIU Guirong; HAN Xu


    Lagrangian support vector machine (LSVM) cannot solve large problems for nonlinear kernel classifiers. In order to extend the LSVM to solve very large problems, an extended Lagrangian support vector machine (ELSVM) for classifications based on LSVM and SVMlight is presented in this paper. Our idea for the ELSVM is to divide a large quadratic programming problem into a series of subproblems with small size and to solve them via LSVM. Since the LSVM can solve small and medium problems for nonlinear kernel classifiers, the proposed ELSVM can be used to handle large problems very efficiently. Numerical experiments on different types of problems are performed to demonstrate the high efficiency of the ELSVM.

  3. Classification using least squares support vector machine for reliability analysis

    Zhi-wei GUO; Guang-chen BAI


    In order to improve the efficiency of the support vector machine (SVM) for classification to deal with a large amount of samples,the least squares support vector machine (LSSVM) for classification methods is introduced into the reliability analysis.To reduce the computational cost,the solution of the SVM is transformed from a quadratic programming to a group of linear equations.The numerical results indicate that the reliability method based on the LSSVM for classification has higher accuracy and requires less computational cost than the SVM method.


    Tong Yubing; Yang Dongkai; Zhang Qishan


    Wavelet, a powerful tool for signal processing, can be used to approximate the target function. For enhancing the sparse property of wavelet approximation, a new algorithm was proposed by using wavelet kernel Support Vector Machines (SVM), which can converge to minimum error with better sparsity. Here, wavelet functions would be firstly used to construct the admitted kernel for SVM according to Mercy theory; then new SVM with this kernel can be used to approximate the target funciton with better sparsity than wavelet approxiamtion itself. The results obtained by our simulation experiment show the feasibility and validity of wavelet kernel support vector machines.

  5. Adjustable entropy function method for support vector machine

    Wu Qing; Liu Sanyang; Zhang Leyou


    Based on KKT complementary condition in optimization theory,an unconstrained non-differential optimization model for support vector machine is proposed.An adjustable entropy function method is given to deal with the proposed optimization problem and the Newton algorithm is used to figure out the optimal solution.The proposed method can find an optimal solution with a relatively small parameter p,which avoids the numerical overflow in the traditional entropy function methods.It is a new approach to solve support vector machine.The theoretical analysis and experimental results illustrate the feasibility and efficiency of the proposed algorithm.

  6. Prediction of Banking Systemic Risk Based on Support Vector Machine

    Shouwei Li


    Full Text Available Banking systemic risk is a complex nonlinear phenomenon and has shed light on the importance of safeguarding financial stability by recent financial crisis. According to the complex nonlinear characteristics of banking systemic risk, in this paper we apply support vector machine (SVM to the prediction of banking systemic risk in an attempt to suggest a new model with better explanatory power and stability. We conduct a case study of an SVM-based prediction model for Chinese banking systemic risk and find the experiment results showing that support vector machine is an efficient method in such case.

  7. How to create more supportive supervision for primary healthcare: lessons from Ngamiland district of Botswana: co-operative inquiry group

    Oathokwa Nkomazana


    Full Text Available Background: Supportive supervision is a way to foster performance, productivity, motivation, and retention of health workforce. Nevertheless there is a dearth of evidence of the impact and acceptability of supportive supervision in low- and middle-income countries. This article describes a participatory process of transforming the supervisory practice of district health managers to create a supportive environment for primary healthcare workers. Objective: The objective of the study was to explore how district health managers can change their practice to create a more supportive environment for primary healthcare providers. Design: A facilitated co-operative inquiry group (CIG was formed with Ngamiland health district managers. CIG belongs to the participatory action research paradigm and is characterised by a cyclic process of observation, reflection, planning, and action. The CIG went through three cycles between March 2013 and March 2014. Results: Twelve district health managers participated in the inquiry group. The major insights and learning that emerged from the inquiry process included inadequate supervisory practice, perceptions of healthcare workers’ experiences, change in the managers’ supervision paradigm, recognition of the supervisors’ inadequate supervisory skills, and barriers to supportive supervision. Finally, the group developed a 10-point consensus on what they had learnt regarding supportive supervision. Conclusion: Ngamiland health district managers have come to appreciate the value of supportive supervision and changed their management style to be more supportive of their subordinates. They also developed a consensus on supportive supervision that could be adapted for use nationally. Supportive supervision should be prioritised at all levels of the health system, and it should be adequately resourced.

  8. Robust support vector machine-trained fuzzy system.

    Forghani, Yahya; Yazdi, Hadi Sadoghi


    Because the SVM (support vector machine) classifies data with the widest symmetric margin to decrease the probability of the test error, modern fuzzy systems use SVM to tune the parameters of fuzzy if-then rules. But, solving the SVM model is time-consuming. To overcome this disadvantage, we propose a rapid method to solve the robust SVM model and use it to tune the parameters of fuzzy if-then rules. The robust SVM is an extension of SVM for interval-valued data classification. We compare our proposed method with SVM, robust SVM, ISVM-FC (incremental support vector machine-trained fuzzy classifier), BSVM-FC (batch support vector machine-trained fuzzy classifier), SOTFN-SV (a self-organizing TS-type fuzzy network with support vector learning) and SCLSE (a TS-type fuzzy system with subtractive clustering for antecedent parameter tuning and LSE for consequent parameter tuning) by using some real datasets. According to experimental results, the use of proposed approach leads to very low training and testing time with good misclassification rate.

  9. Diagnosis of Acute Coronary Syndrome with a Support Vector Machine.

    Berikol, Göksu Bozdereli; Yildiz, Oktay; Özcan, I Türkay


    Acute coronary syndrome (ACS) is a serious condition arising from an imbalance of supply and demand to meet myocardium's metabolic needs. Patients typically present with retrosternal chest pain radiating to neck and left arm. Electrocardiography (ECG) and laboratory tests are used indiagnosis. However in emergency departments, there are some difficulties for physicians to decide whether hospitalizing, following up or discharging the patient. The aim of the study is to diagnose ACS and helping the physician with his decisionto discharge or to hospitalizevia machine learning techniques such as support vector machine (SVM) by using patient data including age, sex, risk factors, and cardiac enzymes (CK-MB, Troponin I) of patients presenting to emergency department with chest pain. Clinical, laboratory, and imaging data of 228 patients presenting to emergency department with chest pain were reviewedand the performance of support vector machine. Four different methods (Support vector machine (SVM), Artificial neural network (ANN), Naïve Bayes and Logistic Regression) were tested and the results of SVM which has the highest accuracy is reported. Among 228 patients aged 19 to 91 years who were included in the study, 99 (43.4 %) were qualified as ACS, while 129 (56.5 %) had no ACS. The classification model using SVM attained a 99.13 % classification success. The present study showed a 99.13 % classification success for ACS diagnosis attained by Support Vector Machine. This study showed that machine learning techniques may help emergency department staff make decisions by rapidly producing relevant data.

  10. Analog neural network for support vector machine learning.

    Perfetti, Renzo; Ricci, Elisa


    An analog neural network for support vector machine learning is proposed, based on a partially dual formulation of the quadratic programming problem. It results in a simpler circuit implementation with respect to existing neural solutions for the same application. The effectiveness of the proposed network is shown through some computer simulations concerning benchmark problems.

  11. Ischemic Segment Detection using the Support Vector Domain Description

    Hansen, Michael Sass; Ólafsdóttir, Hildur; Sjöstrand, Karl


    and registration of the myocardium provided pixel-wise signal intensity curves that were analyzed using the Support Vector Domain Description (SVDD). In contrast to normal SVDD, the entire regularization path was calculated and used to calculate a generalized distance. The results corresponded well to the ischemic...

  12. Estimate of error bounds in the improved support vector regression

    SUN Yanfeng; LIANG Yanchun; WU Chunguo; YANG Xiaowei; LEE Heow Pueh; LIN Wu Zhong


    An estimate of a generalization error bound of the improved support vector regression(SVR)is provided based on our previous work.The boundedness of the error of the improved SVR is proved when the algorithm is applied to the function approximation.

  13. Prediction of Machine Tool Condition Using Support Vector Machine

    Wang, Peigong; Meng, Qingfeng; Zhao, Jian; Li, Junjie; Wang, Xiufeng


    Condition monitoring and predicting of CNC machine tools are investigated in this paper. Considering the CNC machine tools are often small numbers of samples, a condition predicting method for CNC machine tools based on support vector machines (SVMs) is proposed, then one-step and multi-step condition prediction models are constructed. The support vector machines prediction models are used to predict the trends of working condition of a certain type of CNC worm wheel and gear grinding machine by applying sequence data of vibration signal, which is collected during machine processing. And the relationship between different eigenvalue in CNC vibration signal and machining quality is discussed. The test result shows that the trend of vibration signal Peak-to-peak value in surface normal direction is most relevant to the trend of surface roughness value. In trends prediction of working condition, support vector machine has higher prediction accuracy both in the short term ('One-step') and long term (multi-step) prediction compared to autoregressive (AR) model and the RBF neural network. Experimental results show that it is feasible to apply support vector machine to CNC machine tool condition prediction.

  14. Predicting post-translational lysine acetylation using support vector machines

    Gnad, Florian; Ren, Shubin; Choudhary, Chunaram


    spectrometry to identify 3600 lysine acetylation sites on 1750 human proteins covering most of the previously annotated sites and providing the most comprehensive acetylome so far. This dataset should provide an excellent source to train support vector machines (SVMs) allowing the high accuracy in silico...

  15. GenSVM: a generalized multiclass support vector machine

    G.J.J. van den Burg (Gerrit); P.J.F. Groenen (Patrick)


    textabstractTraditional extensions of the binary support vector machine (SVM) to multiclass problems are either heuristics or require solving a large dual optimization problem. Here, a generalized multiclass SVM is proposed called GenSVM. In this method classification boundaries for a K-class proble

  16. Support Vector Machine-Based Nonlinear System Modeling and Control

    张浩然; 韩正之; 冯瑞; 于志强


    This paper provides an introduction to a support vector machine, a new kernel-based technique introduced in statistical learning theory and structural risk minimization, then presents a modeling-control framework based on SVM.At last a numerical experiment is taken to demonstrate the proposed approach's correctness and effectiveness.

  17. How supportive supervision influences immunization session site practices: a quasi-experimental study in Odisha, India

    Bhuputra Panda


    Full Text Available Background: Routine immunization (RI is a key child survival intervention. Ensuring acceptable standards of RI service delivery is critical for optimal outcomes. Accumulated evidences suggest that ‘supportive supervision’ improves the quality of health care services in general. During 2009–2010, the Government of Odisha and UNICEF jointly piloted this strategy in four districts to improve RI program outcomes. The present study aims to assess the effect of this strategy on improvement of skills and practices at immunization session sites. Design: A quasi-experimental ‘post-test only’ study design was adopted to compare the opinion and practices of frontline health workers and their supervisors in four intervention districts (IDs with two control districts (CDs. Altogether, we interviewed 111 supervisor–supervisee (health worker pairs using semi-structured interview schedules and case vignettes. We also directly observed health workers’ practices during immunization sessions at 111 sites. Data were analyzed with SPSS version 16.0. Results: The mean knowledge score of supervisors in CDs was significantly higher than in intervention groups. Variegated responses were obtained on case vignettes. The control group performed better in solving certain hypothetically asked problems, whereas the intervention group scored better in others. Health workers in IDs gave a lower rating to their respective supervisors’ knowledge, skill, and frequency of supervision. Logistics and vaccine availability were better in CDs. Conclusion: Notwithstanding other limitations, supportive supervision may not have independent effects on improving the quality of immunization services. Addressing systemic issues, such as the availability of essential logistics, supply chain management, timely indenting, and financial resources, could complement the supportive supervision strategy in improving immunization service delivery.

  18. Twin support vector machines models, extensions and applications

    Jayadeva; Chandra, Suresh


    This book provides a systematic and focused study of the various aspects of twin support vector machines (TWSVM) and related developments for classification and regression. In addition to presenting most of the basic models of TWSVM and twin support vector regression (TWSVR) available in the literature, it also discusses the important and challenging applications of this new machine learning methodology. A chapter on “Additional Topics” has been included to discuss kernel optimization and support tensor machine topics, which are comparatively new but have great potential in applications. It is primarily written for graduate students and researchers in the area of machine learning and related topics in computer science, mathematics, electrical engineering, management science and finance.

  19. Broiler chickens can benefit from machine learning: support vector machine analysis of observational epidemiological data.

    Hepworth, Philip J; Nefedov, Alexey V; Muchnik, Ilya B; Morgan, Kenton L


    Machine-learning algorithms pervade our daily lives. In epidemiology, supervised machine learning has the potential for classification, diagnosis and risk factor identification. Here, we report the use of support vector machine learning to identify the features associated with hock burn on commercial broiler farms, using routinely collected farm management data. These data lend themselves to analysis using machine-learning techniques. Hock burn, dermatitis of the skin over the hock, is an important indicator of broiler health and welfare. Remarkably, this classifier can predict the occurrence of high hock burn prevalence with accuracy of 0.78 on unseen data, as measured by the area under the receiver operating characteristic curve. We also compare the results with those obtained by standard multi-variable logistic regression and suggest that this technique provides new insights into the data. This novel application of a machine-learning algorithm, embedded in poultry management systems could offer significant improvements in broiler health and welfare worldwide.

  20. Using Doctoral Experience Survey Data to Support Developments in Postgraduate Supervision and Support

    Lucy Johnston


    Full Text Available Provision of both high standards of thesis supervision and high quality research environments are required for doctoral candidates to flourish. An important component of ensuring quality provision of research resources is the soliciting of feedback from research students and the provision from research supervisors and institutions of timely and constructive responses to such feedback. In this manuscript we describe the use of locally developed survey instruments to elicit student feedback. We then demonstrate how actions taken in response to this student feedback can help establish a virtuous circle that enhances doctoral students’ research experiences. We provide examples of changes to supervisory practice and resource allocation based on feedback and show the positive impact on subsequent student evaluations. While the examples included here are local, the issues considered and the methods and interventions developed are applicable to all institutions offering research degrees.

  1. Adaptive support vector regression for UAV flight control.

    Shin, Jongho; Jin Kim, H; Kim, Youdan


    This paper explores an application of support vector regression for adaptive control of an unmanned aerial vehicle (UAV). Unlike neural networks, support vector regression (SVR) generates global solutions, because SVR basically solves quadratic programming (QP) problems. With this advantage, the input-output feedback-linearized inverse dynamic model and the compensation term for the inversion error are identified off-line, which we call I-SVR (inversion SVR) and C-SVR (compensation SVR), respectively. In order to compensate for the inversion error and the unexpected uncertainty, an online adaptation algorithm for the C-SVR is proposed. Then, the stability of the overall error dynamics is analyzed by the uniformly ultimately bounded property in the nonlinear system theory. In order to validate the effectiveness of the proposed adaptive controller, numerical simulations are performed on the UAV model.

  2. Convex Decomposition Based Cluster Labeling Method for Support Vector Clustering

    Yuan Ping; Ying-Jie Tian; Ya-Jian Zhou; Yi-Xian Yang


    Support vector clustering (SVC) is an important boundary-based clustering algorithm in multiple applications for its capability of handling arbitrary cluster shapes. However,SVC's popularity is degraded by its highly intensive time complexity and poor label performance.To overcome such problems,we present a novel efficient and robust convex decomposition based cluster labeling (CDCL) method based on the topological property of dataset.The CDCL decomposes the implicit cluster into convex hulls and each one is comprised by a subset of support vectors (SVs).According to a robust algorithm applied in the nearest neighboring convex hulls,the adjacency matrix of convex hulls is built up for finding the connected components; and the remaining data points would be assigned the label of the nearest convex hull appropriately.The approach's validation is guaranteed by geometric proofs.Time complexity analysis and comparative experiments suggest that CDCL improves both the efficiency and clustering quality significantly.

  3. Study on Support Vector Machine Based on 1-Norm

    PAN Mei-qin; HE Guo-ping; HAN Cong-ying; XUE Xin; SHI You-qun


    The model of optimization problem for Support Vector Machine(SVM) is provided, which based on the definitions of the dual norm and the distance between a point and its projection onto a given plane. The model of improved Support Vector Machine based on 1-norm (1 - SVM) is provided from the optimization problem, yet it is a discrete programming. With the smoothing technique and optimality knowledge, the discrete programming is changed into a continuous programming. Experimental results show that the algorithm is easy to implement and this method can select and suppress the problem features more efficiently.Illustrative examples show that the 1 - SVM deal with the linear or nonlinear classification well.

  4. Support vector machine-based multi-model predictive control

    Zhejing BA; Youxian SUN


    In this paper,a support vector machine-based multi-model predictive control is proposed,in which SVM classification combines well with SVM regression.At first,each working environment is modeled by SVM regression and the support vector machine network-based model predictive control(SVMN-MPC)algorithm corresponding to each environment is developed,and then a multi-class SVM model is established to recognize multiple operating conditions.As for control,the current environment is identified by the multi-class SVM model and then the corresponding SVMN.MPCcontroller is activated at each sampling instant.The proposed modeling,switching and controller design is demonstrated in simulation results.

  5. A Novel Support Vector Machine with Globality-Locality Preserving

    Cheng-Long Ma


    Full Text Available Support vector machine (SVM is regarded as a powerful method for pattern classification. However, the solution of the primal optimal model of SVM is susceptible for class distribution and may result in a nonrobust solution. In order to overcome this shortcoming, an improved model, support vector machine with globality-locality preserving (GLPSVM, is proposed. It introduces globality-locality preserving into the standard SVM, which can preserve the manifold structure of the data space. We complete rich experiments on the UCI machine learning data sets. The results validate the effectiveness of the proposed model, especially on the Wine and Iris databases; the recognition rate is above 97% and outperforms all the algorithms that were developed from SVM.

  6. Monitoring Grinding Wheel Redress-life Using Support Vector Machines

    Xun Chen; Thitikorn Limchimchol


    Condition monitoring is a very important aspect in automated manufacturing processes. Any malfunction of a machining process will deteriorate production quality and efficiency. This paper presents an application of support vector machines in grinding process monitoring. The paper starts with an overview of grinding behaviour. Grinding force is analysed through a Short Time Fourier Transform (STFT) to identify features for condition monitoring. The Support Vector Machine (SVM) methodology is introduced as a powerful tool for the classification of different wheel wear situations.After training with available signal data, the SVM is able to identify the state of a grinding process. The requirement and strategy for using SVM for grinding process monitoring is discussed, while the result of the example illustrates how effective SVMs can be in determining wheel redress-life.

  7. Novel algorithm for constructing support vector machine regression ensemble

    Li Bo; Li Xinjun; Zhao Zhiyan


    A novel algorithm for constructing support vector machine regression ensemble is proposed. As to regression prediction, support vector machine regression(SVMR) ensemble is proposed by resampling from given training data sets repeatedly and aggregating several independent SVMRs, each of which is trained to use a replicated training set. After training, several independently trained SVMRs need to be aggregated in an appropriate combination manner. Generally, the linear weighting is usually used like expert weighting score in Boosting Regression and it is without optimization capacity. Three combination techniques are proposed, including simple arithmetic mean,linear least square error weighting and nonlinear hierarchical combining that uses another upper-layer SVMR to combine several lower-layer SVMRs. Finally, simulation experiments demonstrate the accuracy and validity of the presented algorithm.

  8. Sistem Deteksi Retinopati Diabetik Menggunakan Support Vector Machine

    Wahyudi Setiawan


    Full Text Available Diabetic Retinopathy is a complication of Diabetes Melitus. It can be a blindness if untreated settled as early as possible. System created in this thesis is the detection of diabetic retinopathy level of the image obtained from fundus photographs. There are three main steps to resolve the problems, preprocessing, feature extraction and classification. Preprocessing methods that used in this system are Grayscale Green Channel, Gaussian Filter, Contrast Limited Adaptive Histogram Equalization and Masking. Two Dimensional Linear Discriminant Analysis (2DLDA is used for feature extraction. Support Vector Machine (SVM is used for classification. The test result performed by taking a dataset of MESSIDOR with number of images that vary for the training phase, otherwise is used for the testing phase. Test result show the optimal accuracy are 84% .   Keywords : Diabetic Retinopathy, Support Vector Machine, Two Dimensional Linear Discriminant Analysis, MESSIDOR

  9. Evolutionary Support Vector Machines for Transient Stability Monitoring

    Dora Arul Selvi, B.; Kamaraj, N.


    Currently, power systems are in the need of fast and reliable contingency monitoring systems for the purpose of maintaining stability in the presence of deregulated and open market environment. In this paper, a quick and unfailing transient stability monitoring algorithm that considers both the symmetrical and unsymmetrical faults is presented. support vector machines (SVMs) are employed as pattern classifiers so as to construct fast relation mappings between the transient stability results and the selected input attributes using mutual information. The type of fault is recognized by a SVM classifier and the critical clearing time of the fault is estimated by a support vector regression machine. The SVM parameters are tuned by an elitist multi-objective non-dominated sorting genetic algorithm in such a manner that the best classification and regression performance are accomplished. To demonstrate the good potential of the scheme, IEEE 3 generator system and a South Indian Grid are utilized.

  10. Fault Isolation for Nonlinear Systems Using Flexible Support Vector Regression

    Yufang Liu


    Full Text Available While support vector regression is widely used as both a function approximating tool and a residual generator for nonlinear system fault isolation, a drawback for this method is the freedom in selecting model parameters. Moreover, for samples with discordant distributing complexities, the selection of reasonable parameters is even impossible. To alleviate this problem we introduce the method of flexible support vector regression (F-SVR, which is especially suited for modelling complicated sample distributions, as it is free from parameters selection. Reasonable parameters for F-SVR are automatically generated given a sample distribution. Lastly, we apply this method in the analysis of the fault isolation of high frequency power supplies, where satisfactory results have been obtained.

  11. Estimating coal reserves using a support vector machine

    LIU Wen-kai; WANG Rui-fang; ZHENG Xiao-juan


    The basic principles of the Support Vector Machine (SVM) are introduced in this paper. A specific process to establish an SVM prediction model is given. To improve the precision of coal reserve estimation, a support vector machine method, based on statistical learning theory, is put forward. The SVM model was trained and tested by using the existing exploration and exploitation data of Chencun mine of Yima bureau's as the input data. Then coal reserves within a particular region were calculated. These cal-culated results and the actual results of the exploration block were compared. The maximum relative error was 10.85%, within the scope of acceptable error limits. The results show that the SVM coal reserve calculation method is reliable. This method is simple, practical and valuable.

  12. Digital VLSI algorithms and architectures for support vector machines.

    Anguita, D; Boni, A; Ridella, S


    In this paper, we propose some very simple algorithms and architectures for a digital VLSI implementation of Support Vector Machines. We discuss the main aspects concerning the realization of the learning phase of SVMs, with special attention on the effects of fixed-point math for computing and storing the parameters of the network. Some experiments on two classification problems are described that show the efficiency of the proposed methods in reaching optimal solutions with reasonable hardware requirements.

  13. Saudi License Plate Recognition Algorithm Based on Support Vector Machine

    Khaled Suwais; Rana Al-Otaibi; Ali Alshahrani


    License plate recognition (LPR) is an image processing technology that is used to identify vehicles by their license plates. This paper presents a license plate recognition algorithm for Saudi car plates based on the support vector machine (SVM) algorithm. The new algorithm is efficient in recognizing the vehicles from the Arabic part of the plate. The performance of the system has been investigated and analyzed. The recognition accuracy of the algorithm is about 93.3%.

  14. Support vector regression-based internal model control

    HUANG Yan-wei; PENG Tie-gen


    This paper proposes a design of internal model control systems for process with delay by using support vector regression (SVR). The proposed system fully uses the excellent nonlinear estimation performance of SVR with the structural risk minimization principle. Closed-system stability and steady error are analyzed for the existence of modeling errors. The simulations show that the proposed control systems have the better control performance than that by neural networks in the cases of the training samples with small size and noises.

  15. Chord Recognition Based on Temporal Correlation Support Vector Machine

    Zhongyang Rao; Xin Guan; Jianfu Teng


    In this paper, we propose a method called temporal correlation support vector machine (TCSVM) for automatic major-minor chord recognition in audio music. We first use robust principal component analysis to separate the singing voice from the music to reduce the influence of the singing voice and consider the temporal correlations of the chord features. Using robust principal component analysis, we expect the low-rank component of the spectrogram matrix to contain the musical accompaniment and...

  16. Inverse Learning Control of Nonlinear Systems Using Support Vector Machines

    HU Zhong-hui; LI Yuan-gui; CAI Yun-ze; XU Xiao-ming


    An inverse learning control scheme using the support vector machine (SVM) for regression was proposed. The inverse learning approach is originally researched in the neural networks. Compared with neural networks, SVMs overcome the problems of local minimum and curse of dimensionality. Additionally, the good generalization performance of SVMs increases the robustness of control system. The method of designing SVM inverselearning controller was presented. The proposed method is demonstrated on tracking problems and the performance is satisfactory.

  17. Knowledge-based analysis of microarray gene expression data by using support vector machines

    William Grundy; Manuel Ares, Jr.; David Haussler


    The authors introduce a method of functionally classifying genes by using gene expression data from DNA microarray hybridization experiments. The method is based on the theory of support vector machines (SVMs). SVMs are considered a supervised computer learning method because they exploit prior knowledge of gene function to identify unknown genes of similar function from expression data. SVMs avoid several problems associated with unsupervised clustering methods, such as hierarchical clustering and self-organizing maps. SVMs have many mathematical features that make them attractive for gene expression analysis, including their flexibility in choosing a similarity function, sparseness of solution when dealing with large data sets, the ability to handle large feature spaces, and the ability to identify outliers. They test several SVMs that use different similarity metrics, as well as some other supervised learning methods, and find that the SVMs best identify sets of genes with a common function using expression data. Finally, they use SVMs to predict functional roles for uncharacterized yeast ORFs based on their expression data.

  18. Support vector based battery state of charge estimator

    Hansen, Terry; Wang, Chia-Jiu

    This paper investigates the use of a support vector machine (SVM) to estimate the state-of-charge (SOC) of a large-scale lithium-ion-polymer (LiP) battery pack. The SOC of a battery cannot be measured directly and must be estimated from measurable battery parameters such as current and voltage. The coulomb counting SOC estimator has been used in many applications but it has many drawbacks [S. Piller, M. Perrin, Methods for state-of-charge determination and their application, J. Power Sources 96 (2001) 113-120]. The proposed SVM based solution not only removes the drawbacks of the coulomb counting SOC estimator but also produces accurate SOC estimates, using industry standard US06 [V.H. Johnson, A.A. Pesaran, T. Sack, Temperature-dependent battery models for high-power lithium-ion batteries, in: Presented at the 17th Annual Electric Vehicle Symposium Montreal, Canada, October 15-18, 2000. The paper is downloadable at website] aggressive driving cycle test procedures. The proposed SOC estimator extracts support vectors from a battery operation history then uses only these support vectors to estimate SOC, resulting in minimal computation load and suitable for real-time embedded system applications.

  19. Optimized support vector regression for drilling rate of penetration estimation

    Bodaghi, Asadollah; Ansari, Hamid Reza; Gholami, Mahsa


    In the petroleum industry, drilling optimization involves the selection of operating conditions for achieving the desired depth with the minimum expenditure while requirements of personal safety, environment protection, adequate information of penetrated formations and productivity are fulfilled. Since drilling optimization is highly dependent on the rate of penetration (ROP), estimation of this parameter is of great importance during well planning. In this research, a novel approach called `optimized support vector regression' is employed for making a formulation between input variables and ROP. Algorithms used for optimizing the support vector regression are the genetic algorithm (GA) and the cuckoo search algorithm (CS). Optimization implementation improved the support vector regression performance by virtue of selecting proper values for its parameters. In order to evaluate the ability of optimization algorithms in enhancing SVR performance, their results were compared to the hybrid of pattern search and grid search (HPG) which is conventionally employed for optimizing SVR. The results demonstrated that the CS algorithm achieved further improvement on prediction accuracy of SVR compared to the GA and HPG as well. Moreover, the predictive model derived from back propagation neural network (BPNN), which is the traditional approach for estimating ROP, is selected for comparisons with CSSVR. The comparative results revealed the superiority of CSSVR. This study inferred that CSSVR is a viable option for precise estimation of ROP.

  20. Incremental learning for ν-Support Vector Regression.

    Gu, Bin; Sheng, Victor S; Wang, Zhijie; Ho, Derek; Osman, Said; Li, Shuo


    The ν-Support Vector Regression (ν-SVR) is an effective regression learning algorithm, which has the advantage of using a parameter ν on controlling the number of support vectors and adjusting the width of the tube automatically. However, compared to ν-Support Vector Classification (ν-SVC) (Schölkopf et al., 2000), ν-SVR introduces an additional linear term into its objective function. Thus, directly applying the accurate on-line ν-SVC algorithm (AONSVM) to ν-SVR will not generate an effective initial solution. It is the main challenge to design an incremental ν-SVR learning algorithm. To overcome this challenge, we propose a special procedure called initial adjustments in this paper. This procedure adjusts the weights of ν-SVC based on the Karush-Kuhn-Tucker (KKT) conditions to prepare an initial solution for the incremental learning. Combining the initial adjustments with the two steps of AONSVM produces an exact and effective incremental ν-SVR learning algorithm (INSVR). Theoretical analysis has proven the existence of the three key inverse matrices, which are the cornerstones of the three steps of INSVR (including the initial adjustments), respectively. The experiments on benchmark datasets demonstrate that INSVR can avoid the infeasible updating paths as far as possible, and successfully converges to the optimal solution. The results also show that INSVR is faster than batch ν-SVR algorithms with both cold and warm starts. Copyright © 2015 Elsevier Ltd. All rights reserved.

  1. Characterization of digital medical images utilizing support vector machines

    Zafiropoulos Elias P


    Full Text Available Abstract Background In this paper we discuss an efficient methodology for the image analysis and characterization of digital images containing skin lesions using Support Vector Machines and present the results of a preliminary study. Methods The methodology is based on the support vector machines algorithm for data classification and it has been applied to the problem of the recognition of malignant melanoma versus dysplastic naevus. Border and colour based features were extracted from digital images of skin lesions acquired under reproducible conditions, using basic image processing techniques. Two alternative classification methods, the statistical discriminant analysis and the application of neural networks were also applied to the same problem and the results are compared. Results The SVM (Support Vector Machines algorithm performed quite well achieving 94.1% correct classification, which is better than the performance of the other two classification methodologies. The method of discriminant analysis classified correctly 88% of cases (71% of Malignant Melanoma and 100% of Dysplastic Naevi, while the neural networks performed approximately the same. Conclusion The use of a computer-based system, like the one described in this paper, is intended to avoid human subjectivity and to perform specific tasks according to a number of criteria. However the presence of an expert dermatologist is considered necessary for the overall visual assessment of the skin lesion and the final diagnosis.

  2. Twin Support Vector Machine: A review from 2007 to 2014

    Divya Tomar


    Full Text Available Twin Support Vector Machine (TWSVM is an emerging machine learning method suitable for both classification and regression problems. It utilizes the concept of Generalized Eigen-values Proximal Support Vector Machine (GEPSVM and finds two non-parallel planes for each class by solving a pair of Quadratic Programming Problems. It enhances the computational speed as compared to the traditional Support Vector Machine (SVM. TWSVM was initially constructed to solve binary classification problems; later researchers successfully extended it for multi-class problem domain. TWSVM always gives promising empirical results, due to which it has many attractive features which enhance its applicability. This paper presents the research development of TWSVM in recent years. This study is divided into two main broad categories - variant based and multi-class based TWSVM methods. The paper primarily discusses the basic concept of TWSVM and highlights its applications in recent years. A comparative analysis of various research contributions based on TWSVM is also presented. This is helpful for researchers to effectively utilize the TWSVM as an emergent research methodology and encourage them to work further in the performance enhancement of TWSVM.

  3. Approximate entropy and support vector machines for electroencephalogram signal classification*****

    Zhen Zhang; Yi Zhou; Ziyi Chen; Xianghua Tian; Shouhong Du; Ruimei Huang


    The automatic detection and identification of electroencephalogram waves play an important role in the prediction, diagnosis and treatment of epileptic seizures. In this study, a nonlinear dynamics index-approximate entropy and a support vector machine that has strong generalization ability were applied to classify electroencephalogram signals at epileptic interictal and ictal periods. Our aim was to verify whether approximate entropy waves can be effectively applied to the automatic real-time detection of epilepsy in the electroencephalogram, and to explore its generalization ability as a classifier trained using a nonlinear dynamics index. Four patients presenting with partial epi-leptic seizures were included in this study. They were al diagnosed with neocortex localized epi-lepsy and epileptic foci were clearly observed by electroencephalogram. The electroencephalogram data form the four involved patients were segmented and the characteristic values of each segment, that is, the approximate entropy, were extracted. The support vector machine classifier was con-structed with the approximate entropy extracted from one epileptic case, and then electroence-phalogram waves of the other three cases were classified, reaching a 93.33%accuracy rate. Our findings suggest that the use of approximate entropy al ows the automatic real-time detection of electroencephalogram data in epileptic cases. The combination of approximate entropy and support vector machines shows good generalization ability for the classification of electroencephalogram signals for epilepsy.

  4. Using group supervision and social annotation systems to support students’ academic writing

    Daniel Pargman


    Full Text Available In this best practice paper, we present how we have used a Social annotation system (SAS in a bachelor’s thesis course in media technology to support students’ academic writing. In the paper, we reflect on both technical and social practices with using SAS. Despite limited instructional support and despite the fact that different groups used SAS in different ways, there have been a high completion rate, good quality of the theses and satisfied students. The combination of group supervision and the use of SAS has been successful, especially when taking into consideration that this was the first year we broadly introduced SAS in the bachelor’s thesis course. 

  5. Vision-Based Perception and Classification of Mosquitoes Using Support Vector Machine

    Masataka Fuchida


    Full Text Available The need for a novel automated mosquito perception and classification method is becoming increasingly essential in recent years, with steeply increasing number of mosquito-borne diseases and associated casualties. There exist remote sensing and GIS-based methods for mapping potential mosquito inhabitants and locations that are prone to mosquito-borne diseases, but these methods generally do not account for species-wise identification of mosquitoes in closed-perimeter regions. Traditional methods for mosquito classification involve highly manual processes requiring tedious sample collection and supervised laboratory analysis. In this research work, we present the design and experimental validation of an automated vision-based mosquito classification module that can deploy in closed-perimeter mosquito inhabitants. The module is capable of identifying mosquitoes from other bugs such as bees and flies by extracting the morphological features, followed by support vector machine-based classification. In addition, this paper presents the results of three variants of support vector machine classifier in the context of mosquito classification problem. This vision-based approach to the mosquito classification problem presents an efficient alternative to the conventional methods for mosquito surveillance, mapping and sample image collection. Experimental results involving classification between mosquitoes and a predefined set of other bugs using multiple classification strategies demonstrate the efficacy and validity of the proposed approach with a maximum recall of 98%.

  6. Application of support vector machines for copper potential mapping in Kerman region, Iran

    Shabankareh, Mahdi; Hezarkhani, Ardeshir


    The first step in systematic exploration studies is mineral potential mapping, which involves classification of the study area to favorable and unfavorable parts. Support vector machines (SVM) are designed for supervised classification based on statistical learning theory. This method named support vector classification (SVC). This paper describes SVC model, which combine exploration data in the regional-scale for copper potential mapping in Kerman copper bearing belt in south of Iran. Data layers or evidential maps were in six datasets namely lithology, tectonic, airborne geophysics, ferric alteration, hydroxide alteration and geochemistry. The SVC modeling result selected 2220 pixels as favorable zones, approximately 25 percent of the study area. Besides, 66 out of 86 copper indices, approximately 78.6% of all, were located in favorable zones. Other main goal of this study was to determine how each input affects favorable output. For this purpose, the histogram of each normalized input data to its favorable output was drawn. The histograms of each input dataset for favorable output showed that each information layer had a certain pattern. These patterns of SVC results could be considered as regional copper exploration characteristics.

  7. A least square support vector machine-based approach for contingency classification and ranking in a large power system

    Bhanu Pratap Soni


    Full Text Available This paper proposes an effective supervised learning approach for static security assessment of a large power system. Supervised learning approach employs least square support vector machine (LS-SVM to rank the contingencies and predict the system severity level. The severity of the contingency is measured by two scalar performance indices (PIs: line MVA performance index (PIMVA and Voltage-reactive power performance index (PIVQ. SVM works in two steps. Step I is the estimation of both standard indices (PIMVA and PIVQ that is carried out under different operating scenarios and Step II contingency ranking is carried out based on the values of PIs. The effectiveness of the proposed methodology is demonstrated on IEEE 39-bus (New England system. The approach can be beneficial tool which is less time consuming and accurate security assessment and contingency analysis at energy management center.

  8. Chord Recognition Based on Temporal Correlation Support Vector Machine

    Zhongyang Rao


    Full Text Available In this paper, we propose a method called temporal correlation support vector machine (TCSVM for automatic major-minor chord recognition in audio music. We first use robust principal component analysis to separate the singing voice from the music to reduce the influence of the singing voice and consider the temporal correlations of the chord features. Using robust principal component analysis, we expect the low-rank component of the spectrogram matrix to contain the musical accompaniment and the sparse component to contain the vocal signals. Then, we extract a new logarithmic pitch class profile (LPCP feature called enhanced LPCP from the low-rank part. To exploit the temporal correlation among the LPCP features of chords, we propose an improved support vector machine algorithm called TCSVM. We perform this study using the MIREX’09 (Music Information Retrieval Evaluation eXchange Audio Chord Estimation dataset. Furthermore, we conduct comprehensive experiments using different pitch class profile feature vectors to examine the performance of TCSVM. The results of our method are comparable to the state-of-the-art methods that entered the MIREX in 2013 and 2014 for the MIREX’09 Audio Chord Estimation task dataset.

  9. Scorebox extraction from mobile sports videos using Support Vector Machines

    Kim, Wonjun; Park, Jimin; Kim, Changick


    Scorebox plays an important role in understanding contents of sports videos. However, the tiny scorebox may give the small-display-viewers uncomfortable experience in grasping the game situation. In this paper, we propose a novel framework to extract the scorebox from sports video frames. We first extract candidates by using accumulated intensity and edge information after short learning period. Since there are various types of scoreboxes inserted in sports videos, multiple attributes need to be used for efficient extraction. Based on those attributes, the optimal information gain is computed and top three ranked attributes in terms of information gain are selected as a three-dimensional feature vector for Support Vector Machines (SVM) to distinguish the scorebox from other candidates, such as logos and advertisement boards. The proposed method is tested on various videos of sports games and experimental results show the efficiency and robustness of our proposed method.

  10. A new support vector machine based multiuser detection scheme

    WANG Yong-jian; ZHAO Hong-lin


    In order to suppress the multiple access interference(MAI)in 3G,which limits the capacity of a CDMA communication system,a fast relevance vector machine(FRVM)is employed in the muhinser detection (MUD)scheme.This method aims to overcome the shortcomings of many ordinary support vector machine (SVM)based MUD schemes,such as the long training time and the inaccuracy of the decision data,and enhance the performance of a CDMA communication system.Computer simulation results demonstrate that the proposed FRVM based muhiuser detection has lower bit error rate,costs short training time,needs fewer kernel functions and possesses better near-far resistance.

  11. Mandarin Digits Speech Recognition Using Support Vector Machines

    XIE Xiang; KUANG Jing-ming


    A method of applying support vector machine (SVM) in speech recognition was proposed, and a speech recognition system for mandarin digits was built up by SVMs. In the system, vectors were linearly extracted from speech feature sequence to make up time-aligned input patterns for SVM, and the decisions of several 2-class SVM classifiers were employed for constructing an N-class classifier. Four kinds of SVM kernel functions were compared in the experiments of speaker-independent speech recognition of mandarin digits. And the kernel of radial basis function has the highest accurate rate of 99.33%, which is better than that of the baseline system based on hidden Markov models (HMM) (97.08%). And the experiments also show that SVM can outperform HMM especially when the samples for learning were very limited.

  12. Image Reconstruction Using Multi Layer Perceptron MLP And Support Vector Machine SVM Classifier And Study Of Classification Accuracy

    Shovasis Kumar Biswas


    Full Text Available Abstract Support Vector Machine SVM and back-propagation neural network BPNN has been applied successfully in many areas for example rule extraction classification and evaluation. In this paper we studied the back-propagation algorithm for training the multilayer artificial neural network and a support vector machine for data classification and image reconstruction aspects. A model focused on SVM with Gaussian RBF kernel is utilized here for data classification. Back propagation neural network is viewed as one of the most straightforward and is most general methods used for supervised training of multilayered neural network. We compared a support vector machine SVM with a back-propagation neural network BPNN for the task of data classification and image reconstruction. We made a comparison between the performances of the multi-class classification of these two learning methods. Comparing with these two methods we can conclude that the classification accuracy of the support vector machine is better and algorithm is much faster than the MLP with back propagation algorithm.

  13. The Ability–Motivation–Opportunity Framework for Team Innovation: Efficacy Beliefs, Proactive Personalities, Supportive Supervision and Team Innovation

    Jana Krapež Trošt


    Full Text Available Based on ability–motivation–opportunity theoretical framework, the study explores the interplay among team members’ proactive personalities (abilities, collective efficacy (motivation, and supportive supervision (opportunity, and their interaction in predicting team innovation. Multi-level study of 249 employees nested within 64 teams from one German and three Slovenian hi-tech companies showed that collective efficacy was positively related to team innovation. However, the effect of collective efficacy on team innovation was weaker when high levels of supportive supervision and proactivity moderated this relationship. When teams perceived lower levels of collective efficacy, team proactivity, and supportive supervision were more important for achieving higher levels of team innovation as they were when teams perceived lower levels of motivation. We discuss theoretical and practical implications

  14. Support Vector Machines for decision support in electricity markets׳ strategic bidding

    Pinto, Tiago; Sousa, Tiago M.; Praça, Isabel


    . The ALBidS system allows MASCEM market negotiating players to take the best possible advantages from the market context. This paper presents the application of a Support Vector Machines (SVM) based approach to provide decision support to electricity market players. This strategy is tested and validated...... – Iberian market operator....

  15. Twin Support Vector Machine for Multiple Instance Learning Based on Bag Dissimilarities

    Divya Tomar


    Full Text Available In multiple instance learning (MIL framework, an object is represented by a set of instances referred to as bag. A positive class label is assigned to a bag if it contains at least one positive instance; otherwise a bag is labeled with negative class label. Therefore, the task of MIL is to learn a classifier at bag level rather than at instance level. Traditional supervised learning approaches cannot be applied directly in such kind of situation. In this study, we represent each bag by a vector of its dissimilarities to the other existing bags in the training dataset and propose a multiple instance learning based Twin Support Vector Machine (MIL-TWSVM classifier. We have used different ways to represent the dissimilarity between two bags and performed a comparative analysis of them. The experimental results on ten benchmark MIL datasets demonstrate that the proposed MIL-TWSVM classifier is computationally inexpensive and competitive with state-of-the-art approaches. The significance of the experimental results has been tested by using Friedman statistic and Nemenyi post hoc tests.

  16. An adaptive online learning approach for Support Vector Regression: Online-SVR-FID

    Liu, Jie; Zio, Enrico


    Support Vector Regression (SVR) is a popular supervised data-driven approach for building empirical models from available data. Like all data-driven methods, under non-stationary environmental and operational conditions it needs to be provided with adaptive learning capabilities, which might become computationally burdensome with large datasets cumulating dynamically. In this paper, a cost-efficient online adaptive learning approach is proposed for SVR by combining Feature Vector Selection (FVS) and Incremental and Decremental Learning. The proposed approach adaptively modifies the model only when different pattern drifts are detected according to proposed criteria. Two tolerance parameters are introduced in the approach to control the computational complexity, reduce the influence of the intrinsic noise in the data and avoid the overfitting problem of SVR. Comparisons of the prediction results is made with other online learning approaches e.g. NORMA, SOGA, KRLS, Incremental Learning, on several artificial datasets and a real case study concerning time series prediction based on data recorded on a component of a nuclear power generation system. The performance indicators MSE and MARE computed on the test dataset demonstrate the efficiency of the proposed online learning method.

  17. Clinical supervision.

    Goorapah, D


    The introduction of clinical supervision to a wider sphere of nursing is being considered from a professional and organizational point of view. Positive views are being expressed about adopting this concept, although there are indications to suggest that there are also strong reservations. This paper examines the potential for its success amidst the scepticism that exists. One important question raised is whether clinical supervision will replace or run alongside other support systems.

  18. Support vector classification algorithm based on variable parameter linear programming

    Xiao Jianhua; Lin Jian


    To solve the problems of SVM in dealing with large sample size and asymmetric distributed samples, a support vector classification algorithm based on variable parameter linear programming is proposed.In the proposed algorithm, linear programming is employed to solve the optimization problem of classification to decrease the computation time and to reduce its complexity when compared with the original model.The adjusted punishment parameter greatly reduced the classification error resulting from asymmetric distributed samples and the detailed procedure of the proposed algorithm is given.An experiment is conducted to verify whether the proposed algorithm is suitable for asymmetric distributed samples.

  19. Cardiovascular Response Identification Based on Nonlinear Support Vector Regression

    Wang, Lu; Su, Steven W.; Chan, Gregory S. H.; Celler, Branko G.; Cheng, Teddy M.; Savkin, Andrey V.

    This study experimentally investigates the relationships between central cardiovascular variables and oxygen uptake based on nonlinear analysis and modeling. Ten healthy subjects were studied using cycle-ergometry exercise tests with constant workloads ranging from 25 Watt to 125 Watt. Breath by breath gas exchange, heart rate, cardiac output, stroke volume and blood pressure were measured at each stage. The modeling results proved that the nonlinear modeling method (Support Vector Regression) outperforms traditional regression method (reducing Estimation Error between 59% and 80%, reducing Testing Error between 53% and 72%) and is the ideal approach in the modeling of physiological data, especially with small training data set.

  20. Optimization of Support Vector Machine (SVM) for Object Classification

    Scholten, Matthew; Dhingra, Neil; Lu, Thomas T.; Chao, Tien-Hsin


    The Support Vector Machine (SVM) is a powerful algorithm, useful in classifying data into species. The SVMs implemented in this research were used as classifiers for the final stage in a Multistage Automatic Target Recognition (ATR) system. A single kernel SVM known as SVMlight, and a modified version known as a SVM with K-Means Clustering were used. These SVM algorithms were tested as classifiers under varying conditions. Image noise levels varied, and the orientation of the targets changed. The classifiers were then optimized to demonstrate their maximum potential as classifiers. Results demonstrate the reliability of SVM as a method for classification. From trial to trial, SVM produces consistent results.



    The Least Squares Support Vector Machines (LS-SVM) is an improvement to the SVM.Combined the LS-SVM with the Multi-Resolution Analysis (MRA), this letter proposes the Multi-resolution LS-SVM (MLS-SVM). The proposed algorithm has the same theoretical framework as MRA but with better approximation ability. At a fixed scale MLS-SVM is a classical LS-SVM, but MLS-SVM can gradually approximate the target function at different scales. In experiments, the MLS-SVM is used for nonlinear system identification, and achieves better identification accuracy.

  2. Debris Flow Hazard Assessment Based on Support Vector Machine

    YUAN Lifeng; ZHANG Youshui


    Seven factors, including the maximum volume of once flow , occurrence frequency of debris flow , watershed area , main channel length , watershed relative height difference , valley incision density and the length ratio of sediment supplement are chosen as evaluation factors of debris flow hazard degree. Using support vector machine (SVM) theory, we selected 259 basic data of 37 debris flow channels in Yunnan Province as learning samples in this study. We create a debris flow hazard assessment model based on SVM. The model was validated though instance applications and showed encouraging results.

  3. Support vector machine for predicting protein interactions using domain scores

    PENG Xin-jun; WANG Yi-fei


    Protein-protein interactions play a crucial role in the cellular process such as metabolic pathways and immunological recognition. This paper presents a new domain score-based support vector machine (SVM) to infer protein interactions, which can be used not only to explore all possible domain interactions by the kernel method, but also to reflect the evolutionary conservation of domains in proteins by using the domain scores of proteins. The experimental result on the Saccharomyces cerevisiae dataset demonstrates that this approach can predict protein-protein interactions with higher performances compared to the existing approaches.

  4. Estimation of underdetermined mixing matrix based on support vector machine


    In underdetermined blind source separation (BSS), a novel algorithm based on extended support vector machine(SVM) is proposed to estimate the mixing matrix in this paper, including the number of the active sources. Instead of traditional clustering algorithms, it mainly takes the modulus of observations and the number in each direction of arrival, without any prior knowledge about the sources except for sparsity, and it is not sensitive to the initial values. Simulations are given to illustrate availability and robustness of our algorithm.

  5. Support vector machine classifiers for large data sets.

    Gertz, E. M.; Griffin, J. D.


    This report concerns the generation of support vector machine classifiers for solving the pattern recognition problem in machine learning. Several methods are proposed based on interior point methods for convex quadratic programming. Software implementations are developed by adapting the object-oriented packaging OOQP to the problem structure and by using the software package PETSc to perform time-intensive computations in a distributed setting. Linear systems arising from classification problems with moderately large numbers of features are solved by using two techniques--one a parallel direct solver, the other a Krylov-subspace method incorporating novel preconditioning strategies. Numerical results are provided, and computational experience is discussed.

  6. Cross-Validation, Bootstrap, and Support Vector Machines

    Masaaki Tsujitani


    Full Text Available This paper considers the applications of resampling methods to support vector machines (SVMs. We take into account the leaving-one-out cross-validation (CV when determining the optimum tuning parameters and bootstrapping the deviance in order to summarize the measure of goodness-of-fit in SVMs. The leaving-one-out CV is also adapted in order to provide estimates of the bias of the excess error in a prediction rule constructed with training samples. We analyze the data from a mackerel-egg survey and a liver-disease study.

  7. Hybrid Optimization of Support Vector Machine for Intrusion Detection

    XI Fu-li; YU Song-nian; HAO Wei


    Support vector machine (SVM) technique has recently become a research focus in intrusion detection field for its better generalization performance when given less priori knowledge than other soft-computing techniques. But the randomicity of parameter selection in its implement often prevents it achieving expected performance. By utilizing genetic algorithm (GA) to optimize the parameters in data preprocessing and the training model of SVM simultaneously, a hybrid optimization algorithm is proposed in the paper to address this problem. The experimental results demonstrate that it's an effective method and can improve the perfornance of SVM-based intrusion detection system further.

  8. Probability output of multi-class support vector machines

    忻栋; 吴朝晖; 潘云鹤


    A novel approach to interpret the outputs of multi-class support vector machines is proposed in this paper. Using the geometrical interpretation of the classifying heperplane and the distance of the pattern from the hyperplane, one can calculate the posterior probability in binary classification case. This paper focuses on the probability output in multi-class phase where both the one-against-one and one-against-rest strategies are considered. Experiment on the speaker verification showed that this method has high performance.

  9. Slope Deformation Prediction Based on Support Vector Machine

    Lei JIA


    Full Text Available This paper principally studies the prediction of slope deformation based on Support Vector Machine (SVM. In the prediction process,explore how to reconstruct the phase space. The geological body’s displacement data obtained from chaotic time series are used as SVM’s training samples. Slope displacement caused by multivariable coupling is predicted by means of single variable. Results show that this model is of high fitting accuracy and generalization, and provides reference for deformation prediction in slope engineering.

  10. Recursive Feature Selection with Significant Variables of Support Vectors

    Chen-An Tsai


    Full Text Available The development of DNA microarray makes researchers screen thousands of genes simultaneously and it also helps determine high- and low-expression level genes in normal and disease tissues. Selecting relevant genes for cancer classification is an important issue. Most of the gene selection methods use univariate ranking criteria and arbitrarily choose a threshold to choose genes. However, the parameter setting may not be compatible to the selected classification algorithms. In this paper, we propose a new gene selection method (SVM-t based on the use of t-statistics embedded in support vector machine. We compared the performance to two similar SVM-based methods: SVM recursive feature elimination (SVMRFE and recursive support vector machine (RSVM. The three methods were compared based on extensive simulation experiments and analyses of two published microarray datasets. In the simulation experiments, we found that the proposed method is more robust in selecting informative genes than SVMRFE and RSVM and capable to attain good classification performance when the variations of informative and noninformative genes are different. In the analysis of two microarray datasets, the proposed method yields better performance in identifying fewer genes with good prediction accuracy, compared to SVMRFE and RSVM.

  11. Novel cascade FPGA accelerator for support vector machines classification.

    Papadonikolakis, Markos; Bouganis, Christos-Savvas


    Support vector machines (SVMs) are a powerful machine learning tool, providing state-of-the-art accuracy to many classification problems. However, SVM classification is a computationally complex task, suffering from linear dependencies on the number of the support vectors and the problem's dimensionality. This paper presents a fully scalable field programmable gate array (FPGA) architecture for the acceleration of SVM classification, which exploits the device heterogeneity and the dynamic range diversities among the dataset attributes. An adaptive and fully-customized processing unit is proposed, which utilizes the available heterogeneous resources of a modern FPGA device in efficient way with respect to the problem's characteristics. The implementation results demonstrate the efficiency of the heterogeneous architecture, presenting a speed-up factor of 2-3 orders of magnitude, compared to the CPU implementation. The proposed architecture outperforms other proposed FPGA and graphic processor unit approaches by more than seven times. Furthermore, based on the special properties of the heterogeneous architecture, this paper introduces the first FPGA-oriented cascade SVM classifier scheme, which exploits the FPGA reconfigurability and intensifies the custom-arithmetic properties of the heterogeneous architecture. The results show that the proposed cascade scheme is able to increase the heterogeneous classifier throughput even further, without introducing any penalty on the resource utilization.

  12. Biologically relevant neural network architectures for support vector machines.

    Jändel, Magnus


    Neural network architectures that implement support vector machines (SVM) are investigated for the purpose of modeling perceptual one-shot learning in biological organisms. A family of SVM algorithms including variants of maximum margin, 1-norm, 2-norm and ν-SVM is considered. SVM training rules adapted for neural computation are derived. It is found that competitive queuing memory (CQM) is ideal for storing and retrieving support vectors. Several different CQM-based neural architectures are examined for each SVM algorithm. Although most of the sixty-four scanned architectures are unconvincing for biological modeling four feasible candidates are found. The seemingly complex learning rule of a full ν-SVM implementation finds a particularly simple and natural implementation in bisymmetric architectures. Since CQM-like neural structures are thought to encode skilled action sequences and bisymmetry is ubiquitous in motor systems it is speculated that trainable pattern recognition in low-level perception has evolved as an internalized motor programme. Copyright © 2013 Elsevier Ltd. All rights reserved.

  13. Least squares weighted twin support vector machines with local information

    花小朋; 徐森; 李先锋


    A least squares version of the recently proposed weighted twin support vector machine with local information (WLTSVM) for binary classification is formulated. This formulation leads to an extremely simple and fast algorithm, called least squares weighted twin support vector machine with local information (LSWLTSVM), for generating binary classifiers based on two non-parallel hyperplanes. Two modified primal problems of WLTSVM are attempted to solve, instead of two dual problems usually solved. The solution of the two modified problems reduces to solving just two systems of linear equations as opposed to solving two quadratic programming problems along with two systems of linear equations in WLTSVM. Moreover, two extra modifications were proposed in LSWLTSVM to improve the generalization capability. One is that a hot kernel function, not the simple-minded definition in WLTSVM, is used to define the weight matrix of adjacency graph, which ensures that the underlying similarity information between any pair of data points in the same class can be fully reflected. The other is that the weight for each point in the contrary class is considered in constructing equality constraints, which makes LSWLTSVM less sensitive to noise points than WLTSVM. Experimental results indicate that LSWLTSVM has comparable classification accuracy to that of WLTSVM but with remarkably less computational time.

  14. Clifford support vector machines for classification, regression, and recurrence.

    Bayro-Corrochano, Eduardo Jose; Arana-Daniel, Nancy


    This paper introduces the Clifford support vector machines (CSVM) as a generalization of the real and complex-valued support vector machines using the Clifford geometric algebra. In this framework, we handle the design of kernels involving the Clifford or geometric product. In this approach, one redefines the optimization variables as multivectors. This allows us to have a multivector as output. Therefore, we can represent multiple classes according to the dimension of the geometric algebra in which we work. We show that one can apply CSVM for classification and regression and also to build a recurrent CSVM. The CSVM is an attractive approach for the multiple input multiple output processing of high-dimensional geometric entities. We carried out comparisons between CSVM and the current approaches to solve multiclass classification and regression. We also study the performance of the recurrent CSVM with experiments involving time series. The authors believe that this paper can be of great use for researchers and practitioners interested in multiclass hypercomplex computing, particularly for applications in complex and quaternion signal and image processing, satellite control, neurocomputation, pattern recognition, computer vision, augmented virtual reality, robotics, and humanoids.

  15. Support Vector Machine Classification of Drunk Driving Behaviour

    Chen, Huiqin; Chen, Lei


    Alcohol is the root cause of numerous traffic accidents due to its pharmacological action on the human central nervous system. This study conducted a detection process to distinguish drunk driving from normal driving under simulated driving conditions. The classification was performed by a support vector machine (SVM) classifier trained to distinguish between these two classes by integrating both driving performance and physiological measurements. In addition, principal component analysis was conducted to rank the weights of the features. The standard deviation of R–R intervals (SDNN), the root mean square value of the difference of the adjacent R–R interval series (RMSSD), low frequency (LF), high frequency (HF), the ratio of the low and high frequencies (LF/HF), and average blink duration were the highest weighted features in the study. The results show that SVM classification can successfully distinguish drunk driving from normal driving with an accuracy of 70%. The driving performance data and the physiological measurements reported by this paper combined with air-alcohol concentration could be integrated using the support vector regression classification method to establish a better early warning model, thereby improving vehicle safety.

  16. A Novel Kernel for Least Squares Support Vector Machine

    FENG Wei; ZHAO Yong-ping; DU Zhong-hua; LI De-cai; WANG Li-feng


    Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.

  17. Reducing Support Vector Machine Classification Error by Implementing Kalman Filter

    Muhsin Hassan


    Full Text Available The aim of this is to demonstrate the capability of Kalman Filter to reduce Support Vector Machine classification errors in classifying pipeline corrosion depth. In pipeline defect classification, it is important to increase the accuracy of the SVM classification so that one can avoid misclassification which can lead to greater problems in monitoring pipeline defect and prediction of pipeline leakage. In this paper, it is found that noisy data can greatly affect the performance of SVM. Hence, Kalman Filter + SVM hybrid technique has been proposed as a solution to reduce SVM classification errors. The datasets has been added with Additive White Gaussian Noise in several stages to study the effect of noise on SVM classification accuracy. Three techniques have been studied in this experiment, namely SVM, hybrid of Discrete Wavelet Transform + SVM and hybrid of Kalman Filter + SVM. Experiment results have been compared to find the most promising techniques among them. MATLAB simulations show Kalman Filter and Support Vector Machine combination in a single system produced higher accuracy compared to the other two techniques.

  18. Support Vector Machine Classification of Drunk Driving Behaviour

    Huiqin Chen


    Full Text Available Alcohol is the root cause of numerous traffic accidents due to its pharmacological action on the human central nervous system. This study conducted a detection process to distinguish drunk driving from normal driving under simulated driving conditions. The classification was performed by a support vector machine (SVM classifier trained to distinguish between these two classes by integrating both driving performance and physiological measurements. In addition, principal component analysis was conducted to rank the weights of the features. The standard deviation of R–R intervals (SDNN, the root mean square value of the difference of the adjacent R–R interval series (RMSSD, low frequency (LF, high frequency (HF, the ratio of the low and high frequencies (LF/HF, and average blink duration were the highest weighted features in the study. The results show that SVM classification can successfully distinguish drunk driving from normal driving with an accuracy of 70%. The driving performance data and the physiological measurements reported by this paper combined with air-alcohol concentration could be integrated using the support vector regression classification method to establish a better early warning model, thereby improving vehicle safety.

  19. Support Vector Machine Classification of Drunk Driving Behaviour.

    Chen, Huiqin; Chen, Lei


    Alcohol is the root cause of numerous traffic accidents due to its pharmacological action on the human central nervous system. This study conducted a detection process to distinguish drunk driving from normal driving under simulated driving conditions. The classification was performed by a support vector machine (SVM) classifier trained to distinguish between these two classes by integrating both driving performance and physiological measurements. In addition, principal component analysis was conducted to rank the weights of the features. The standard deviation of R-R intervals (SDNN), the root mean square value of the difference of the adjacent R-R interval series (RMSSD), low frequency (LF), high frequency (HF), the ratio of the low and high frequencies (LF/HF), and average blink duration were the highest weighted features in the study. The results show that SVM classification can successfully distinguish drunk driving from normal driving with an accuracy of 70%. The driving performance data and the physiological measurements reported by this paper combined with air-alcohol concentration could be integrated using the support vector regression classification method to establish a better early warning model, thereby improving vehicle safety.

  20. Support Vector Machine Diagnosis of Acute Abdominal Pain

    Björnsdotter, Malin; Nalin, Kajsa; Hansson, Lars-Erik; Malmgren, Helge

    This study explores the feasibility of a decision-support system for patients seeking care for acute abdominal pain, and, specifically the diagnosis of acute diverticulitis. We used a linear support vector machine (SVM) to separate diverticulitis from all other reported cases of abdominal pain and from the important differential diagnosis non-specific abdominal pain (NSAP). On a database containing 3337 patients, the SVM obtained results comparable to those of the doctors in separating diverticulitis or NSAP from the remaining diseases. The distinction between diverticulitis and NSAP was, however, substantially improved by the SVM. For this patient group, the doctors achieved a sensitivity of 0.714 and a specificity of 0.963. When adjusted to the physicians' results, the SVM sensitivity/specificity was higher at 0.714/0.985 and 0.786/0.963 respectively. Age was found as the most important discriminative variable, closely followed by C-reactive protein level and lower left side pain.

  1. Enhancing the Doctoral Journey: The Role of Group Supervision in Supporting Collaborative Learning and Creativity

    Fenge, Lee-Ann


    This article explores the role of group supervision within doctoral education, offering an exploration of the experience of group supervision processes through a small-scale study evaluating both student and staff experience across three cohorts of one professional doctorate programme. There has been very little research to date exploring…

  2. What is the right time for supportive versus expressive interventions in supervision? An illustration based on a clinical mistake.

    Leibovich, Liat; Zilcha-Mano, Sigal


    Although supportive-expressive (SE) psychotherapy is one of the most studied psychodynamic therapies today, little is known empirically about effective strategies in SE supervision, or in psychodynamic supervision in general (Diener & Mesrie, 2015; Watkins, 2011). One of the important questions in SE psychotherapy is how to decide when to use supportive and when to use expressive interventions. As a parallel process, this type of decision is relevant also to SE supervision. The present case study focuses on the decision-making process in an SE supervision session: when should supervisors use supportive as opposed to expressive strategies with their supervisees? Our aim is to develop decision rules that reliably support supervisors' decisions. We analyze a clinical error made by supervisors in this type of decision making, and show how mistakes of this type can either be avoided or, when they occur, how to turn them into opportunities for learning and for the formation of new understanding and growth. Similarly to the finding that therapists with better skills in managing their countertransference feelings were shown to have better outcomes with their patients (Gelso, Latts, Gomez, & Fassinger, 2002; Hayes, Gelso, & Hummel, 2011), we suggest that the management of the supervisors' feelings, and working through their mistakes with the therapists, can contribute to the supervisory relationship and to the development of the psychodynamic therapists' skills. (PsycINFO Database Record

  3. A comparative study of slope failure prediction using logistic regression, support vector machine and least square support vector machine models

    Zhou, Lim Yi; Shan, Fam Pei; Shimizu, Kunio; Imoto, Tomoaki; Lateh, Habibah; Peng, Koay Swee


    A comparative study of logistic regression, support vector machine (SVM) and least square support vector machine (LSSVM) models has been done to predict the slope failure (landslide) along East-West Highway (Gerik-Jeli). The effects of two monsoon seasons (southwest and northeast) that occur in Malaysia are considered in this study. Two related factors of occurrence of slope failure are included in this study: rainfall and underground water. For each method, two predictive models are constructed, namely SOUTHWEST and NORTHEAST models. Based on the results obtained from logistic regression models, two factors (rainfall and underground water level) contribute to the occurrence of slope failure. The accuracies of the three statistical models for two monsoon seasons are verified by using Relative Operating Characteristics curves. The validation results showed that all models produced prediction of high accuracy. For the results of SVM and LSSVM, the models using RBF kernel showed better prediction compared to the models using linear kernel. The comparative results showed that, for SOUTHWEST models, three statistical models have relatively similar performance. For NORTHEAST models, logistic regression has the best predictive efficiency whereas the SVM model has the second best predictive efficiency.

  4. Using support vector machines for anomalous change detonation

    Theiler, James P [Los Alamos National Laboratory; Steinwart, Ingo [UNIV STUTTGART; Llamocca, Daniel [UNM


    We cast anomalous change detection as a binary classification problem, and use a support vector machine (SVM) to build a detector that does not depend on assumptions about the underlying data distribution. To speed up the computation, our SVM is implemented, in part, on a graphical processing unit. Results on real and simulated anomalous changes are used to compare performance to algorithms which effectively assume a Gaussian distribution. In this paper, we investigate the use of support vector machines (SVMs) with radial basis kernels for finding anomalous changes. Compared to typical applications of SVMs, we are operating in a regime of very low false alarm rate. This means that even for relatively large training sets, the data are quite meager in the regime of operational interest. This drives us to use larger training sets, which in turn places more of a computational burden on the SVM. We initially considered three different approaches to to address the need to work in the very low false alarm rate regime. The first is a standard SVM which is trained at one threshold (where more reliable estimates of false alarm rates are possible) and then re-thresholded for the low false alarm rate regime. The second uses the same thresholding approach, but employs a so-called least squares SVM; here a quadratic (instead of a hinge-based) loss function is employed, and for this model, there are good theoretical arguments in favor of adjusting the threshold in a straightforward manner. The third approach employs a weighted support vector machine, where the weights for the two types of errors (false alarm and missed detection) are automatically adjusted to achieve the desired false alarm rate. We have found in previous experiments (not shown here) that the first two types can in some cases work well, while in other cases they do not. This renders both approaches unreliable for automated change detection. By contrast, the third approach reliably produces good results, but at

  5. Cavitation detection of butterfly valve using support vector machines

    Yang, Bo-Suk; Hwang, Won-Woo; Ko, Myung-Han; Lee, Soo-Jong


    Butterfly valves are popularly used in service in the industrial and water works pipeline systems with large diameter because of its lightweight, simple structure and the rapidity of its manipulation. Sometimes cavitation can occur, resulting in noise, vibration and rapid deterioration of the valve trim, and do not allow further operation. Thus, monitoring of cavitation is of economic interest and is very important in industry. This paper proposes a condition monitoring scheme using statistical feature evaluation and support vector machine (SVM) to detect the cavitation conditions of butterfly valve which used as a flow control valve at the pumping stations. The stationary features of vibration signals are extracted from statistical moments. The SVMs are trained, and then classify normal and cavitation conditions of control valves. The SVMs with the reorganized feature vectors can distinguish the class of the untrained and untested data. The classification validity of this method is examined by various signals acquired from butterfly valves in the pumping stations. And the classification success rate is compared with that of self-organizing feature map neural network (SOFM).

  6. Online Handwritten Sanskrit Character Recognition Using Support Vector Classification

    Prof. Sonal P.Patil


    Full Text Available Handwritten recognition has been one of the active and challenging research areas in the field of image processing. In this Paper, we are going to analyses feature extraction technique to recognize online handwritten Sanskrit word using preprocessing, segmentation. However, most of the current work in these areas is limited to English and a few oriental languages. The lack of efficient solutions for Indic scripts and languages such as Sanskrit has disadvantaged information extraction from a large body of documents of cultural and historical importance. Here we use Freeman chain code (FCC as the representation technique of an image character. Chain code gives the boundary of a character image in which the codes represents the direction of where is the location of the next pixel. Randomized algorithm is used to generate the FCC. After that, features vector is built. The criterion of features toinput the classification is the chain code that converted to various features. And segmentation is applied to evaluate the possible segmentation zone. Accordingly, several generations are performed to evaluate the individuals with maximum fitness value. Support vector machine (SVM is chosen for the classification step.

  7. Support vector machine approach for protein subcellular localization prediction.

    Hua, S; Sun, Z


    Subcellular localization is a key functional characteristic of proteins. A fully automatic and reliable prediction system for protein subcellular localization is needed, especially for the analysis of large-scale genome sequences. In this paper, Support Vector Machine has been introduced to predict the subcellular localization of proteins from their amino acid compositions. The total prediction accuracies reach 91.4% for three subcellular locations in prokaryotic organisms and 79.4% for four locations in eukaryotic organisms. Predictions by our approach are robust to errors in the protein N-terminal sequences. This new approach provides superior prediction performance compared with existing algorithms based on amino acid composition and can be a complementary method to other existing methods based on sorting signals. A web server implementing the prediction method is available at Supplementary material is available at

  8. Finger vein image quality evaluation using support vector machines

    Yang, Lu; Yang, Gongping; Yin, Yilong; Xiao, Rongyang


    In an automatic finger-vein recognition system, finger-vein image quality is significant for segmentation, enhancement, and matching processes. In this paper, we propose a finger-vein image quality evaluation method using support vector machines (SVMs). We extract three features including the gradient, image contrast, and information capacity from the input image. An SVM model is built on the training images with annotated quality labels (i.e., high/low) and then applied to unseen images for quality evaluation. To resolve the class-imbalance problem in the training data, we perform oversampling for the minority class with random-synthetic minority oversampling technique. Cross-validation is also employed to verify the reliability and stability of the learned model. Our experimental results show the effectiveness of our method in evaluating the quality of finger-vein images, and by discarding low-quality images detected by our method, the overall finger-vein recognition performance is considerably improved.

  9. Application of Support Vector Machine to Ship Steering

    LUO Wei-lin; ZOU Zao-jian; LI Tie-shan


    System identification is an effective way for modeling ship manoeuvring motion and ship manoeuvrability prediction. Support vector machine is proposed to identify the manoeuvring indices in four different response models of ship steering motion, including the first order linear, the first order nonlinear, the second order linear and the second order nonlinear models. Predictions of manoeuvres including trained samples by using the identified parameters are compared with the results of free-running model tests. It is discussed that the different four categories are consistent with each other both analytically and numerically. The generalization of the identified model is verified by predicting different untrained manoeuvres. The simulations and comparisons demonstrate the validity of the proposed method.


    V. Dheepa


    Full Text Available Along with the great increase of internet and e-commerce, the use of credit card is an unavoidable one. Due to the increase of credit card usage, the frauds associated with this have also increased. There are a lot of approaches used to detect the frauds. In this paper, behavior based classification approach using Support Vector Machines are employed and efficient feature extraction method also adopted. If any discrepancies occur in the behaviors transaction pattern then it is predicted as suspicious and taken for further consideration to find the frauds. Generally credit card fraud detection problem suffers from a large amount of data, which is rectified by the proposed method. Achieving finest accuracy, high fraud catching rate and low false alarms are the main tasks of this approach.

  11. Hybrid Neural Network and Support Vector Machine Method for Optimization

    Rai, Man Mohan (Inventor)


    System and method for optimization of a design associated with a response function, using a hybrid neural net and support vector machine (NN/SVM) analysis to minimize or maximize an objective function, optionally subject to one or more constraints. As a first example, the NN/SVM analysis is applied iteratively to design of an aerodynamic component, such as an airfoil shape, where the objective function measures deviation from a target pressure distribution on the perimeter of the aerodynamic component. As a second example, the NN/SVM analysis is applied to data classification of a sequence of data points in a multidimensional space. The NN/SVM analysis is also applied to data regression.

  12. Support Vector Machine active learning for 3D model retrieval


    In this paper, we present a novel Support Vector Machine active learning algorithm for effective 3D model retrieval using the concept of relevance feedback. The proposed method learns from the most informative objects which are marked by the user, and then creates a boundary separating the relevant models from irrelevant ones. What it needs is only a small number of 3D models labelled by the user. It can grasp the user's semantic knowledge rapidly and accurately. Experimental results showed that the proposed algorithm significantly improves the retrieval effectiveness. Compared with four state-of-the-art query refinement schemes for 3D model retrieval, it provides superior retrieval performance after no more than two rounds of relevance feedback.

  13. Temperature prediction control based on least squares support vector machines

    Bin LIU; Hongye SU; Weihua HUANG; Jian CHU


    A prediction control algorithm is presented based on least squares support vector machines (LS-SVM) model for a class of complex systems with strong nonlinearity.The nonlinear off-line model of the controlled plant is built by LS-SVM with radial basis function (RBF) kernel.In the process of system running,the off-line model is linearized at each sampling instant,and the generalized prediction control (GPC) algorithm is employed to implement the prediction control for the controlled plant.The obtained algorithm is applied to a boiler temperature control system with complicated nonlinearity and large time delay.The results of the experiment verify the effectiveness and merit of the algorithm.

  14. Using support vector classification for SAR of fentanyl derivatives

    Ning DONG; Wen-cong LU; Nian-yi CHEN; You-cheng ZHU; Kai-xian CHEN


    Aim: To discriminate between fentanyl derivatives with high and low activities.Methods: The support vector classification (SVC) method, a novel approach,was employed to investigate structure-activity relationship (SAR) of fentanyl derivatives based on the molecular descriptors, which were quantum parameters including △E [energy difference between highest occupied molecular orbital energy (HOMO) and lowest empty molecular orbital energy (LUMO)], MR(molecular refractivity) and Mr (molecular weight). Results: By using leave-oneout cross-validation test, the accuracies of prediction for activities of fentanyl derivatives in SVC, principal component analysis (PCA), artificial neural network (ANN) and K-nearest neighbor (KNN) models were 93%, 86%, 57%, and 71%, respectively. The results indicated that the performance of the SVC model was better than those of PCA, ANN, and KNN models for this data. Conclusion:SVC can be used to investigate SAR of fentanyl derivatives and could be a promising tool in the field of SAR research.

  15. Packet Classification using Support Vector Machines with String Kernels

    Sarthak Munshi


    Full Text Available Since the inception of internet many methods have been devised to keep untrusted and malicious packets away from a user’s system . The traffic / packet classification can be used as an important tool to detect intrusion in the system. Using Machine Learning as an efficient statistical based approach for classifying packets is a novel method in practice today . This paper emphasizes upon using an advanced string kernel method within a support vector machine to classify packets .There exists a paper related to a similar problem using Machine Learning [2]. But the researches mentioned in their paper are not up-to date and doesn’t account for modern day string kernels that are much more efficient . My work extends their research by introducing different approaches to classify encrypted / unencrypted traffic / packets .

  16. Support vector classifier based on principal component analysis


    Support vector classifier (SVC) has the superior advantages for small sample learning problems with high dimensions,with especially better generalization ability.However there is some redundancy among the high dimensions of the original samples and the main features of the samples may be picked up first to improve the performance of SVC.A principal component analysis (PCA) is employed to reduce the feature dimensions of the original samples and the pre-selected main features efficiently,and an SVC is constructed in the selected feature space to improve the learning speed and identification rate of SVC.Furthermore,a heuristic genetic algorithm-based automatic model selection is proposed to determine the hyperparameters of SVC to evaluate the performance of the learning machines.Experiments performed on the Heart and Adult benchmark data sets demonstrate that the proposed PCA-based SVC not only reduces the test time drastically,but also improves the identify rates effectively.

  17. On the regularization path of the support vector domain description

    Hansen, Michael Sass; Sjöstrand, Karl; Larsen, Rasmus


    The internet and a growing number of increasingly sophisticated measuring devices make vast amounts of data available in many applications. However, the dimensionality is often high, and the time available for manual labelling scarce. Methods for unsupervised novelty detection are a great step...... towards meeting these challenges, and the support vector domain description has already shown its worth in this field. The method has recently received more attention, since it has been shown that the regularization path is piece-wise linear, and can be calculated efficiently. The presented work restates...... the new findings in a manner which permits the calculation with O(n.n(B)) complexity in each iteration step instead of O(n(2) + n(B)(3)), where n is the number of data points and n, is the number of boundary points. This is achieved by updating and downdating the system matrix to avoid redundant...

  18. Reinforced Angle-based Multicategory Support Vector Machines

    Zhang, Chong; Liu, Yufeng; Wang, Junhui; Zhu, Hongtu


    The Support Vector Machine (SVM) is a very popular classification tool with many successful applications. It was originally designed for binary problems with desirable theoretical properties. Although there exist various Multicategory SVM (MSVM) extensions in the literature, some challenges remain. In particular, most existing MSVMs make use of k classification functions for a k-class problem, and the corresponding optimization problems are typically handled by existing quadratic programming solvers. In this paper, we propose a new group of MSVMs, namely the Reinforced Angle-based MSVMs (RAMSVMs), using an angle-based prediction rule with k − 1 functions directly. We prove that RAMSVMs can enjoy Fisher consistency. Moreover, we show that the RAMSVM can be implemented using the very efficient coordinate descent algorithm on its dual problem. Numerical experiments demonstrate that our method is highly competitive in terms of computational speed, as well as classification prediction performance. Supplemental materials for the article are available online. PMID:27891045

  19. Application of support vector machine to synthetic earthquake prediction

    Chun Jiang; Xueli Wei; Xiaofeng Cui; Dexiang You


    This paper introduces the method of support vector machine (SVM) into the field of synthetic earthquake prediction, which is a non-linear and complex seismogenic system. As an example, we apply this method to predict the largest annual magnitude for the North China area (30°E-42°E, 108°N-125°N) and the capital region (38°E-41.5°E, 114°N-120°N) on the basis of seismicity parameters and observed precursory data. The corresponding prediction rates for the North China area and the capital region are 64.1% and 75%, respectively, which shows that the method is feasible.


    Huang Yanwei; Wu Tihua; Zhao Jingyi; Wang Yiqun


    A method for the calculation of the sensitivity factors of the rolling process has been obtained by differentiating the roll force model based on support vector machine. It can eliminate the algebraic loop of the analytical model of the rolling process. The simulations in the first stand of five stand cold tandem rolling mill indicate that the calculation for sensitivities by this proposed method can obtain a good accuracy, and an appropriate adjustment on the control variables determined directly by the sensitivity has an excellent compensation accuracy. Moreover, the roll gap has larger effect on the exit thickness than both front tension and back tension, and it is more efficient to select the roll gap as the controlvariable of the thickness control system in the first stand.

  1. Application of Support Vector Machine to Forex Monitoring

    Kamruzzaman, Joarder; Sarker, Ruhul A.

    Previous studies have demonstrated superior performance of artificial neural network (ANN) based forex forecasting models over traditional regression models. This paper applies support vector machines to build a forecasting model from the historical data using six simple technical indicators and presents a comparison with an ANN based model trained by scaled conjugate gradient (SCG) learning algorithm. The models are evaluated and compared on the basis of five commonly used performance metrics that measure closeness of prediction as well as correctness in directional change. Forecasting results of six different currencies against Australian dollar reveal superior performance of SVM model using simple linear kernel over ANN-SCG model in terms of all the evaluation metrics. The effect of SVM parameter selection on prediction performance is also investigated and analyzed.

  2. Speaker Identification using MFCC-Domain Support Vector Machine

    Kamruzzaman, S M; Islam, Md Saiful; Haque, Md Emdadul; 10.3923/ijepe.2007.274.278


    Speech recognition and speaker identification are important for authentication and verification in security purpose, but they are difficult to achieve. Speaker identification methods can be divided into text-independent and text-dependent. This paper presents a technique of text-dependent speaker identification using MFCC-domain support vector machine (SVM). In this work, melfrequency cepstrum coefficients (MFCCs) and their statistical distribution properties are used as features, which will be inputs to the neural network. This work firstly used sequential minimum optimization (SMO) learning technique for SVM that improve performance over traditional techniques Chunking, Osuna. The cepstrum coefficients representing the speaker characteristics of a speech segment are computed by nonlinear filter bank analysis and discrete cosine transform. The speaker identification ability and convergence speed of the SVMs are investigated for different combinations of features. Extensive experimental results on several sam...

  3. The seam offset identification based on support vector regression machines

    Zeng Songsheng; Shi Yonghua; Wang Guorong; Huang Guoxing


    The principle of the support vector regression machine(SVR) is first analysed. Then the new data-dependent kernel function is constructed from information geometry perspective. The current waveforms change regularly in accordance with the different horizontal offset when the rotational frequency of the high speed rotational arc sensor is in the range from 15 Hz to 30 Hz. The welding current data is pretreated by wavelet filtering, mean filtering and normalization treatment. The SVR model is constructed by making use of the evolvement laws, the decision function can be achieved by training the SVR and the seam offset can be identified. The experimental results show that the precision of the offset identification can be greatly improved by modifying the SVR and applying mean filtering from the longitudinal direction.

  4. Threat Assessment of Targets Based on Support Vector Machine

    CAI Huai-ping; LIU Jing-xu; CHEN Ying-wu


    In the context of cooperative engagement of armored vehicles, the threat factors of offensive targets are analyzed, and a threat assessment (TA) model is built based on a support v.ector machine (SVM) method. The SVM-based model has some advantages over the traditional method-based models: the complex factors of threat are considered in the cooperative engagement; the shortcomings of neural networks, such as local minimum and "over fitting", are overcome to improve the generalization ability; its operation speed is high and meets the needs of real time C2 of cooperative engagement; the assessment results could be more reasonable because of its self-learning capability. The analysis and simulation indicate that the SVM method is an effective method to resolve the TA problems.


    HUANG Wei; Yoshiteru Nakamori; WANG Shouyang; YU Lean


    Support Vector Machine (SVM) is a very specific type of learning algorithms characterized by the capacity control of the decision function, the use of the kernel functions and the sparsity of the solution. In this paper, we investigate the predictability of financial movement direction with SVM by forecasting the weekly movement direction of NIKKEI 225 index. To evaluate the forecasting ability of SVM, we compare the performance with those of Linear Discriminant Analysis, Quadratic Discriminant Analysis and Elman Backpropagation Neural Networks. The experiment results show that SVM outperforms other classification methods. Furthermore, we propose a combining model by integrating SVM with other classification methods. The combining model performs the best among the forecasting methods.

  6. Support vector machine ensemble using rough sets theory


    A support vector machine (SVM) ensemble classifier is proposed. Performance of SVM trained in an input space consisting of all the information from many sources is not always good. The strategy that the original input space is partitioned into several input subspaces usually works for improving the performance. Different from conventional partition methods, the partition method used in this paper, rough sets theory based attribute reduction, allows the input subspaces partially overlapped. These input subspaces can offer complementary information about hidden data patterns. In every subspace, an SVM sub-classifier is learned. With the information fusion techniques, those SVM sub-classifiers with better performance are selected and combined to construct an SVM ensemble. The proposed method is applied to decisionmaking of medical diagnosis. Comparison of performance between our method and several other popular ensemble methods is done. Experimental results demonstrate that our proposed approach can make full use of the information contained in data and improve the decision-making performance.

  7. An Efficient Audio Classification Approach Based on Support Vector Machines

    Lhoucine Bahatti


    Full Text Available In order to achieve an audio classification aimed to identify the composer, the use of adequate and relevant features is important to improve performance especially when the classification algorithm is based on support vector machines. As opposed to conventional approaches that often use timbral features based on a time-frequency representation of the musical signal using constant window, this paper deals with a new audio classification method which improves the features extraction according the Constant Q Transform (CQT approach and includes original audio features related to the musical context in which the notes appear. The enhancement done by this work is also lay on the proposal of an optimal features selection procedure which combines filter and wrapper strategies. Experimental results show the accuracy and efficiency of the adopted approach in the binary classification as well as in the multi-class classification.

  8. Estimating Military Aircraft Cost Using Least Squares Support Vector Machines

    ZHU Jia-yuan; ZHANG Xi-bin; ZHANG Heng-xi; REN Bo


    A multi-layer adaptive optimizing parameters algorithm is developed for improving least squares support vector machines(LS-SVM),and a military aircraft life-cycle-cost(LCC)intelligent estimation model is proposed based on the improved LS-SVM.The intelligent cost estimation process is divided into three steps in the model.In the first step,a cost-drive-factor needs to be selected,which is significant for cost estimation.In the second step,military aircraft training samples within costs and cost-drive-factor set are obtained by the LS-SVM.Then the model can be used for new type aircraft cost estimation.Chinese military aircraft costs are estimated in the paper.The results show that the estimated costs by the new model are closer to the true costs than that of the traditionally used methods.


    ZHENG Shuibo; TANG Houjun; HAN Zhengzhi; ZHANG Yong


    Various methods of tyre modelling are implemented from pure theoretical to empirical or semi-empirical models based on experimental results. A new way of representing tyre data obtained from measurements is presented via support vector machines (SVMs). The feasibility of applying SVMs to steady-state tyre modelling is investigated by comparison with three-layer backpropagation(BP) neural network at pure slip and combined slip. The results indicate SVMs outperform the BP neural network in modelling the tyre characteristics with better generalization performance. The SVMs-tyre is implemented in 8-DOF vehicle model for vehicle dynamics simulation by means of the PAC 2002 Magic Formula as reference. The SVMs-tyre can be a competitive and accurate method to model a tyre for vehicle dynamics simulation.

  10. Vectores


    Documento que contiene la explicación sobre las temáticas de Sistemas coordenados, Cantidades vectoriales y escalares, Algunas propiedades de los vectores, Componentes de un vector y vectores unitarios

  11. Ecological Footprint Model Using the Support Vector Machine Technique

    Ma, Haibo; Chang, Wenjuan; Cui, Guangbai


    The per capita ecological footprint (EF) is one of the most widely recognized measures of environmental sustainability. It aims to quantify the Earth's biological resources required to support human activity. In this paper, we summarize relevant previous literature, and present five factors that influence per capita EF. These factors are: National gross domestic product (GDP), urbanization (independent of economic development), distribution of income (measured by the Gini coefficient), export dependence (measured by the percentage of exports to total GDP), and service intensity (measured by the percentage of service to total GDP). A new ecological footprint model based on a support vector machine (SVM), which is a machine-learning method based on the structural risk minimization principle from statistical learning theory was conducted to calculate the per capita EF of 24 nations using data from 123 nations. The calculation accuracy was measured by average absolute error and average relative error. They were 0.004883 and 0.351078% respectively. Our results demonstrate that the EF model based on SVM has good calculation performance. PMID:22291949

  12. Classification of Incidental Carcinoma of the Prostate Using Learning Vector Quantization and Support Vector Machines

    Torsten Mattfeldt


    Full Text Available The subclassification of incidental prostatic carcinoma into the categories T1a and T1b is of major prognostic and therapeutic relevance. In this paper an attempt was made to find out which properties mainly predispose to these two tumor categories, and whether it is possible to predict the category from a battery of clinical and histopathological variables using newer methods of multivariate data analysis. The incidental prostatic carcinomas of the decade 1990–99 diagnosed at our department were reexamined. Besides acquisition of routine clinical and pathological data, the tumours were scored by immunohistochemistry for proliferative activity and p53‐overexpression. Tumour vascularization (angiogenesis and epithelial texture were investigated by quantitative stereology. Learning vector quantization (LVQ and support vector machines (SVM were used for the purpose of prediction of tumour category from a set of 10 input variables (age, Gleason score, preoperative PSA value, immunohistochemical scores for proliferation and p53‐overexpression, 3 stereological parameters of angiogenesis, 2 stereological parameters of epithelial texture. In a stepwise logistic regression analysis with the tumour categories T1a and T1b as dependent variables, only the Gleason score and the volume fraction of epithelial cells proved to be significant as independent predictor variables of the tumour category. Using LVQ and SVM with the information from all 10 input variables, more than 80 of the cases could be correctly predicted as T1a or T1b category with specificity, sensitivity, negative and positive predictive value from 74–92%. Using only the two significant input variables Gleason score and epithelial volume fraction, the accuracy of prediction was not worse. Thus, descriptive and quantitative texture parameters of tumour cells are of major importance for the extent of propagation in the prostate gland in incidental prostatic adenocarcinomas. Classical

  13. Mining protein function from text using term-based support vector machines

    Rice, Simon B; Nenadic, Goran; Stapley, Benjamin J


    Background Text mining has spurred huge interest in the domain of biology. The goal of the BioCreAtIvE exercise was to evaluate the performance of current text mining systems. We participated in Task 2, which addressed assigning Gene Ontology terms to human proteins and selecting relevant evidence from full-text documents. We approached it as a modified form of the document classification task. We used a supervised machine-learning approach (based on support vector machines) to assign protein function and select passages that support the assignments. As classification features, we used a protein's co-occurring terms that were automatically extracted from documents. Results The results evaluated by curators were modest, and quite variable for different problems: in many cases we have relatively good assignment of GO terms to proteins, but the selected supporting text was typically non-relevant (precision spanning from 3% to 50%). The method appears to work best when a substantial set of relevant documents is obtained, while it works poorly on single documents and/or short passages. The initial results suggest that our approach can also mine annotations from text even when an explicit statement relating a protein to a GO term is absent. Conclusion A machine learning approach to mining protein function predictions from text can yield good performance only if sufficient training data is available, and significant amount of supporting data is used for prediction. The most promising results are for combined document retrieval and GO term assignment, which calls for the integration of methods developed in BioCreAtIvE Task 1 and Task 2. PMID:15960835

  14. Prediction of backbone dihedral angles and protein secondary structure using support vector machines

    Hirst Jonathan D


    Full Text Available Abstract Background The prediction of the secondary structure of a protein is a critical step in the prediction of its tertiary structure and, potentially, its function. Moreover, the backbone dihedral angles, highly correlated with secondary structures, provide crucial information about the local three-dimensional structure. Results We predict independently both the secondary structure and the backbone dihedral angles and combine the results in a loop to enhance each prediction reciprocally. Support vector machines, a state-of-the-art supervised classification technique, achieve secondary structure predictive accuracy of 80% on a non-redundant set of 513 proteins, significantly higher than other methods on the same dataset. The dihedral angle space is divided into a number of regions using two unsupervised clustering techniques in order to predict the region in which a new residue belongs. The performance of our method is comparable to, and in some cases more accurate than, other multi-class dihedral prediction methods. Conclusions We have created an accurate predictor of backbone dihedral angles and secondary structure. Our method, called DISSPred, is available online at

  15. Support vector machine as an alternative method for lithology classification of crystalline rocks

    Deng, Chengxiang; Pan, Heping; Fang, Sinan; Amara Konaté, Ahmed; Qin, Ruidong


    With the expansion of machine learning algorithms, automatic lithology classification that uses well logging data is becoming significant in formation evaluation and reservoir characterization. In fact, the complicated composition and structural variations of metamorphic rocks result in more nonlinear features in well logging data and elevate requirements to algorithms. Herein, the application of the support vector machine (SVM) in classifying crystalline rocks from Chinese Continental Scientific Drilling Main Hole (CCSD-MH) data was reported. We found that the SVM performs poorly on the lithology classification of crystalline rocks when training samples are imbalanced. The fact is that training samples are generally limited and imbalanced as cores cannot be obtained balanced and at 100 percent. In this paper, we introduced the synthetic minority over-sampling technique (SMOTE) and Borderline-SMOTE to deal with imbalanced data. After experiments generating different quantities of training samples by SMOTE and Borderline-SMOTE, the most suitable classifier was selected to overcome the disadvantage of the SVM. Then, the popular supervised classifier back-propagation neural networks (BPNN), which has been proved competent for lithology classification of crystalline rocks in previous studies, was compared to evaluate the performance of the SVM. Results show that Borderline-SMOTE can improve the SVM with substantially increased accuracy even for minority classes in a reasonable manner, while the SVM outperforms BPNN in aspects of lithology prediction and CCSD-MH data generalization. We demonstrate the potential of the SVM as an alternative to current methods for lithology identification of crystalline rocks.

  16. [Hyperspectral image classification based on 3-D gabor filter and support vector machines].

    Feng, Xiao; Xiao, Peng-feng; Li, Qi; Liu, Xiao-xi; Wu, Xiao-cui


    A three-dimensional Gabor filter was developed for classification of hyperspectral remote sensing image. This method is based on the characteristics of hyperspectral image and the principle of texture extraction with 2-D Gabor filters. Three-dimensional Gabor filter is able to filter all the bands of hyperspectral image simultaneously, capturing the specific responses in different scales, orientations, and spectral-dependent properties from enormous image information, which greatly reduces the time consumption in hyperspectral image texture extraction, and solve the overlay difficulties of filtered spectrums. Using the designed three-dimensional Gabor filters in different scales and orientations, Hyperion image which covers the typical area of Qi Lian Mountain was processed with full bands to get 26 Gabor texture features and the spatial differences of Gabor feature textures corresponding to each land types were analyzed. On the basis of automatic subspace separation, the dimensions of the hyperspectral image were reduced by band index (BI) method which provides different band combinations for classification in order to search for the optimal magnitude of dimension reduction. Adding three-dimensional Gabor texture features successively according to its discrimination to the given land types, supervised classification was carried out with the classifier support vector machines (SVM). It is shown that the method using three-dimensional Gabor texture features and BI band selection based on automatic subspace separation for hyperspectral image classification can not only reduce dimensions; but also improve the classification accuracy and efficiency of hyperspectral image.

  17. Inferring the location of buried UXO using a support vector machine

    Fernández, Juan Pablo; Sun, Keli; Barrowes, Benjamin; O'Neill, Kevin; Shamatava, Irma; Shubitidze, Fridon; Paulsen, Keith D.


    The identification of unexploded ordnance (UXO) using electromagnetic-induction (EMI) sensors involves two essentially independent steps: Each anomaly detected by the sensor has to be located fairly accurately, and its orientation determined, before one can try to find size/shape/composition properties that identify the object uniquely. The dependence on the latter parameters is linear, and can be solved for efficiently using for example the Normalized Surface Magnetic Charge model. The location and orientation, on the other hand, have a nonlinear effect on the measurable scattered field, making their determination much more time-consuming and thus hampering the ability to carry out discrimination in real time. In particular, it is difficult to resolve for depth when one has measurements taken at only one instrument elevation. In view of the difficulties posed by direct inversion, we propose using a Support Vector Machine (SVM) to infer the location and orientation of buried UXO. SVMs are a method of supervised machine learning: the user can train a computer program by feeding it features of representative examples, and the machine, in turn, can generalize this information by finding underlying patterns and using them to classify or regress unseen instances. In this work we train an SVM using measured-field information, for both synthetic and experimental data, and evaluate its ability to predict the location of different buried objects to reasonable accuracy. We explore various combinations of input data and learning parameters in search of an optimal predictive configuration.

  18. Using support vector machine ensembles for target audience classification on Twitter.

    Lo, Siaw Ling; Chiong, Raymond; Cornforth, David


    The vast amount and diversity of the content shared on social media can pose a challenge for any business wanting to use it to identify potential customers. In this paper, our aim is to investigate the use of both unsupervised and supervised learning methods for target audience classification on Twitter with minimal annotation efforts. Topic domains were automatically discovered from contents shared by followers of an account owner using Twitter Latent Dirichlet Allocation (LDA). A Support Vector Machine (SVM) ensemble was then trained using contents from different account owners of the various topic domains identified by Twitter LDA. Experimental results show that the methods presented are able to successfully identify a target audience with high accuracy. In addition, we show that using a statistical inference approach such as bootstrapping in over-sampling, instead of using random sampling, to construct training datasets can achieve a better classifier in an SVM ensemble. We conclude that such an ensemble system can take advantage of data diversity, which enables real-world applications for differentiating prospective customers from the general audience, leading to business advantage in the crowded social media space.

  19. Phase Space Prediction of Chaotic Time Series with Nu-Support Vector Machine Regression

    YE Mei-Ying; WANG Xiao-Dong


    A new class of support vector machine, nu-support vector machine, is discussed which can handle both classification and regression. We focus on nu-support vector machine regression and use it for phase space prediction of compares nu-support vector machine with back propagation (BP) networks in order to better evaluate the performance of the proposed methods. The experimental results show that the nu-support vector machine regression obtains lower root mean squared error than the BP networks and provides an accurate chaotic time series prediction. These results can be attributable to the fact that nu-support vector machine implements the structural risk minimization principle and this leads to better generalization than the BP networks.

  20. Implementing the supportive supervision intervention for registered nurses in a long-term care home: a feasibility study.

    McGilton, Katherine S; Profetto-McGrath, Joanne; Robinson, Angela


    This pilot study was conducted in response to the call in 2009 by the International Association of Gerontology and Geriatrics to focus on effective leadership structures in nursing homes and to develop leadership capacity. Few researchers have evaluated interventions aimed at enhancing the leadership ability of registered nurses in long-term care. The aim of the pilot study was to test the feasibility of a three-part supportive supervisory intervention to improve supervisory skills of registered nurses in long-term care. A repeated measures group design was used. Quantitative data were collected from healthcare aides, licensed practical nurses (i.e., supervised staff), and registered nurses (i.e., supervisors). Focus groups with care managers and supervisors examined perceptions of the intervention. There were nonsignificant changes in both the registered nurse supervisors' job satisfaction and the supervised staff's perception of their supervisors' support. Supervised staff scores indicated an increase in the use of research utilization but did not reflect an increase in job satisfaction. Focus group discussions revealed that the supervisors and care managers perceived the workshop to be valuable; however, the weekly self-reflection, coaching, and mentoring components of the intervention were rare and inconsistent. While the primary outcomes were not influenced by the Supportive Supervision Intervention, further effort is required to understand how best to enhance the supportive supervisory skills of RNs. Examples of how to improve the possibility of a successful intervention are advanced. Effective supervisory skills among registered nurses are crucial for improving the quality of care in long-term care homes. Registered nurses are receptive to interventions that will enhance their roles as supervisors. © 2013 Sigma Theta Tau International.

  1. Research on Application of Regression Least Squares Support Vector Machine on Performance Prediction of Hydraulic Excavator

    Zhan-bo Chen


    Full Text Available In order to improve the performance prediction accuracy of hydraulic excavator, the regression least squares support vector machine is applied. First, the mathematical model of the regression least squares support vector machine is studied, and then the algorithm of the regression least squares support vector machine is designed. Finally, the performance prediction simulation of hydraulic excavator based on regression least squares support vector machine is carried out, and simulation results show that this method can predict the performance changing rules of hydraulic excavator correctly.

  2. [Comparative Efficiency of Algorithms Based on Support Vector Machines for Regression].

    Kadyrova, N O; Pavlova, L V


    Methods of construction of support vector machines do not require additional a priori information and can be used to process large scale data set. It is especially important for various problems in computational biology. The main set of algorithms of support vector machines for regression is presented. The comparative efficiency of a number of support-vector-algorithms for regression is investigated. A thorough analysis of the study results found the most efficient support vector algorithms for regression. The description of the presented algorithms, sufficient for their practical implementation is given.

  3. Enhancing the intrinsic work motivation of community nutrition educators: how supportive supervision and job design foster autonomy.

    Dickin, Katherine L; Dollahite, Jamie S; Habicht, Jean-Pierre


    Mixed-methods research investigated the work motivation of paraprofessional community nutrition educators (CNEs) delivering a long-running public health nutrition program. In interviews, CNEs (n = 9) emphasized "freedom," supportive supervision, and "making a difference" as key sources of motivation. Community nutrition educator surveys (n = 115) confirmed high levels of autonomy, which was associated with supervisors' delegation and support, CNE decision-making on scheduling and curricula, and job satisfaction. Supervisors (n = 32) rated CNEs' job design as having inherently motivating characteristics comparable to professional jobs. Supervisory strategies can complement job design to create structured, supportive contexts that maintain fidelity, while granting autonomy to paraprofessionals to enhance intrinsic work motivation.

  4. NESVM: a Fast Gradient Method for Support Vector Machines

    Zhou, Tianyi; Wu, Xindong


    Support vector machines (SVMs) are invaluable tools for many practical applications in artificial intelligence, e.g., classification and event recognition. However, popular SVM solvers are not sufficiently efficient for applications with a great deal of samples as well as a large number of features. In this paper, thus, we present NESVM, a fast gradient SVM solver that can optimize various SVM models, e.g., classical SVM, linear programming SVM and least square SVM. Compared against SVM-Perf \\cite{SVM_Perf}\\cite{PerfML} (its convergence rate in solving the dual SVM is upper bounded by $\\mathcal O(1/\\sqrt{k})$, wherein $k$ is the number of iterations.) and Pegasos \\cite{Pegasos} (online SVM that converges at rate $\\mathcal O(1/k)$ for the primal SVM), NESVM achieves the optimal convergence rate at $\\mathcal O(1/k^{2})$ and a linear time complexity. In particular, NESVM smoothes the non-differentiable hinge loss and $\\ell_1$-norm in the primal SVM. Then the optimal gradient method without any line search is ado...

  5. Spatio-temporal avalanche forecasting with Support Vector Machines

    A. Pozdnoukhov


    Full Text Available This paper explores the use of the Support Vector Machine (SVM as a data exploration tool and a predictive engine for spatio-temporal forecasting of snow avalanches. Based on the historical observations of avalanche activity, meteorological conditions and snowpack observations in the field, an SVM is used to build a data-driven spatio-temporal forecast for the local mountain region. It incorporates the outputs of simple physics-based and statistical approaches used to interpolate meteorological and snowpack-related data over a digital elevation model of the region. The interpretation of the produced forecast is discussed, and the quality of the model is validated using observations and avalanche bulletins of the recent years. The insight into the model behaviour is presented to highlight the interpretability of the model, its abilities to produce reliable forecasts for individual avalanche paths and sensitivity to input data. Estimates of prediction uncertainty are obtained with ensemble forecasting. The case study was carried out using data from the avalanche forecasting service in the Locaber region of Scotland, where avalanches are forecast on a daily basis during the winter months.

  6. Phone Duration Modeling of Affective Speech Using Support Vector Regression

    Alexandros Lazaridis


    Full Text Available In speech synthesis accurate modeling of prosody is important for producing high quality synthetic speech. One of the main aspects of prosody is phone duration. Robust phone duration modeling is a prerequisite for synthesizing emotional speech with natural sounding. In this work ten phone duration models are evaluated. These models belong to well known and widely used categories of algorithms, such as the decision trees, linear regression, lazy-learning algorithms and meta-learning algorithms. Furthermore, we investigate the effectiveness of Support Vector Regression (SVR in phone duration modeling in the context of emotional speech. The evaluation of the eleven models is performed on a Modern Greek emotional speech database which consists of four categories of emotional speech (anger, fear, joy, sadness plus neutral speech. The experimental results demonstrated that the SVR-based modeling outperforms the other ten models across all the four emotion categories. Specifically, the SVR model achieved an average relative reduction of 8% in terms of root mean square error (RMSE throughout all emotional categories.

  7. Hybrid Support Vector Machines-Based Multi-fault Classification

    GAO Guo-hua; ZHANG Yong-zhong; ZHU Yu; DUAN Guang-huang


    Support Vector Machines (SVM) is a new general machine-learning tool based on structural risk minimization principle. This characteristic is very signific ant for the fault diagnostics when the number of fault samples is limited. Considering that SVM theory is originally designed for a two-class classification, a hybrid SVM scheme is proposed for multi-fault classification of rotating machinery in our paper. Two SVM strategies, 1-v-1 (one versus one) and 1-v-r (one versus rest), are respectively adopted at different classification levels. At the parallel classification level, using 1-v-1 strategy, the fault features extracted by various signal analysis methods are transferred into the multiple parallel SVM and the local classification results are obtained. At the serial classification level, these local results values are fused by one serial SVM based on 1-v-r strategy. The hybrid SVM scheme introduced in our paper not only generalizes the performance of signal binary SVMs but improves the precision and reliability of the fault classification results. The actually testing results show the availability suitability of this new method.

  8. Nonlinear structural damage detection using support vector machines

    Xiao, Li; Qu, Wenzhong


    An actual structure including connections and interfaces may exist nonlinear. Because of many complicated problems about nonlinear structural health monitoring (SHM), relatively little progress have been made in this aspect. Statistical pattern recognition techniques have been demonstrated to be competitive with other methods when applied to real engineering datasets. When a structure existing 'breathing' cracks that open and close under operational loading may cause a linear structural system to respond to its operational and environmental loads in a nonlinear manner nonlinear. In this paper, a vibration-based structural health monitoring when the structure exists cracks is investigated with autoregressive support vector machine (AR-SVM). Vibration experiments are carried out with a model frame. Time-series data in different cases such as: initial linear structure; linear structure with mass changed; nonlinear structure; nonlinear structure with mass changed are acquired.AR model of acceleration time-series is established, and different kernel function types and corresponding parameters are chosen and compared, which can more accurate, more effectively locate the damage. Different cases damaged states and different damage positions have been recognized successfully. AR-SVM method for the insufficient training samples is proved to be practical and efficient on structure nonlinear damage detection.

  9. River flow time series using least squares support vector machines

    Samsudin, R.; Saad, P.; Shabri, A.


    This paper proposes a novel hybrid forecasting model known as GLSSVM, which combines the group method of data handling (GMDH) and the least squares support vector machine (LSSVM). The GMDH is used to determine the useful input variables which work as the time series forecasting for the LSSVM model. Monthly river flow data from two stations, the Selangor and Bernam rivers in Selangor state of Peninsular Malaysia were taken into consideration in the development of this hybrid model. The performance of this model was compared with the conventional artificial neural network (ANN) models, Autoregressive Integrated Moving Average (ARIMA), GMDH and LSSVM models using the long term observations of monthly river flow discharge. The root mean square error (RMSE) and coefficient of correlation (R) are used to evaluate the models' performances. In both cases, the new hybrid model has been found to provide more accurate flow forecasts compared to the other models. The results of the comparison indicate that the new hybrid model is a useful tool and a promising new method for river flow forecasting.

  10. Voice Activity Detection Using Fuzzy Entropy and Support Vector Machine

    R. Johny Elton


    Full Text Available This paper proposes support vector machine (SVM based voice activity detection using FuzzyEn to improve detection performance under noisy conditions. The proposed voice activity detection (VAD uses fuzzy entropy (FuzzyEn as a feature extracted from noise-reduced speech signals to train an SVM model for speech/non-speech classification. The proposed VAD method was tested by conducting various experiments by adding real background noises of different signal-to-noise ratios (SNR ranging from −10 dB to 10 dB to actual speech signals collected from the TIMIT database. The analysis proves that FuzzyEn feature shows better results in discriminating noise and corrupted noisy speech. The efficacy of the SVM classifier was validated using 10-fold cross validation. Furthermore, the results obtained by the proposed method was compared with those of previous standardized VAD algorithms as well as recently developed methods. Performance comparison suggests that the proposed method is proven to be more efficient in detecting speech under various noisy environments with an accuracy of 93.29%, and the FuzzyEn feature detects speech efficiently even at low SNR levels.

  11. Semisupervised Support Vector Machines With Tangent Space Intrinsic Manifold Regularization.

    Sun, Shiliang; Xie, Xijiong


    Semisupervised learning has been an active research topic in machine learning and data mining. One main reason is that labeling examples is expensive and time-consuming, while there are large numbers of unlabeled examples available in many practical problems. So far, Laplacian regularization has been widely used in semisupervised learning. In this paper, we propose a new regularization method called tangent space intrinsic manifold regularization. It is intrinsic to data manifold and favors linear functions on the manifold. Fundamental elements involved in the formulation of the regularization are local tangent space representations, which are estimated by local principal component analysis, and the connections that relate adjacent tangent spaces. Simultaneously, we explore its application to semisupervised classification and propose two new learning algorithms called tangent space intrinsic manifold regularized support vector machines (TiSVMs) and tangent space intrinsic manifold regularized twin SVMs (TiTSVMs). They effectively integrate the tangent space intrinsic manifold regularization consideration. The optimization of TiSVMs can be solved by a standard quadratic programming, while the optimization of TiTSVMs can be solved by a pair of standard quadratic programmings. The experimental results of semisupervised classification problems show the effectiveness of the proposed semisupervised learning algorithms.

  12. Prediction of Hydrocarbon Reservoirs Permeability Using Support Vector Machine

    R. Gholami


    Full Text Available Permeability is a key parameter associated with the characterization of any hydrocarbon reservoir. In fact, it is not possible to have accurate solutions to many petroleum engineering problems without having accurate permeability value. The conventional methods for permeability determination are core analysis and well test techniques. These methods are very expensive and time consuming. Therefore, attempts have usually been carried out to use artificial neural network for identification of the relationship between the well log data and core permeability. In this way, recent works on artificial intelligence techniques have led to introduce a robust machine learning methodology called support vector machine. This paper aims to utilize the SVM for predicting the permeability of three gas wells in the Southern Pars field. Obtained results of SVM showed that the correlation coefficient between core and predicted permeability is 0.97 for testing dataset. Comparing the result of SVM with that of a general regression neural network (GRNN revealed that the SVM approach is faster and more accurate than the GRNN in prediction of hydrocarbon reservoirs permeability.

  13. Support Vector Machine Ensemble Based on Genetic Algorithm

    LI Ye; YIN Ru-po; CAI Yun-ze; XU Xiao-ming


    Support vector machines (SVMs) have been introduced as effective methods for solving classification problems.However, due to some limitations in practical applications,their generalization performance is sometimes far from the expected level. Therefore, it is meaningful to study SVM ensemble learning. In this paper, a novel genetic algorithm based ensemble learning method, namely Direct Genetic Ensemble (DGE), is proposed. DGE adopts the predictive accuracy of ensemble as the fitness function and searches a good ensemble from the ensemble space. In essence, DGE is also a selective ensemble learning method because the base classifiers of the ensemble are selected according to the solution of genetic algorithm. In comparison with other ensemble learning methods, DGE works on a higher level and is more direct. Different strategies of constructing diverse base classifiers can be utilized in DGE.Experimental results show that SVM ensembles constructed by DGE can achieve better performance than single SVMs,bagged and boosted SVM ensembles. In addition, some valuable conclusions are obtained.

  14. A Support Vector Regression Approach for Investigating Multianticipative Driving Behavior

    Bin Lu


    Full Text Available This paper presents a Support Vector Regression (SVR approach that can be applied to predict the multianticipative driving behavior using vehicle trajectory data. Building upon the SVR approach, a multianticipative car-following model is developed and enhanced in learning speed and predication accuracy. The model training and validation are conducted by using the field trajectory data extracted from the Next Generation Simulation (NGSIM project. During the model training and validation tests, the estimation results show that the SVR model performs as well as IDM model with respect to the model prediction accuracy. In addition, this paper performs a relative importance analysis to quantify the multianticipation in terms of the different stimuli to which drivers react in platoon car following. The analysis results confirm that drivers respond to the behavior of not only the immediate leading vehicle in front but also the second, third, and even fourth leading vehicles. Specifically, in congested traffic conditions, drivers are observed to be more sensitive to the relative speed than to the gap. These findings provide insight into multianticipative driving behavior and illustrate the necessity of taking into account multianticipative car-following model in microscopic traffic simulation.

  15. A Semisupervised Support Vector Machines Algorithm for BCI Systems

    Jianzhao Qin


    Full Text Available As an emerging technology, brain-computer interfaces (BCIs bring us new communication interfaces which translate brain activities into control signals for devices like computers, robots, and so forth. In this study, we propose a semisupervised support vector machine (SVM algorithm for brain-computer interface (BCI systems, aiming at reducing the time-consuming training process. In this algorithm, we apply a semisupervised SVM for translating the features extracted from the electrical recordings of brain into control signals. This SVM classifier is built from a small labeled data set and a large unlabeled data set. Meanwhile, to reduce the time for training semisupervised SVM, we propose a batch-mode incremental learning method, which can also be easily applied to the online BCI systems. Additionally, it is suggested in many studies that common spatial pattern (CSP is very effective in discriminating two different brain states. However, CSP needs a sufficient labeled data set. In order to overcome the drawback of CSP, we suggest a two-stage feature extraction method for the semisupervised learning algorithm. We apply our algorithm to two BCI experimental data sets. The offline data analysis results demonstrate the effectiveness of our algorithm.

  16. Fuzzy support vector machines based on linear clustering

    Xiong, Shengwu; Liu, Hongbing; Niu, Xiaoxiao


    A new Fuzzy Support Vector Machines (FSVMs) based on linear clustering is proposed in this paper. Its concept comes from the idea of linear clustering, selecting the data points near to the preformed hyperplane, which is formed on the training set including one positive and one negative training samples respectively. The more important samples near to the preformed hyperplane are selected by linear clustering technique, and the new FSVMs are formed on the more important data set. It integrates the merit of two kinds of FSVMs. The membership functions are defined using the relative distance between the data points and the preformed hyperplane during the training process. The fuzzy membership decision functions of multi-class FSVMs adopt the minimal value of all the decision functions of two-class FSVMs. To demonstrate the superiority of our methods, the benchmark data sets of machines learning databases are selected to verify the proposed FSVMs. The experimental results indicate that the proposed FSVMs can reduce the training data and running time, and its recognition rate is greater than or equal to that of FSVMs through selecting a suitable linear clustering parameter.

  17. Detection of Splice Sites Using Support Vector Machine

    Varadwaj, Pritish; Purohit, Neetesh; Arora, Bhumika

    Automatic identification and annotation of exon and intron region of gene, from DNA sequences has been an important research area in field of computational biology. Several approaches viz. Hidden Markov Model (HMM), Artificial Intelligence (AI) based machine learning and Digital Signal Processing (DSP) techniques have extensively and independently been used by various researchers to cater this challenging task. In this work, we propose a Support Vector Machine based kernel learning approach for detection of splice sites (the exon-intron boundary) in a gene. Electron-Ion Interaction Potential (EIIP) values of nucleotides have been used for mapping character sequences to corresponding numeric sequences. Radial Basis Function (RBF) SVM kernel is trained using EIIP numeric sequences. Furthermore this was tested on test gene dataset for detection of splice site by window (of 12 residues) shifting. Optimum values of window size, various important parameters of SVM kernel have been optimized for a better accuracy. Receiver Operating Characteristic (ROC) curves have been utilized for displaying the sensitivity rate of the classifier and results showed 94.82% accuracy for splice site detection on test dataset.

  18. A Reformulation of Support Vector Machines for General Confidence Functions

    Guo, Yuhong; Schuurmans, Dale

    We present a generalized view of support vector machines that does not rely on a Euclidean geometric interpretation nor even positive semidefinite kernels. We base our development instead on the confidence matrix—the matrix normally determined by the direct (Hadamard) product of the kernel matrix with the label outer-product matrix. It turns out that alternative forms of confidence matrices are possible, and indeed useful. By focusing on the confidence matrix instead of the underlying kernel, we can derive an intuitive principle for optimizing example weights to yield robust classifiers. Our principle initially recovers the standard quadratic SVM training criterion, which is only convex for kernel-derived confidence measures. However, given our generalized view, we are then able to derive a principled relaxation of the SVM criterion that yields a convex upper bound. This relaxation is always convex and can be solved with a linear program. Our new training procedure obtains similar generalization performance to standard SVMs on kernel-derived confidence functions, but achieves even better results with indefinite confidence functions.

  19. Incremental support vector machines for fast reliable image recognition

    Makili, L., E-mail: [Instituto Superior Politécnico da Universidade Katyavala Bwila, Benguela (Angola); Vega, J. [Asociación EURATOM/CIEMAT para Fusión, Madrid (Spain); Dormido-Canto, S. [Dpto. Informática y Automática – UNED, Madrid (Spain)


    Highlights: ► A conformal predictor using SVM as the underlying algorithm was implemented. ► It was applied to image recognition in the TJ–II's Thomson Scattering Diagnostic. ► To improve time efficiency an approach to incremental SVM training has been used. ► Accuracy is similar to the one reached when standard SVM is used. ► Computational time saving is significant for large training sets. -- Abstract: This paper addresses the reliable classification of images in a 5-class problem. To this end, an automatic recognition system, based on conformal predictors and using Support Vector Machines (SVM) as the underlying algorithm has been developed and applied to the recognition of images in the Thomson Scattering Diagnostic of the TJ–II fusion device. Using such conformal predictor based classifier is a computationally intensive task since it implies to train several SVM models to classify a single example and to perform this training from scratch takes a significant amount of time. In order to improve the classification time efficiency, an approach to the incremental training of SVM has been used as the underlying algorithm. Experimental results show that the overall performance of the new classifier is high, comparable to the one corresponding to the use of standard SVM as the underlying algorithm and there is a significant improvement in time efficiency.

  20. Support Vector Regression and Genetic Algorithm for HVAC Optimal Operation

    Ching-Wei Chen


    Full Text Available This study covers records of various parameters affecting the power consumption of air-conditioning systems. Using the Support Vector Machine (SVM, the chiller power consumption model, secondary chilled water pump power consumption model, air handling unit fan power consumption model, and air handling unit load model were established. In addition, it was found that R2 of the models all reached 0.998, and the training time was far shorter than that of the neural network. Through genetic programming, a combination of operating parameters with the least power consumption of air conditioning operation was searched. Moreover, the air handling unit load in line with the air conditioning cooling load was predicted. The experimental results show that for the combination of operating parameters with the least power consumption in line with the cooling load obtained through genetic algorithm search, the power consumption of the air conditioning systems under said combination of operating parameters was reduced by 22% compared to the fixed operating parameters, thus indicating significant energy efficiency.

  1. Classification of Cotton Leaf Spot Disease Using Support Vector Machine

    Prof. Sonal P. Patil


    Full Text Available In order to obtain more value added products, a product quality control is essentially required Many studies show that quality of agriculture products may be reduced from many causes. One of the most important factors of such quality plant diseases. Consequently, minimizing plant diseases allows substantially improving quality of the product Suitable diagnosis of crop disease in the field is very critical for the increased production. Foliar is the major important fungal disease of cotton and occurs in all growing Indian cotton regions. In this paper I express Technological Strategies uses mobile captured symptoms of Cotton Leaf Spot images and categorize the diseases using support vector machine. The classifier is being trained to achieve intelligent farming, including early detection of disease in the groves, selective fungicide application, etc. This proposed work is based on Segmentation techniques in which, the captured images are processed for enrichment first. Then texture and color Feature extraction techniques are used to extract features such as boundary, shape, color and texture for the disease spots to recognize diseases.

  2. Data filtering with support vector machines in geometric camera calibration.

    Ergun, B; Kavzoglu, T; Colkesen, I; Sahin, C


    The use of non-metric digital cameras in close-range photogrammetric applications and machine vision has become a popular research agenda. Being an essential component of photogrammetric evaluation, camera calibration is a crucial stage for non-metric cameras. Therefore, accurate camera calibration and orientation procedures have become prerequisites for the extraction of precise and reliable 3D metric information from images. The lack of accurate inner orientation parameters can lead to unreliable results in the photogrammetric process. A camera can be well defined with its principal distance, principal point offset and lens distortion parameters. Different camera models have been formulated and used in close-range photogrammetry, but generally sensor orientation and calibration is performed with a perspective geometrical model by means of the bundle adjustment. In this study, support vector machines (SVMs) using radial basis function kernel is employed to model the distortions measured for Olympus Aspherical Zoom lens Olympus E10 camera system that are later used in the geometric calibration process. It is intended to introduce an alternative approach for the on-the-job photogrammetric calibration stage. Experimental results for DSLR camera with three focal length settings (9, 18 and 36 mm) were estimated using bundle adjustment with additional parameters, and analyses were conducted based on object point discrepancies and standard errors. Results show the robustness of the SVMs approach on the correction of image coordinates by modelling total distortions on-the-job calibration process using limited number of images.

  3. Priori Information Based Support Vector Regression and Its Applications

    Litao Ma


    Full Text Available In order to extract the priori information (PI provided by real monitored values of peak particle velocity (PPV and increase the prediction accuracy of PPV, PI based support vector regression (SVR is established. Firstly, to extract the PI provided by monitored data from the aspect of mathematics, the probability density of PPV is estimated with ε-SVR. Secondly, in order to make full use of the PI about fluctuation of PPV between the maximal value and the minimal value in a certain period of time, probability density estimated with ε-SVR is incorporated into training data, and then the dimensionality of training data is increased. Thirdly, using the training data with a higher dimension, a method of predicting PPV called PI-ε-SVR is proposed. Finally, with the collected values of PPV induced by underwater blasting at Dajin Island in Taishan nuclear power station in China, contrastive experiments are made to show the effectiveness of the proposed method.

  4. Explaining Support Vector Machines: A Color Based Nomogram

    Van Belle, Vanya; Van Calster, Ben; Van Huffel, Sabine; Suykens, Johan A. K.; Lisboa, Paulo


    Problem setting Support vector machines (SVMs) are very popular tools for classification, regression and other problems. Due to the large choice of kernels they can be applied with, a large variety of data can be analysed using these tools. Machine learning thanks its popularity to the good performance of the resulting models. However, interpreting the models is far from obvious, especially when non-linear kernels are used. Hence, the methods are used as black boxes. As a consequence, the use of SVMs is less supported in areas where interpretability is important and where people are held responsible for the decisions made by models. Objective In this work, we investigate whether SVMs using linear, polynomial and RBF kernels can be explained such that interpretations for model-based decisions can be provided. We further indicate when SVMs can be explained and in which situations interpretation of SVMs is (hitherto) not possible. Here, explainability is defined as the ability to produce the final decision based on a sum of contributions which depend on one single or at most two input variables. Results Our experiments on simulated and real-life data show that explainability of an SVM depends on the chosen parameter values (degree of polynomial kernel, width of RBF kernel and regularization constant). When several combinations of parameter values yield the same cross-validation performance, combinations with a lower polynomial degree or a larger kernel width have a higher chance of being explainable. Conclusions This work summarizes SVM classifiers obtained with linear, polynomial and RBF kernels in a single plot. Linear and polynomial kernels up to the second degree are represented exactly. For other kernels an indication of the reliability of the approximation is presented. The complete methodology is available as an R package and two apps and a movie are provided to illustrate the possibilities offered by the method. PMID:27723811

  5. A Wavelet Kernel-Based Primal Twin Support Vector Machine for Economic Development Prediction

    Fang Su


    Full Text Available Economic development forecasting allows planners to choose the right strategies for the future. This study is to propose economic development prediction method based on the wavelet kernel-based primal twin support vector machine algorithm. As gross domestic product (GDP is an important indicator to measure economic development, economic development prediction means GDP prediction in this study. The wavelet kernel-based primal twin support vector machine algorithm can solve two smaller sized quadratic programming problems instead of solving a large one as in the traditional support vector machine algorithm. Economic development data of Anhui province from 1992 to 2009 are used to study the prediction performance of the wavelet kernel-based primal twin support vector machine algorithm. The comparison of mean error of economic development prediction between wavelet kernel-based primal twin support vector machine and traditional support vector machine models trained by the training samples with the 3–5 dimensional input vectors, respectively, is given in this paper. The testing results show that the economic development prediction accuracy of the wavelet kernel-based primal twin support vector machine model is better than that of traditional support vector machine.

  6. Support vector machine for day ahead electricity price forecasting

    Razak, Intan Azmira binti Wan Abdul; Abidin, Izham bin Zainal; Siah, Yap Keem; Rahman, Titik Khawa binti Abdul; Lada, M. Y.; Ramani, Anis Niza binti; Nasir, M. N. M.; Ahmad, Arfah binti


    Electricity price forecasting has become an important part of power system operation and planning. In a pool- based electric energy market, producers submit selling bids consisting in energy blocks and their corresponding minimum selling prices to the market operator. Meanwhile, consumers submit buying bids consisting in energy blocks and their corresponding maximum buying prices to the market operator. Hence, both producers and consumers use day ahead price forecasts to derive their respective bidding strategies to the electricity market yet reduce the cost of electricity. However, forecasting electricity prices is a complex task because price series is a non-stationary and highly volatile series. Many factors cause for price spikes such as volatility in load and fuel price as well as power import to and export from outside the market through long term contract. This paper introduces an approach of machine learning algorithm for day ahead electricity price forecasting with Least Square Support Vector Machine (LS-SVM). Previous day data of Hourly Ontario Electricity Price (HOEP), generation's price and demand from Ontario power market are used as the inputs for training data. The simulation is held using LSSVMlab in Matlab with the training and testing data of 2004. SVM that widely used for classification and regression has great generalization ability with structured risk minimization principle rather than empirical risk minimization. Moreover, same parameter settings in trained SVM give same results that absolutely reduce simulation process compared to other techniques such as neural network and time series. The mean absolute percentage error (MAPE) for the proposed model shows that SVM performs well compared to neural network.

  7. Profiled support vector machines for antisense oligonucleotide efficacy prediction

    Martín-Guerrero José D


    Full Text Available Abstract Background This paper presents the use of Support Vector Machines (SVMs for prediction and analysis of antisense oligonucleotide (AO efficacy. The collected database comprises 315 AO molecules including 68 features each, inducing a problem well-suited to SVMs. The task of feature selection is crucial given the presence of noisy or redundant features, and the well-known problem of the curse of dimensionality. We propose a two-stage strategy to develop an optimal model: (1 feature selection using correlation analysis, mutual information, and SVM-based recursive feature elimination (SVM-RFE, and (2 AO prediction using standard and profiled SVM formulations. A profiled SVM gives different weights to different parts of the training data to focus the training on the most important regions. Results In the first stage, the SVM-RFE technique was most efficient and robust in the presence of low number of samples and high input space dimension. This method yielded an optimal subset of 14 representative features, which were all related to energy and sequence motifs. The second stage evaluated the performance of the predictors (overall correlation coefficient between observed and predicted efficacy, r; mean error, ME; and root-mean-square-error, RMSE using 8-fold and minus-one-RNA cross-validation methods. The profiled SVM produced the best results (r = 0.44, ME = 0.022, and RMSE= 0.278 and predicted high (>75% inhibition of gene expression and low efficacy ( Conclusions The SVM approach is well suited to the AO prediction problem, and yields a prediction accuracy superior to previous methods. The profiled SVM was found to perform better than the standard SVM, suggesting that it could lead to improvements in other prediction problems as well.


    K.-Y. Lee


    Full Text Available Cloud covers are generally present in optical remote-sensing images, which limit the usage of acquired images and increase the difficulty of data analysis, such as image compositing, correction of atmosphere effects, calculations of vegetation induces, land cover classification, and land cover change detection. In previous studies, thresholding is a common and useful method in cloud detection. However, a selected threshold is usually suitable for certain cases or local study areas, and it may be failed in other cases. In other words, thresholding-based methods are data-sensitive. Besides, there are many exceptions to control, and the environment is changed dynamically. Using the same threshold value on various data is not effective. In this study, a threshold-free method based on Support Vector Machine (SVM is proposed, which can avoid the abovementioned problems. A statistical model is adopted to detect clouds instead of a subjective thresholding-based method, which is the main idea of this study. The features used in a classifier is the key to a successful classification. As a result, Automatic Cloud Cover Assessment (ACCA algorithm, which is based on physical characteristics of clouds, is used to distinguish the clouds and other objects. In the same way, the algorithm called Fmask (Zhu et al., 2012 uses a lot of thresholds and criteria to screen clouds, cloud shadows, and snow. Therefore, the algorithm of feature extraction is based on the ACCA algorithm and Fmask. Spatial and temporal information are also important for satellite images. Consequently, co-occurrence matrix and temporal variance with uniformity of the major principal axis are used in proposed method. We aim to classify images into three groups: cloud, non-cloud and the others. In experiments, images acquired by the Landsat 7 Enhanced Thematic Mapper Plus (ETM+ and images containing the landscapes of agriculture, snow area, and island are tested. Experiment results demonstrate

  9. Prediction of cell penetrating peptides by support vector machines.

    William S Sanders


    Full Text Available Cell penetrating peptides (CPPs are those peptides that can transverse cell membranes to enter cells. Once inside the cell, different CPPs can localize to different cellular components and perform different roles. Some generate pore-forming complexes resulting in the destruction of cells while others localize to various organelles. Use of machine learning methods to predict potential new CPPs will enable more rapid screening for applications such as drug delivery. We have investigated the influence of the composition of training datasets on the ability to classify peptides as cell penetrating using support vector machines (SVMs. We identified 111 known CPPs and 34 known non-penetrating peptides from the literature and commercial vendors and used several approaches to build training data sets for the classifiers. Features were calculated from the datasets using a set of basic biochemical properties combined with features from the literature determined to be relevant in the prediction of CPPs. Our results using different training datasets confirm the importance of a balanced training set with approximately equal number of positive and negative examples. The SVM based classifiers have greater classification accuracy than previously reported methods for the prediction of CPPs, and because they use primary biochemical properties of the peptides as features, these classifiers provide insight into the properties needed for cell-penetration. To confirm our SVM classifications, a subset of peptides classified as either penetrating or non-penetrating was selected for synthesis and experimental validation. Of the synthesized peptides predicted to be CPPs, 100% of these peptides were shown to be penetrating.

  10. Cloud Detection of Optical Satellite Images Using Support Vector Machine

    Lee, Kuan-Yi; Lin, Chao-Hung


    Cloud covers are generally present in optical remote-sensing images, which limit the usage of acquired images and increase the difficulty of data analysis, such as image compositing, correction of atmosphere effects, calculations of vegetation induces, land cover classification, and land cover change detection. In previous studies, thresholding is a common and useful method in cloud detection. However, a selected threshold is usually suitable for certain cases or local study areas, and it may be failed in other cases. In other words, thresholding-based methods are data-sensitive. Besides, there are many exceptions to control, and the environment is changed dynamically. Using the same threshold value on various data is not effective. In this study, a threshold-free method based on Support Vector Machine (SVM) is proposed, which can avoid the abovementioned problems. A statistical model is adopted to detect clouds instead of a subjective thresholding-based method, which is the main idea of this study. The features used in a classifier is the key to a successful classification. As a result, Automatic Cloud Cover Assessment (ACCA) algorithm, which is based on physical characteristics of clouds, is used to distinguish the clouds and other objects. In the same way, the algorithm called Fmask (Zhu et al., 2012) uses a lot of thresholds and criteria to screen clouds, cloud shadows, and snow. Therefore, the algorithm of feature extraction is based on the ACCA algorithm and Fmask. Spatial and temporal information are also important for satellite images. Consequently, co-occurrence matrix and temporal variance with uniformity of the major principal axis are used in proposed method. We aim to classify images into three groups: cloud, non-cloud and the others. In experiments, images acquired by the Landsat 7 Enhanced Thematic Mapper Plus (ETM+) and images containing the landscapes of agriculture, snow area, and island are tested. Experiment results demonstrate the detection

  11. A comparative study of surface EMG classification by fuzzy relevance vector machine and fuzzy support vector machine.

    Xie, Hong-Bo; Huang, Hu; Wu, Jianhua; Liu, Lei


    We present a multiclass fuzzy relevance vector machine (FRVM) learning mechanism and evaluate its performance to classify multiple hand motions using surface electromyographic (sEMG) signals. The relevance vector machine (RVM) is a sparse Bayesian kernel method which avoids some limitations of the support vector machine (SVM). However, RVM still suffers the difficulty of possible unclassifiable regions in multiclass problems. We propose two fuzzy membership function-based FRVM algorithms to solve such problems, based on experiments conducted on seven healthy subjects and two amputees with six hand motions. Two feature sets, namely, AR model coefficients and room mean square value (AR-RMS), and wavelet transform (WT) features, are extracted from the recorded sEMG signals. Fuzzy support vector machine (FSVM) analysis was also conducted for wide comparison in terms of accuracy, sparsity, training and testing time, as well as the effect of training sample sizes. FRVM yielded comparable classification accuracy with dramatically fewer support vectors in comparison with FSVM. Furthermore, the processing delay of FRVM was much less than that of FSVM, whilst training time of FSVM much faster than FRVM. The results indicate that FRVM classifier trained using sufficient samples can achieve comparable generalization capability as FSVM with significant sparsity in multi-channel sEMG classification, which is more suitable for sEMG-based real-time control applications.

  12. Kernel Learning in Support Vector Machines using Dual-Objective Optimization

    Pietersma, Auke-Dirk; Schomaker, Lambertus; Wiering, Marco


    Support vector machines (SVMs) are very popular methods for solving classification problems that require mapping input features to target labels. When dealing with real-world data sets, the different classes are usually not linearly separable, and therefore support vector machines employ a particula

  13. Comparison of ν-support vector regression and logistic equation for ...



    Jul 4, 2011 ... DOI: 10.5897/AJB10.2086. ISSN 1684–5315 ... As a novel type of learning method, support ... formalism known as the support vector machines (SVMs) ..... fermentation process using neural networks and genetic algorithms.

  14. Towards automatic lithological classification from remote sensing data using support vector machines

    Yu, Le; Porwal, Alok; Holden, Eun-Jung; Dentith, Michael


    Remote sensing data can be effectively used as a mean to build geological knowledge for poorly mapped terrains. Spectral remote sensing data from space- and air-borne sensors have been widely used to geological mapping, especially in areas of high outcrop density in arid regions. However, spectral remote sensing information by itself cannot be efficiently used for a comprehensive lithological classification of an area due to (1) diagnostic spectral response of a rock within an image pixel is conditioned by several factors including the atmospheric effects, spectral and spatial resolution of the image, sub-pixel level heterogeneity in chemical and mineralogical composition of the rock, presence of soil and vegetation cover; (2) only surface information and is therefore highly sensitive to the noise due to weathering, soil cover, and vegetation. Consequently, for efficient lithological classification, spectral remote sensing data needs to be supplemented with other remote sensing datasets that provide geomorphological and subsurface geological information, such as digital topographic model (DEM) and aeromagnetic data. Each of the datasets contain significant information about geology that, in conjunction, can potentially be used for automated lithological classification using supervised machine learning algorithms. In this study, support vector machine (SVM), which is a kernel-based supervised learning method, was applied to automated lithological classification of a study area in northwestern India using remote sensing data, namely, ASTER, DEM and aeromagnetic data. Several digital image processing techniques were used to produce derivative datasets that contained enhanced information relevant to lithological discrimination. A series of SVMs (trained using k-folder cross-validation with grid search) were tested using various combinations of input datasets selected from among 50 datasets including the original 14 ASTER bands and 36 derivative datasets (including 14

  15. Automated novelty detection in the WISE survey with one-class support vector machines

    Solarz, A.; Bilicki, M.; Gromadzki, M.; Pollo, A.; Durkalec, A.; Wypych, M.


    Wide-angle photometric surveys of previously uncharted sky areas or wavelength regimes will always bring in unexpected sources - novelties or even anomalies - whose existence and properties cannot be easily predicted from earlier observations. Such objects can be efficiently located with novelty detection algorithms. Here we present an application of such a method, called one-class support vector machines (OCSVM), to search for anomalous patterns among sources preselected from the mid-infrared AllWISE catalogue covering the whole sky. To create a model of expected data we train the algorithm on a set of objects with spectroscopic identifications from the SDSS DR13 database, present also in AllWISE. The OCSVM method detects as anomalous those sources whose patterns - WISE photometric measurements in this case - are inconsistent with the model. Among the detected anomalies we find artefacts, such as objects with spurious photometry due to blending, but more importantly also real sources of genuine astrophysical interest. Among the latter, OCSVM has identified a sample of heavily reddened AGN/quasar candidates distributed uniformly over the sky and in a large part absent from other WISE-based AGN catalogues. It also allowed us to find a specific group of sources of mixed types, mostly stars and compact galaxies. By combining the semi-supervised OCSVM algorithm with standard classification methods it will be possible to improve the latter by accounting for sources which are not present in the training sample, but are otherwise well-represented in the target set. Anomaly detection adds flexibility to automated source separation procedures and helps verify the reliability and representativeness of the training samples. It should be thus considered as an essential step in supervised classification schemes to ensure completeness and purity of produced catalogues. The catalogues of outlier data are only available at the CDS via anonymous ftp to http

  16. Vectors

    Boeriis, Morten; van Leeuwen, Theo


    This article revisits the concept of vectors, which, in Kress and van Leeuwen’s Reading Images (2006), plays a crucial role in distinguishing between ‘narrative’, action-oriented processes and ‘conceptual’, state-oriented processes. The use of this concept in image analysis has usually focused...... on the most salient vectors, and this works well, but many images contain a plethora of vectors, which makes their structure quite different from the linguistic transitivity structures with which Kress and van Leeuwen have compared ‘narrative’ images. It can also be asked whether facial expression vectors...... should be taken into account in discussing ‘reactions’, which Kress and van Leeuwen link only to eyeline vectors. Finally, the question can be raised as to whether actions are always realized by vectors. Drawing on a re-reading of Rudolf Arnheim’s account of vectors, these issues are outlined...

  17. Support Vector Machine Model for Automatic Detection and Classification of Seismic Events

    Barros, Vesna; Barros, Lucas


    The automated processing of multiple seismic signals to detect, localize and classify seismic events is a central tool in both natural hazards monitoring and nuclear treaty verification. However, false detections and missed detections caused by station noise and incorrect classification of arrivals are still an issue and the events are often unclassified or poorly classified. Thus, machine learning techniques can be used in automatic processing for classifying the huge database of seismic recordings and provide more confidence in the final output. Applied in the context of the International Monitoring System (IMS) - a global sensor network developed for the Comprehensive Nuclear-Test-Ban Treaty (CTBT) - we propose a fully automatic method for seismic event detection and classification based on a supervised pattern recognition technique called the Support Vector Machine (SVM). According to Kortström et al., 2015, the advantages of using SVM are handleability of large number of features and effectiveness in high dimensional spaces. Our objective is to detect seismic events from one IMS seismic station located in an area of high seismicity and mining activity and classify them as earthquakes or quarry blasts. It is expected to create a flexible and easily adjustable SVM method that can be applied in different regions and datasets. Taken a step further, accurate results for seismic stations could lead to a modification of the model and its parameters to make it applicable to other waveform technologies used to monitor nuclear explosions such as infrasound and hydroacoustic waveforms. As an authorized user, we have direct access to all IMS data and bulletins through a secure signatory account. A set of significant seismic waveforms containing different types of events (e.g. earthquake, quarry blasts) and noise is being analysed to train the model and learn the typical pattern of the signal from these events. Moreover, comparing the performance of the support-vector

  18. Support vector machines for TEC seismo-ionospheric anomalies detection

    M. Akhoondzadeh


    Full Text Available Using time series prediction methods, it is possible to pursue the behaviors of earthquake precursors in the future and to announce early warnings when the differences between the predicted value and the observed value exceed the predefined threshold value. Support Vector Machines (SVMs are widely used due to their many advantages for classification and regression tasks. This study is concerned with investigating the Total Electron Content (TEC time series by using a SVM to detect seismo-ionospheric anomalous variations induced by the three powerful earthquakes of Tohoku (11 March 2011, Haiti (12 January 2010 and Samoa (29 September 2009. The duration of TEC time series dataset is 49, 46 and 71 days, for Tohoku, Haiti and Samoa earthquakes, respectively, with each at time resolution of 2 h. In the case of Tohoku earthquake, the results show that the difference between the predicted value obtained from the SVM method and the observed value reaches the maximum value (i.e., 129.31 TECU at earthquake time in a period of high geomagnetic activities. The SVM method detected a considerable number of anomalous occurrences 1 and 2 days prior to the Haiti earthquake and also 1 and 5 days before the Samoa earthquake in a period of low geomagnetic activities. In order to show that the method is acting sensibly with regard to the results extracted during nonevent and event TEC data, i.e., to perform some null-hypothesis tests in which the methods would also be calibrated, the same period of data from the previous year of the Samoa earthquake date has been taken into the account. Further to this, in this study, the detected TEC anomalies using the SVM method were compared to the previous results (Akhoondzadeh and Saradjian, 2011; Akhoondzadeh, 2012 obtained from the mean, median, wavelet and Kalman filter methods. The SVM detected anomalies are similar to those detected using the previous methods. It can be concluded that SVM can be a suitable learning method

  19. Instability of anisotropic cosmological solutions supported by vector fields.

    Himmetoglu, Burak; Contaldi, Carlo R; Peloso, Marco


    Models with vector fields acquiring a nonvanishing vacuum expectation value along one spatial direction have been proposed to sustain a prolonged stage of anisotropic accelerated expansion. Such models have been used for realizations of early time inflation, with a possible relation to the large scale cosmic microwave background anomalies, or of the late time dark energy. We show that, quite generally, the concrete realizations proposed so far are plagued by instabilities (either ghosts or unstable growth of the linearized perturbations) which can be ultimately related to the longitudinal vector polarization present in them. Phenomenological results based on these models are therefore unreliable.

  20. The Emergence of Family-specific Support Constructs: Cross-level Effects of Family-supportive Supervision and Family-Supportive Organization Perceptions on Individual Outcomes.

    Hill, Rachel T; Matthews, Russell A; Walsh, Benjamin M


    Implicit to the definitions of both family-supportive supervision (FSS) and family-supportive organization perceptions (FSOP) is the argument that these constructs may manifest at a higher (e.g. group or organizational) level. In line with these conceptualizations, grounded in tenants of conservation of resources theory, we argue that FSS and FSOP, as universal resources, are emergent constructs at the organizational level, which have cross-level effects on work-family conflict and turnover intentions. To test our theoretically derived hypotheses, a multilevel model was examined in which FSS and FSOP at the unit level predict individual work-to-family conflict, which in turn predicts turnover intentions. Our hypothesized model was generally supported. Collectively, our results point to FSOP serving as an explanatory mechanism of the effects that mutual perceptions of FSS have on individual experiences of work-to-family conflict and turnover intentions. Lagged (i.e. overtime) cross-level effects of the model were also confirmed in supplementary analyses. Our results extend our theoretical understanding of FSS and FSOP by demonstrating the utility of conceptualizing them as universal resources, opening up a variety of avenues for future research. Copyright © 2015 John Wiley & Sons, Ltd. Copyright © 2015 John Wiley & Sons, Ltd.


    M. Ustuner


    Full Text Available The accuracy of supervised image classification is highly dependent upon several factors such as the design of training set (sample selection, composition, purity and size, resolution of input imagery and landscape heterogeneity. The design of training set is still a challenging issue since the sensitivity of classifier algorithm at learning stage is different for the same dataset. In this paper, the classification of RapidEye imagery with balanced and imbalanced training data for mapping the crop types was addressed. Classification with imbalanced training data may result in low accuracy in some scenarios. Support Vector Machines (SVM, Maximum Likelihood (ML and Artificial Neural Network (ANN classifications were implemented here to classify the data. For evaluating the influence of the balanced and imbalanced training data on image classification algorithms, three different training datasets were created. Two different balanced datasets which have 70 and 100 pixels for each class of interest and one imbalanced dataset in which each class has different number of pixels were used in classification stage. Results demonstrate that ML and NN classifications are affected by imbalanced training data in resulting a reduction in accuracy (from 90.94% to 85.94% for ML and from 91.56% to 88.44% for NN while SVM is not affected significantly (from 94.38% to 94.69% and slightly improved. Our results highlighted that SVM is proven to be a very robust, consistent and effective classifier as it can perform very well under balanced and imbalanced training data situations. Furthermore, the training stage should be precisely and carefully designed for the need of adopted classifier.

  2. Phytoplankton global mapping from space with a support vector machine algorithm

    de Boissieu, Florian; Menkes, Christophe; Dupouy, Cécile; Rodier, Martin; Bonnet, Sophie; Mangeas, Morgan; Frouin, Robert J.


    In recent years great progress has been made in global mapping of phytoplankton from space. Two main trends have emerged, the recognition of phytoplankton functional types (PFT) based on reflectance normalized to chlorophyll-a concentration, and the recognition of phytoplankton size class (PSC) based on the relationship between cell size and chlorophyll-a concentration. However, PFTs and PSCs are not decorrelated, and one approach can complement the other in a recognition task. In this paper, we explore the recognition of several dominant PFTs by combining reflectance anomalies, chlorophyll-a concentration and other environmental parameters, such as sea surface temperature and wind speed. Remote sensing pixels are labeled thanks to coincident in-situ pigment data from GeP&CO, NOMAD and MAREDAT datasets, covering various oceanographic environments. The recognition is made with a supervised Support Vector Machine classifier trained on the labeled pixels. This algorithm enables a non-linear separation of the classes in the input space and is especially adapted for small training datasets as available here. Moreover, it provides a class probability estimate, allowing one to enhance the robustness of the classification results through the choice of a minimum probability threshold. A greedy feature selection associated to a 10-fold cross-validation procedure is applied to select the most discriminative input features and evaluate the classification performance. The best classifiers are finally applied on daily remote sensing datasets (SeaWIFS, MODISA) and the resulting dominant PFT maps are compared with other studies. Several conclusions are drawn: (1) the feature selection highlights the weight of temperature, chlorophyll-a and wind speed variables in phytoplankton recognition; (2) the classifiers show good results and dominant PFT maps in agreement with phytoplankton distribution knowledge; (3) classification on MODISA data seems to perform better than on SeaWIFS data

  3. Balanced VS Imbalanced Training Data: Classifying Rapideye Data with Support Vector Machines

    Ustuner, M.; Sanli, F. B.; Abdikan, S.


    The accuracy of supervised image classification is highly dependent upon several factors such as the design of training set (sample selection, composition, purity and size), resolution of input imagery and landscape heterogeneity. The design of training set is still a challenging issue since the sensitivity of classifier algorithm at learning stage is different for the same dataset. In this paper, the classification of RapidEye imagery with balanced and imbalanced training data for mapping the crop types was addressed. Classification with imbalanced training data may result in low accuracy in some scenarios. Support Vector Machines (SVM), Maximum Likelihood (ML) and Artificial Neural Network (ANN) classifications were implemented here to classify the data. For evaluating the influence of the balanced and imbalanced training data on image classification algorithms, three different training datasets were created. Two different balanced datasets which have 70 and 100 pixels for each class of interest and one imbalanced dataset in which each class has different number of pixels were used in classification stage. Results demonstrate that ML and NN classifications are affected by imbalanced training data in resulting a reduction in accuracy (from 90.94% to 85.94% for ML and from 91.56% to 88.44% for NN) while SVM is not affected significantly (from 94.38% to 94.69%) and slightly improved. Our results highlighted that SVM is proven to be a very robust, consistent and effective classifier as it can perform very well under balanced and imbalanced training data situations. Furthermore, the training stage should be precisely and carefully designed for the need of adopted classifier.

  4. Using a geographical-information-system-based decision support to enhance malaria vector control in zambia.

    Chanda, Emmanuel; Mukonka, Victor Munyongwe; Mthembu, David; Kamuliwo, Mulakwa; Coetzer, Sarel; Shinondo, Cecilia Jill


    Geographic information systems (GISs) with emerging technologies are being harnessed for studying spatial patterns in vector-borne diseases to reduce transmission. To implement effective vector control, increased knowledge on interactions of epidemiological and entomological malaria transmission determinants in the assessment of impact of interventions is critical. This requires availability of relevant spatial and attribute data to support malaria surveillance, monitoring, and evaluation. Monitoring the impact of vector control through a GIS-based decision support (DSS) has revealed spatial relative change in prevalence of infection and vector susceptibility to insecticides and has enabled measurement of spatial heterogeneity of trend or impact. The revealed trends and interrelationships have allowed the identification of areas with reduced parasitaemia and increased insecticide resistance thus demonstrating the impact of resistance on vector control. The GIS-based DSS provides opportunity for rational policy formulation and cost-effective utilization of limited resources for enhanced malaria vector control.

  5. [Comparative efficiency of algorithms based on support vector machines for binary classification].

    Kadyrova, N O; Pavlova, L V


    Methods of construction of support vector machines require no further a priori infoimation and provide big data processing, what is especially important for various problems in computational biology. The question of the quality of learning algorithms is considered. The main algorithms of support vector machines for binary classification are reviewed and they were comparatively explored for their efficiencies. The critical analysis of the results of this study revealed the most effective support-vector-classifiers. The description of the recommended algorithms, sufficient for their practical implementation, is presented.

  6. Kollegial supervision

    Andersen, Ole Dibbern; Petersson, Erling

    Publikationen belyser, hvordan kollegial supervision i en kan organiseres i en uddannelsesinstitution......Publikationen belyser, hvordan kollegial supervision i en kan organiseres i en uddannelsesinstitution...

  7. Insect cell transformation vectors that support high level expression and promoter assessment in insect cell culture

    A somatic transformation vector, pDP9, was constructed that provides a simplified means of producing permanently transformed cultured insect cells that support high levels of protein expression of foreign genes. The pDP9 plasmid vector incorporates DNA sequences from the Junonia coenia densovirus th...

  8. Multiple Crop Classification Using Various Support Vector Machine Kernel Functions

    Rupali R. Surase


    Full Text Available This study was carried out with techniques of Remote Sensing (RS based crop discrimination and area estimation with single date approach. Several kernel functions are employed and compared in this study for mapping the input space with including linear, sigmoid, and polynomial and Radial Basis Function (RBF. The present study highlights the advantages of Remote Sensing (RS and Geographic Information System (GIS techniques for analyzing the land use/land cover mapping for Aurangabad region of Maharashtra, India. Single date, cloud free IRS-Resourcesat-1 LISS-III data was used for further classification on training set for supervised classification. ENVI 4.4 is used for image analysis and interpretation. The experimental tests show that system is achieved 94.82% using SVM with kernel functions including Polynomial kernel function compared with Radial Basis Function, Sigmoid and linear kernel. The Overall Accuracy (OA to up to 5.17% in comparison to using sigmoid kernel function, and up to 3.45% in comparison to a 3rd degree polynomial kernel function and RBF with 200 as a penalty parameter.

  9. A support vector machine approach to detect financial statement fraud in South Africa: A first look

    Moepya, SO


    Full Text Available Auditors face the difficult task of detecting companies that issue manipulated financial statements. In recent years, machine learning methods have provided a feasible solution to this task. This study develops support vector machine (SVM) models...



    Gears alternately mesh and detach in driving process, and then working conditions of gears are alternately changing, so they are easy to be spalled and worn. But because of the effect of additive gaussian measurement noises, the signal-to-noises ratio is low; their fault features are difficult to extract. This study aims to propose an approach of gear faults classification,using the cumulants and support vector machines. The cumulants can eliminate the additive gaussian noises, boost the signal-to-noises ratio. Generalisation of support vector machines as classifier, which is employed structural risk minimisation principle, is superior to that of conventional neural networks, which is employed traditional empirical risk minimisation principle. Support vector machines as the classifier, and the third and fourth order cumulants as input, gears faults are successfully recognized. The experimental results show that the method of fault classification combining cumulants with support vector machines is very effective.

  11. Support vector machine based on chaos particle swarm optimization for fault diagnosis of rotating machine

    TANG Xian-lun; ZHUANG Ling; QIU Guo-qing; CAI Jun


    The performance of the support vector machine models depends on a proper setting of its parameters to a great extent. A novel method of searching the optimal parameters of support vector machine based on chaos particle swarm optimization is proposed. A multi-fault classification model based on SVM optimized by chaos particle swarm optimization is established and applied to the fault diagnosis of rotating machines. The results show that the proposed fault classification model outperforms the neural network trained by chaos particle swarm optimization and least squares support vector machine, and the precision and reliability of the fault classification results can meet the requirement of practical application. It indicates that chaos particle swarm optimization is a suitable method for searching the optimal parameters of support vector machine.

  12. Protein domain boundary prediction by combining support vector machine and domain guess by size algorithm

    Dong Qiwen; Wang Xiaolong; Lin Lei


    Successful prediction of protein domain boundaries provides valuable information not only for the computational structure prediction of multi-domain proteins but also for the experimental structure determination. A novel method for domain boundary prediction has been presented, which combines the support vector machine with domain guess by size algorithm. Since the evolutional information of multiple domains can be detected by position specific score matrix, the support vector machine method is trained and tested using the values of position specific score matrix generated by PSI-BLAST. The candidate domain boundaries are selected from the output of support vector machine, and are then inputted to domain guess by size algorithm to give the final results of domain boundary prediction. The experimental results show that the combined method outperforms the individual method of both support vector machine and domain guess by size.

  13. Mass detection algorithm based on support vector machine and relevance feedback

    Ying WANG; Xinbo GAO


    To improve the detection of mass with appearance that borders on the similarity between mass and density tissues in the breast,an support vector machine classifier based on typical features iS designed to classify the region of interest(ROI).Furthermore,relevance feedback is introduced to improve the performance of support vector machines.A new mass detection scheme based on the support vector machine and the relevance feedback is proposed.Simulation experiments on mammograms illustrate that the novel support vector machine classifier based on typical features can improve the detection performance of the featureless classifier by 5%,while the introduction of relevance feedback can further improve the detection performance to about 90%.

  14. Particle Filter with Binary Gaussian Weighting and Support Vector Machine for Human Pose Interpretation

    Indah Agustien; Muhammad Rahmat Widyanto; Sukmawati Endah; Tarzan Basaruddin


    Human pose interpretation using Particle filter with Binary Gaussian Weighting and Support Vector Machine is proposed. In the proposed system, Particle filter is used to track human object, then this human object is skeletonized using thinning algorithm and classified using Support Vector Machine. The classification is to identify human pose, whether a normal or abnormal behavior. Here Particle filter is modified through weight calculation using Gaussiandistribution to reduce t...

  15. Multiscale asymmetric orthogonal wavelet kernel for linear programming support vector learning and nonlinear dynamic systems identification.

    Lu, Zhao; Sun, Jing; Butts, Kenneth


    Support vector regression for approximating nonlinear dynamic systems is more delicate than the approximation of indicator functions in support vector classification, particularly for systems that involve multitudes of time scales in their sampled data. The kernel used for support vector learning determines the class of functions from which a support vector machine can draw its solution, and the choice of kernel significantly influences the performance of a support vector machine. In this paper, to bridge the gap between wavelet multiresolution analysis and kernel learning, the closed-form orthogonal wavelet is exploited to construct new multiscale asymmetric orthogonal wavelet kernels for linear programming support vector learning. The closed-form multiscale orthogonal wavelet kernel provides a systematic framework to implement multiscale kernel learning via dyadic dilations and also enables us to represent complex nonlinear dynamics effectively. To demonstrate the superiority of the proposed multiscale wavelet kernel in identifying complex nonlinear dynamic systems, two case studies are presented that aim at building parallel models on benchmark datasets. The development of parallel models that address the long-term/mid-term prediction issue is more intricate and challenging than the identification of series-parallel models where only one-step ahead prediction is required. Simulation results illustrate the effectiveness of the proposed multiscale kernel learning.

  16. Chaotic time series prediction using mean-field theory for support vector machine

    Cui Wan-Zhao; Zhu Chang-Chun; Bao Wen-Xing; Liu Jun-Hua


    This paper presents a novel method for predicting chaotic time series which is based on the support vector machines approach, and it uses the mean-field theory for developing an easy and efficient learning procedure for the support vector machine. The proposed method approximates the distribution of the support vector machine parameters to a Gaussian process and uses the mean-field theory to estimate these parameters easily, and select the weights of the mixture of kernels used in the support vector machine estimation more accurately and faster than traditional quadratic programming-based algorithms. Finally, relationships between the embedding dimension and the predicting performance of this method are discussed, and the Mackey-Glass equation is applied to test this method. The stimulations show that the mean-field theory for support vector machine can predict chaotic time series accurately, and even if the embedding dimension is unknown, the predicted results are still satisfactory. This result implies that the mean-field theory for support vector machine is a good tool for studying chaotic time series.

  17. Design of Clinical Support Systems Using Integrated Genetic Algorithm and Support Vector Machine

    Chen, Yung-Fu; Huang, Yung-Fa; Jiang, Xiaoyi; Hsu, Yuan-Nian; Lin, Hsuan-Hung

    Clinical decision support system (CDSS) provides knowledge and specific information for clinicians to enhance diagnostic efficiency and improving healthcare quality. An appropriate CDSS can highly elevate patient safety, improve healthcare quality, and increase cost-effectiveness. Support vector machine (SVM) is believed to be superior to traditional statistical and neural network classifiers. However, it is critical to determine suitable combination of SVM parameters regarding classification performance. Genetic algorithm (GA) can find optimal solution within an acceptable time, and is faster than greedy algorithm with exhaustive searching strategy. By taking the advantage of GA in quickly selecting the salient features and adjusting SVM parameters, a method using integrated GA and SVM (IGS), which is different from the traditional method with GA used for feature selection and SVM for classification, was used to design CDSSs for prediction of successful ventilation weaning, diagnosis of patients with severe obstructive sleep apnea, and discrimination of different cell types form Pap smear. The results show that IGS is better than methods using SVM alone or linear discriminator.

  18. From risky to safer home care: health care assistants striving to overcome a lack of training, supervision, and support

    Lena Swedberg


    Full Text Available Patients receiving home care are becoming increasingly dependent upon competent caregivers’ 24-h availability due to their substantial care needs, often with advanced care and home care technology included. In Sweden, care is often carried out by municipality-employed paraprofessionals such as health care assistants (HC assistants with limited or no health care training, performing advanced care without formal training or support. The aim of this study was to investigate the work experience of the HC assistants and to explore how they manage when delivering 24-h home care to patients with substantial care needs. Grounded theory methodology involving multiple data sources comprising interviews with HC assistants (n=19 and field observations in patients’ homes was used to collect data and constant comparative analysis was used for analysis. The initial analysis revealed a number of barriers, competence gap; trapped in the home setting; poor supervision and unconnected to the patient care system, describing the risks associated with the situations of HC assistants working in home care, thus affecting their working conditions as well as the patient care. The core process identified was the HC assistants’ strivings to combine safe home care with good working conditions by using compensatory processes. The four identified compensatory processes were: day-by-day learning; balancing relations with the patient; self-managing; and navigating the patient care system. By actively employing the compensatory processes, the HC assistants could be said to adopt an inclusive approach, by compensating for their own barriers as well as those of their colleagues’ and taking overall responsibility for their workplace. In conclusion, the importance of supporting HC assistants in relation to their needs for training, supervision,and support from health care professionals must be addressed when organising 24-h home care to patients with substantial care needs

  19. Implications of resolved hypoxemia on the utility of desaturation alerts sent from an anesthesia decision support system to supervising anesthesiologists.

    Epstein, Richard H; Dexter, Franklin


    Hypoxemia (oxygen saturation anesthesia in operating room settings. Alarm management functionality can be added to decision support systems (DSS) to send text alerts about vital signs outside specified thresholds, using data in anesthesia information management systems. We considered enhancing our DSS to send hypoxemia alerts to the text pagers of supervising anesthesiologists. As part of a voluntary application for an investigative device exemption from our IRB to implement such functionality, we evaluated the maximum potential utility of such an alert system. Pulse oximetry values (Spo(2)) were extracted from our anesthesia information management systems for all cases performed in our main operating rooms and ambulatory surgical center between September 1, 2011, and February 4, 2012 (n = 16,870). Hypoxemic episodes (Spo(2) anesthesia care provider to initiate treatment promptly, to interpret or correct artifacts, and to make it easier to call for assistance via a rapid communication system.

  20. Prediction of protein binding sites in protein structures using hidden Markov support vector machine

    Lin Lei


    Full Text Available Abstract Background Predicting the binding sites between two interacting proteins provides important clues to the function of a protein. Recent research on protein binding site prediction has been mainly based on widely known machine learning techniques, such as artificial neural networks, support vector machines, conditional random field, etc. However, the prediction performance is still too low to be used in practice. It is necessary to explore new algorithms, theories and features to further improve the performance. Results In this study, we introduce a novel machine learning model hidden Markov support vector machine for protein binding site prediction. The model treats the protein binding site prediction as a sequential labelling task based on the maximum margin criterion. Common features derived from protein sequences and structures, including protein sequence profile and residue accessible surface area, are used to train hidden Markov support vector machine. When tested on six data sets, the method based on hidden Markov support vector machine shows better performance than some state-of-the-art methods, including artificial neural networks, support vector machines and conditional random field. Furthermore, its running time is several orders of magnitude shorter than that of the compared methods. Conclusion The improved prediction performance and computational efficiency of the method based on hidden Markov support vector machine can be attributed to the following three factors. Firstly, the relation between labels of neighbouring residues is useful for protein binding site prediction. Secondly, the kernel trick is very advantageous to this field. Thirdly, the complexity of the training step for hidden Markov support vector machine is linear with the number of training samples by using the cutting-plane algorithm.

  1. A path algorithm for the support vector domain description and its application to medical imaging

    Sjöstrand, Karl; Hansen, Michael Sass; Larsson, Henrik B. W.


    The support vector domain description is a one-class classification method that estimates the distributional support of a data set. A flexible closed boundary function is used to separate trustworthy data on the inside from outliers on the outside. A single regularization parameter determines the...

  2. Strategic Bidding for Electri city Markets Negotiation Using Support Vector Machines

    Pereira, Rafael; Sousa, Tiago; Pinto, Tiago


    . The ALBidS system allows MASCEM market negotiating players to take the best possible advantages from the market context. This paper presents the application of a Support Vector Machines (SVM) based approach to provide decision support to electricity market players. This strategy is tested and validated...

  3. Data fusion for fault diagnosis using multi-class Support Vector Machines


    Multi-source multi-class classification methods based on multi-class Support Vector Machines and data fusion strategies are proposed in this paper. The centralized and distributed fusion schemes are applied to combine information from several data sources. In the centralized scheme, all information from several data sources is centralized to construct an input space.Then a multi-class Support Vector Machine classifier is trained. In the distributed schemes, the individual data sources are processed separately and modelled by using the multi-class Support Vector Machine. Then new data fusion strategies are proposed to combine the information from the individual multi-class Support Vector Machine models. Our proposed fusion strategies take into account that an Support Vector Machine (SVM) classifier achieves classification by finding the optimal classification hyperplane with maximal margin. The proposed methods are applied for fault diagnosis of a diesel engine. The experimental results showed that almost all the proposed approaches can largely improve the diagnostic accuracy. The robustness of diagnosis is also improved because of the implementation of data fusion strategies. The proposed methods can also be applied in other fields.

  4. A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification

    Wang Lily


    Full Text Available Abstract Background Cancer diagnosis and clinical outcome prediction are among the most important emerging applications of gene expression microarray technology with several molecular signatures on their way toward clinical deployment. Use of the most accurate classification algorithms available for microarray gene expression data is a critical ingredient in order to develop the best possible molecular signatures for patient care. As suggested by a large body of literature to date, support vector machines can be considered "best of class" algorithms for classification of such data. Recent work, however, suggests that random forest classifiers may outperform support vector machines in this domain. Results In the present paper we identify methodological biases of prior work comparing random forests and support vector machines and conduct a new rigorous evaluation of the two algorithms that corrects these limitations. Our experiments use 22 diagnostic and prognostic datasets and show that support vector machines outperform random forests, often by a large margin. Our data also underlines the importance of sound research design in benchmarking and comparison of bioinformatics algorithms. Conclusion We found that both on average and in the majority of microarray datasets, random forests are outperformed by support vector machines both in the settings when no gene selection is performed and when several popular gene selection methods are used.

  5. Supervision Experiences of Professional Counselors Providing Crisis Counseling

    Dupre, Madeleine; Echterling, Lennis G.; Meixner, Cara; Anderson, Robin; Kielty, Michele


    In this phenomenological study, the authors explored supervision experiences of 13 licensed professional counselors in situations requiring crisis counseling. Five themes concerning crisis and supervision were identified from individual interviews. Findings support intensive, immediate crisis supervision and postlicensure clinical supervision.

  6. Special Education Teachers' Experiences Supporting and Supervising Paraeducators: Implications for Special and General Education Settings

    Douglas, Sarah N.; Chapin, Shelley E.; Nolan, James F.


    In recent years, there has been an increase in paraeducator supports, in large part because students with low incidence disabilities are being included more frequently in general education settings. As a result, special education teachers have been given additional supervisory responsibilities related to directing the work of paraeducators in…

  7. Special Education Teachers' Experiences Supporting and Supervising Paraeducators: Implications for Special and General Education Settings

    Douglas, Sarah N.; Chapin, Shelley E.; Nolan, James F.


    In recent years, there has been an increase in paraeducator supports, in large part because students with low incidence disabilities are being included more frequently in general education settings. As a result, special education teachers have been given additional supervisory responsibilities related to directing the work of paraeducators in…

  8. Automated Classification of Epiphyses in the Distal Radius and Ulna using a Support Vector Machine.

    Wang, Ya-hui; Liu, Tai-ang; Wei, Hua; Wan, Lei; Ying, Chong-liang; Zhu, Guang-you


    The aim of this study was to automatically classify epiphyses in the distal radius and ulna using a support vector machine (SVM) and to examine the accuracy of the epiphyseal growth grades generated by the support vector machine. X-ray images of distal radii and ulnae were collected from 140 Chinese teenagers aged between 11.0 and 19.0 years. Epiphyseal growth of the two elements was classified into five grades. Features of each element were extracted using a histogram of oriented gradient (HOG), and models were established using support vector classification (SVC). The prediction results and the validity of the models were evaluated with a cross-validation test and independent test for accuracy (PA ). Our findings suggest that this new technique for epiphyseal classification was successful and that an automated technique using an SVM is reliable and feasible, with a relative high accuracy for the models.

  9. Support vector machine method for forecasting future strong earthquakes in Chinese mainland


    Statistical learning theory is for small-sample statistics. And support vector machine is a new machine learning method based on the statistical learning theory. The support vector machine not only has solved certain problems in many learning methods, such as small sample, over fitting, high dimension and local minimum, but also has a higher generalization (forecasting) ability than that of artificial neural networks. The strong earthquakes in Chinese mainland are related to a certain extent to the intensive seismicity along the main plate boundaries in the world,however, the relation is nonlinear. In the paper, we have studied this unclear relation by the support vector machine method for the purpose of forecasting strong earthquakes in Chinese mainland.

  10. A Support Vector Machine-Based Dynamic Network for Visual Speech Recognition Applications

    Mihaela Gordan


    Full Text Available Visual speech recognition is an emerging research field. In this paper, we examine the suitability of support vector machines for visual speech recognition. Each word is modeled as a temporal sequence of visemes corresponding to the different phones realized. One support vector machine is trained to recognize each viseme and its output is converted to a posterior probability through a sigmoidal mapping. To model the temporal character of speech, the support vector machines are integrated as nodes into a Viterbi lattice. We test the performance of the proposed approach on a small visual speech recognition task, namely the recognition of the first four digits in English. The word recognition rate obtained is at the level of the previous best reported rates.

  11. Application of support vector machine in the prediction of mechanical property of steel materials

    Ling Wang; Zhichun Mu; Hui Guo


    The investigation of the influences of important parameters including steel chemical composition and hot rolling parameters on the mechanical properties of steel is a key for the systems that are used to predict mechanical properties. To improve the prediction accuracy, support vector machine was used to predict the mechanical properties of hot-rolled plain carbon steel Q235B. Support vector machine is a novel machine learning method, which is a powerful tool used to solve the problem characterized by small sample, nonlinearity, and high dimension with a good generalization performance. On the basis of the data collected from the supervisor of hotrolling process, the support vector regression algorithm was used to build prediction models, and the off-line simulation indicates that predicted and measured results are in good agreement.

  12. Small-time scale network traffic prediction based on a local support vector machine regression model

    Meng Qing-Fang; Chen Yue-Hui; Peng Yu-Hua


    In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the reconstructed phase space, the local support vector machine prediction method is used to predict the traffic measurement data, and the BIC-based neighbouring point selection method is used to choose the number of the nearest neighbouring points for the local support vector machine regression model. The experimental results show that the local support vector machine prediction method whose neighbouring points are optimized can effectively predict the small-time scale traffic measurement data and can reproduce the statistical features of real traffic measurements.

  13. DDoS detection based on wavelet kernel support vector machine

    YANG Ming-hui; WANG Ru-chuan


    To enhance the detection accuracy and deduce false positive rate of distributed denial of service (DDoS) attack detection, a new machine learning method was proposed. With the analysis of support vector machine (SVM) and the wavelet kernel function theory, an admissive support vector kernel, which is a wavelet kernel constructed in this article, implements the combination of the wavelet technique with SVM. Then, wavelet support vector machine (WSVM) is applied to DDoS attack detections and as a classifying means to test the validity of the wavelet kernel function. Simulation experiments show that under the same conditions, the predictive ability of WSVM is improved and the computation burden is alleviated. The detection accuracy of WSVM is higher than the traditional SVM by about 4%, while its false positive is lower than the traditional SVM. Thus, for DDoS detections, WSVM shows better detection performance and is more adaptive to the changing network environment.

  14. Lithium-ion battery remaining useful life prediction based on grey support vector machines

    Xiaogang Li


    Full Text Available In this article, an improved grey prediction model is proposed to address low-accuracy prediction issue of grey forecasting model. The first step is using a trigonometric function to transform the original data sequence to smooth the data, which is called smoothness of grey prediction model, and then a grey support vector machine model by integrating the improved grey model with support vector machine is introduced. At the initial stage of the model, trigonometric functions and accumulation generation operation can be used to preprocess the data, which enhances the smoothness of the data and reduces the associated randomness. In addition, support vector machine is implemented to establish a prediction model for the pre-processed data and select the optimal model parameters via genetic algorithms. Finally, the data are restored through the ‘regressive generate’ operation to obtain the forecasting data. To prove that the grey support vector machine model is superior to the other models, the battery life data from the Center for Advanced Life Cycle Engineering are selected, and the presented model is used to predict the remaining useful life of the battery. The predicted result is compared to that of grey model and support vector machines. For a more intuitive comparison of the three models, this article quantifies the root mean square errors for these three different models in the case of different ratio of training samples and prediction samples. The results show that the effect of grey support vector machine model is optimal, and the corresponding root mean square error is only 3.18%.

  15. Application of Hybrid Quantum Tabu Search with Support Vector Regression (SVR for Load Forecasting

    Cheng-Wen Lee


    Full Text Available Hybridizing chaotic evolutionary algorithms with support vector regression (SVR to improve forecasting accuracy is a hot topic in electricity load forecasting. Trapping at local optima and premature convergence are critical shortcomings of the tabu search (TS algorithm. This paper investigates potential improvements of the TS algorithm by applying quantum computing mechanics to enhance the search information sharing mechanism (tabu memory to improve the forecasting accuracy. This article presents an SVR-based load forecasting model that integrates quantum behaviors and the TS algorithm with the support vector regression model (namely SVRQTS to obtain a more satisfactory forecasting accuracy. Numerical examples demonstrate that the proposed model outperforms the alternatives.

  16. Classification of Motor Imagery EEG Signals with Support Vector Machines and Particle Swarm Optimization

    Ma, Yuliang; Ding, Xiaohui; She, Qingshan; Luo, Zhizeng; Potter, Thomas; Zhang, Yingchun


    Support vector machines are powerful tools used to solve the small sample and nonlinear classification problems, but their ultimate classification performance depends heavily upon the selection of appropriate kernel and penalty parameters. In this study, we propose using a particle swarm optimization algorithm to optimize the selection of both the kernel and penalty parameters in order to improve the classification performance of support vector machines. The performance of the optimized classifier was evaluated with motor imagery EEG signals in terms of both classification and prediction. Results show that the optimized classifier can significantly improve the classification accuracy of motor imagery EEG signals. PMID:27313656

  17. Active Learning for Transductive Support Vector Machines with Applications to Text Classification


    This paper presents a novel active learning approach for transductive support vector machines with applications to text classification. The concept of the centroid of the support vectors is proposed so that the selective sampling based on measuring the distance from the unlabeled samples to the centroid is feasible and simple to compute. With additional hypothesis, active learning offers better performance with comparison to regular inductive SVMs and transductive SVMs with random sampling,and it is even competitive to transductive SVMs on all available training data. Experimental results prove that our approach is efficient and easy to implement.

  18. Combination of Multi-class Probability Support Vector Machines for Fault Diagnosis


    To deal with multi-source multi-class classification problems, the method of combining multiple multi-class probability support vector machines (MPSVMs) using Bayesian theory is proposed in this paper. The MPSVMs are designed by mapping the output of standard support vector machines into a calibrated posterior probability by using a learned sigmoid function and then combining these learned binary-class probability SVMs. Two Bayes based methods for combining multiple MPSVMs are applied to improve the performance of classification. Our proposed methods are applied to fault diagnosis of a diesel engine. The experimental results show that the new methods can improve the accuracy and robustness of fault diagnosis.

  19. Gear Fault Diagnosis Based on Rough Set and Support Vector Machine

    TIAN Huifang; SUN Shanxia


    By introducing Rough Set Theory and the principle of Support vector machine, a gear fault diagnosis method based on them is proposed. Firstly, diagnostic decision-making is reduced based on rough set theory, and the noise and redundancy in the sample are removed, then, according to the chosen reduction, a support vector machine multi-classifier is designed for gear fault diagnosis. Therefore, SVM' training data can be reduced and running speed can quicken. Test shows its accuracy and efficiency of gear fault diagnosis.

  20. Support Vector Regression Algorithms in the Forecasting of Daily Maximums of Tropospheric Ozone Concentration in Madrid

    Ortiz-García, E. G.; Salcedo-Sanz, S.; Pérez-Bellido, A. M.; Gascón-Moreno, J.; Portilla-Figueras, A.

    In this paper we present the application of a support vector regression algorithm to a real problem of maximum daily tropospheric ozone forecast. The support vector regression approach proposed is hybridized with an heuristic for optimal selection of hyper-parameters. The prediction of maximum daily ozone is carried out in all the station of the air quality monitoring network of Madrid. In the paper we analyze how the ozone prediction depends on meteorological variables such as solar radiation and temperature, and also we perform a comparison against the results obtained using a multi-layer perceptron neural network in the same prediction problem.

  1. A support vector machine approach for classification of welding defects from ultrasonic signals

    Chen, Yuan; Ma, Hong-Wei; Zhang, Guang-Ming


    Defect classification is an important issue in ultrasonic non-destructive evaluation. A layered multi-class support vector machine (LMSVM) classification system, which combines multiple SVM classifiers through a layered architecture, is proposed in this paper. The proposed LMSVM classification system is applied to the classification of welding defects from ultrasonic test signals. The measured ultrasonic defect echo signals are first decomposed into wavelet coefficients by the wavelet packet transform. The energy of the wavelet coefficients at different frequency channels are used to construct the feature vectors. The bees algorithm (BA) is then used for feature selection and SVM parameter optimisation for the LMSVM classification system. The BA-based feature selection optimises the energy feature vectors. The optimised feature vectors are input to the LMSVM classification system for training and testing. Experimental results of classifying welding defects demonstrate that the proposed technique is highly robust, precise and reliable for ultrasonic defect classification.

  2. Modeling personalized head-related impulse response using support vector regression

    HUANG Qing-hua; FANG Yong


    A new customization approach based on support vector regression (SVR) is proposed to obtain individual headrelated impulse response (HRIR) without complex measurement and special equipment. Principal component analysis (PCA) is first applied to obtain a few principal components and corresponding weight vectors correlated with individual anthropometric parameters. Then the weight vectors act as output of the nonlinear regression model. Some measured anthropometric parameters are selected as input of the model according to the correlation coefficients between the parameters and the weight vectors. After the regression model is learned from the training data, the individual HRIR can be predicted based on the measured anthropometric parameters. Compared with a back-propagation neural network (BPNN) for nonlinear regression,better generalization and prediction performance for small training samples can be obtained using the proposed PCA-SVR algorithm.

  3. Exact Dynamic Support Tracking with Multiple Measurement Vectors using Compressive MUSIC

    Kim, Jong Min; Ye, Jong Chul


    Dynamic tracking of sparse targets has been one of the important topics in array signal processing. Recently, compressed sensing (CS) approaches have been extensively investigated as a new tool for this problem using partial support information obtained by exploiting temporal redundancy. However, most of these approaches are formulated under single measurement vector compressed sensing (SMV-CS) framework, where the performance guarantees are only in a probabilistic manner. The main contribution of this paper is to allow \\textit{deterministic} tracking of time varying supports with multiple measurement vectors (MMV) by exploiting multi-sensor diversity. In particular, we show that a novel compressive MUSIC (CS-MUSIC) algorithm with optimized partial support selection not only allows removal of inaccurate portion of previous support estimation but also enables addition of newly emerged part of unknown support. Numerical results confirm the theory.

  4. Single-Trial Classification of Bistable Perception by Integrating Empirical Mode Decomposition, Clustering, and Support Vector Machine

    Hualou Liang


    Full Text Available We propose an empirical mode decomposition (EMD- based method to extract features from the multichannel recordings of local field potential (LFP, collected from the middle temporal (MT visual cortex in a macaque monkey, for decoding its bistable structure-from-motion (SFM perception. The feature extraction approach consists of three stages. First, we employ EMD to decompose nonstationary single-trial time series into narrowband components called intrinsic mode functions (IMFs with time scales dependent on the data. Second, we adopt unsupervised K-means clustering to group the IMFs and residues into several clusters across all trials and channels. Third, we use the supervised common spatial patterns (CSP approach to design spatial filters for the clustered spatiotemporal signals. We exploit the support vector machine (SVM classifier on the extracted features to decode the reported perception on a single-trial basis. We demonstrate that the CSP feature of the cluster in the gamma frequency band outperforms the features in other frequency bands and leads to the best decoding performance. We also show that the EMD-based feature extraction can be useful for evoked potential estimation. Our proposed feature extraction approach may have potential for many applications involving nonstationary multivariable time series such as brain-computer interfaces (BCI.

  5. A support vector machine model provides an accurate transcript-level-based diagnostic for major depressive disorder

    Yu, J S; Xue, A Y; Redei, E E; Bagheri, N


    Major depressive disorder (MDD) is a critical cause of morbidity and disability with an economic cost of hundreds of billions of dollars each year, necessitating more effective treatment strategies and novel approaches to translational research. A notable barrier in addressing this public health threat involves reliable identification of the disorder, as many affected individuals remain undiagnosed or misdiagnosed. An objective blood-based diagnostic test using transcript levels of a panel of markers would provide an invaluable tool for MDD as the infrastructure—including equipment, trained personnel, billing, and governmental approval—for similar tests is well established in clinics worldwide. Here we present a supervised classification model utilizing support vector machines (SVMs) for the analysis of transcriptomic data readily obtained from a peripheral blood specimen. The model was trained on data from subjects with MDD (n=32) and age- and gender-matched controls (n=32). This SVM model provides a cross-validated sensitivity and specificity of 90.6% for the diagnosis of MDD using a panel of 10 transcripts. We applied a logistic equation on the SVM model and quantified a likelihood of depression score. This score gives the probability of a MDD diagnosis and allows the tuning of specificity and sensitivity for individual patients to bring personalized medicine closer in psychiatry. PMID:27779627

  6. Non-metallic coating thickness prediction using artificial neural network and support vector machine with time resolved thermography

    Wang, Hongjin; Hsieh, Sheng-Jen; Peng, Bo; Zhou, Xunfei


    A method without requirements on knowledge about thermal properties of coatings or those of substrates will be interested in the industrial application. Supervised machine learning regressions may provide possible solution to the problem. This paper compares the performances of two regression models (artificial neural networks (ANN) and support vector machines for regression (SVM)) with respect to coating thickness estimations made based on surface temperature increments collected via time resolved thermography. We describe SVM roles in coating thickness prediction. Non-dimensional analyses are conducted to illustrate the effects of coating thicknesses and various factors on surface temperature increments. It's theoretically possible to correlate coating thickness with surface increment. Based on the analyses, the laser power is selected in such a way: during the heating, the temperature increment is high enough to determine the coating thickness variance but low enough to avoid surface melting. Sixty-one pain-coated samples with coating thicknesses varying from 63.5 μm to 571 μm are used to train models. Hyper-parameters of the models are optimized by 10-folder cross validation. Another 28 sets of data are then collected to test the performance of the three methods. The study shows that SVM can provide reliable predictions of unknown data, due to its deterministic characteristics, and it works well when used for a small input data group. The SVM model generates more accurate coating thickness estimates than the ANN model.

  7. The VIMOS Public Extragalactic Redshift Survey (VIPERS). A Support Vector Machine classification of galaxies, stars and AGNs

    Malek, K; Pollo, A; Fritz, A; Garilli, B; Scodeggio, M; Iovino, A; Granett, B R; Abbas, U; Adami, C; Arnouts, S; Bel, J; Bolzonella, M; Bottini, D; Branchini, E; Cappi, A; Coupon, J; Cucciati, O; Davidzon, I; De Lucia, G; de la Torre, S; Franzetti, P; Fumana, M; Guzzo, L; Ilbert, O; Krywult, J; Brun, V Le; Fevre, O Le; Maccagni, D; Marulli, F; McCracken, H J; Paioro, L; Polletta, M; Schlagenhaufer, H; Tasca, L A M; Tojeiro, R; Vergani, D; Zanichelli, A; Burden, A; Di Porto, C; Marchetti, A; Marinoni, C; Mellier, Y; Moscardini, L; Nichol, R C; Peacock, J A; Percival, W J; Phleps, S; Wolk, M; Zamorani, G


    The aim of this work is to develop a comprehensive method for classifying sources in large sky surveys and we apply the techniques to the VIMOS Public Extragalactic Redshift Survey (VIPERS). Using the optical (u*, g', r', i') and NIR data (z', Ks), we develop a classifier for identifying stars, AGNs and galaxies improving the purity of the VIPERS sample. Support Vector Machine (SVM) supervised learning algorithms allow the automatic classification of objects into two or more classes based on a multidimensional parameter space. In this work, we tailored the SVM for classifying stars, AGNs and galaxies, and applied this classification to the VIPERS data. We train the SVM using spectroscopically confirmed sources from the VIPERS and VVDS surveys. We tested two SVM classifiers and concluded that including NIR data can significantly improve the efficiency of the classifier. The self-check of the best optical + NIR classifier has shown a 97% accuracy in the classification of galaxies, 97 for stars, and 95 for AGNs ...

  8. A support vector machine for spectral classification of emission-line galaxies from the Sloan Digital Sky Survey

    Shi, Fei; Liu, Yu-Yan; Sun, Guang-Lan; Li, Pei-Yu; Lei, Yu-Ming; Wang, Jian


    The emission-lines of galaxies originate from massive young stars or supermassive blackholes. As a result, spectral classification of emission-line galaxies into star-forming galaxies, active galactic nucleus (AGN) hosts, or compositions of both relates closely to formation and evolution of galaxy. To find efficient and automatic spectral classification method, especially in large surveys and huge data bases, a support vector machine (SVM) supervised learning algorithm is applied to a sample of emission-line galaxies from the Sloan Digital Sky Survey (SDSS) data release 9 (DR9) provided by the Max Planck Institute and the Johns Hopkins University (MPA/JHU). A two-step approach is adopted. (i) The SVM must be trained with a subset of objects that are known to be AGN hosts, composites or star-forming galaxies, treating the strong emission-line flux measurements as input feature vectors in an n-dimensional space, where n is the number of strong emission-line flux ratios. (ii) After training on a sample of emission-line galaxies, the remaining galaxies are automatically classified. In the classification process, we use a 10-fold cross-validation technique. We show that the classification diagrams based on the [N II]/Hα versus other emission-line ratio, such as [O III]/Hβ, [Ne III]/[O II], ([O III]λ4959+[O III]λ5007)/[O III]λ4363, [O II]/Hβ, [Ar III]/[O III], [S II]/Hα, and [O I]/Hα, plus colour, allows us to separate unambiguously AGN hosts, composites or star-forming galaxies. Among them, the diagram of [N II]/Hα versus [O III]/Hβ achieved an accuracy of 99 per cent to separate the three classes of objects. The other diagrams above give an accuracy of ˜91 per cent.

  9. Simulation and Prediction of Alkalinity in Sintering Process Based on Grey Least Squares Support Vector Machine

    SONG Qiang; WANG Ai-min


    The prediction of the alkalinity is difficult during the sintering process. Whether or not the level of the alkalinity of sintering process is successful is directly related to the quality of sinter. There is no very good method for predicting the alkalinity by now owing to the high complexity, high nonlinearity, strong coupling, high time delay, and etc. Therefore, a new technique, the grey squares support machine, was introduced. The grey support vector machine model of the alkalinity enabled the development of new equation and algorithm to predict the alkalinity. During modelling, the fluctuation of data sequence was weakened by the grey theory and the support vector machine was capable of processing nonlinear adaptable information, and the grey support vector machine has a combination of those advantages. The results revealed that the alkalinity of sinter could be accurately predicted using this model by reference to small sample and information. The experimental results showed that the grey support vector machine model was effective and practical owing to the advantages of high precision, less samples required, and simple calculation.

  10. The Sorting Methods of Support Vector Clustering Based on Boundary Extraction and Category Utility

    Chen Weigao


    Full Text Available According to the problems of low accuracy and high computational complexity in the classification of unknown radar signals, a method of unsupervised Support Vector Clustering (SVC based on boundary extraction and Category Utility (CU of unknown radar signals is studied. By analyzing the principle of SVC, only the boundary data of data sets contribute to the support vector extracted. Thus firstly, for reducing the data set, at the same time reducing the computational complexity, the algorithm is designed to extract the boundary data through local normal vector. Then using CU select the optimal parameters. At last distinguish different categories and get the sorting results by Cone Cluster Labelling (CCL and Depth-First Search (DFS. Through comparing the simulation results, the proposed method which is based on boundary extraction and CU is proved to have turned out quite good time effectiveness, which not only improves the accuracy of classification, but also reduces the computational complexity greatly.

  11. Integrating principal component analysis and vector quantization with support vector regression for sulfur content prediction in HDS process

    Shokri Saeid


    Full Text Available An accurate prediction of sulfur content is very important for the proper operation and product quality control in hydrodesulfurization (HDS process. For this purpose, a reliable data- driven soft sensors utilizing Support Vector Regression (SVR was developed and the effects of integrating Vector Quantization (VQ with Principle Component Analysis (PCA were studied on the assessment of this soft sensor. First, in pre-processing step the PCA and VQ techniques were used to reduce dimensions of the original input datasets. Then, the compressed datasets were used as input variables for the SVR model. Experimental data from the HDS setup were employed to validate the proposed integrated model. The integration of VQ/PCA techniques with SVR model was able to increase the prediction accuracy of SVR. The obtained results show that integrated technique (VQ-SVR was better than (PCA-SVR in prediction accuracy. Also, VQ decreased the sum of the training and test time of SVR model in comparison with PCA. For further evaluation, the performance of VQ-SVR model was also compared to that of SVR. The obtained results indicated that VQ-SVR model delivered the best satisfactory predicting performance (AARE= 0.0668 and R2= 0.995 in comparison with investigated models.

  12. Improving the vector auto regression technique for time-series link prediction by using support vector machine

    Co Jan Miles


    Full Text Available Predicting links between the nodes of a graph has become an important Data Mining task because of its direct applications to biology, social networking, communication surveillance, and other domains. Recent literature in time-series link prediction has shown that the Vector Auto Regression (VAR technique is one of the most accurate for this problem. In this study, we apply Support Vector Machine (SVM to improve the VAR technique that uses an unweighted adjacency matrix along with 5 matrices: Common Neighbor (CN, Adamic-Adar (AA, Jaccard’s Coefficient (JC, Preferential Attachment (PA, and Research Allocation Index (RA. A DBLP dataset covering the years from 2003 until 2013 was collected and transformed into time-sliced graph representations. The appropriate matrices were computed from these graphs, mapped to the feature space, and then used to build baseline VAR models with lag of 2 and some corresponding SVM classifiers. Using the Area Under the Receiver Operating Characteristic Curve (AUC-ROC as the main fitness metric, the average result of 82.04% for the VAR was improved to 84.78% with SVM. Additional experiments to handle the highly imbalanced dataset by oversampling with SMOTE and undersampling with K-means clusters, however, did not improve the average AUC-ROC of the baseline SVM.

  13. SVM-Maj: a majorization approach to linear support vector machines with different hinge errors

    P.J.F. Groenen (Patrick); G.I. Nalbantov (Georgi); J.C. Bioch (Cor)


    textabstractSupport vector machines (SVM) are becoming increasingly popular for the prediction of a binary dependent variable. SVMs perform very well with respect to competing techniques. Often, the solution of an SVM is obtained by switching to the dual. In this paper, we stick to the primal suppor

  14. Experimental comparison of support vector machines with random forests for hyperspectral image land cover classification

    B T Abe; O O Olugbara; T Marwala


    The performances of regular support vector machines and random forests are experimentally compared for hyperspectral imaging land cover classification. Special characteristics of hyperspectral imaging dataset present diverse processing problems to be resolved under robust mathematical formalisms such as image classification. As a result, pixel purity index algorithm is used to obtain endmember spectral responses from Indiana pine hyperspectral image dataset. The generalized reduced gradient optimization algorithm is thereafter executed on the research data to estimate fractional abundances in the hyperspectral image and thereby obtain the numeric values for land cover classification. The Waikato environment for knowledge analysis (WEKA) data mining framework is selected as a tool to carry out the classification process by using support vector machines and random forests classifiers. Results show that performance of support vector machines is comparable to that of random forests. This study makes a positive contribution to the problem of land cover classification by exploring generalized reduced gradient method, support vector machines, and random forests to improve producer accuracy and overall classification accuracy. The performance comparison of these classifiers is valuable for a decision maker to consider tradeoffs in method accuracy versus method complexity.

  15. One Class Classification for Anomaly Detection: Support Vector Data Description Revisited

    Pauwels, E.J.; Ambekar, O.; Perner, P.


    The Support Vector Data Description (SVDD) has been introduced to address the problem of anomaly (or outlier) detection. It essentially fits the smallest possible sphere around the given data points, allowing some points to be excluded as outliers. Whether or not a point is excluded, is governed by

  16. Support vector machine applied to predict the zoonotic potential of E. coli O157 cattle isolates

    Methods based on sequence data analysis facilitate the tracking of disease outbreaks, allow relationships between strains to be reconstructed and virulence factors to be identified. However, these methods are used postfactum after an outbreak has happened. Here, we show that support vector machine a...

  17. Individualized prediction of illness course at the first psychotic episode: a support vector machine MRI study.

    Mourao-Miranda, J


    To date, magnetic resonance imaging (MRI) has made little impact on the diagnosis and monitoring of psychoses in individual patients. In this study, we used a support vector machine (SVM) whole-brain classification approach to predict future illness course at the individual level from MRI data obtained at the first psychotic episode.

  18. Estimation of the wind turbine yaw error by support vector machines

    Sheibat-Othman, Nida; Othman, Sami; Tayari, Raoaa


    Wind turbine yaw error information is of high importance in controlling wind turbine power and structural load. Normally used wind vanes are imprecise. In this work, the estimation of yaw error in wind turbines is studied using support vector machines for regression (SVR). As the methodology...

  19. Alcohols' Classification by Infrared Spectra Segment Based on Support Vector Machines

    Wei XIE; Fu Sheng NIE; Meng Long LI; Guang Ming LI; Min Chun LU


    This paper studies various classifiers to identify primary, secondary or tertiary alcohols by using segmental spectra and their combinations to support vector machines (SVMs). The results showed that the O-H in-plane bending absorption contributed most to identification their substitute. This conclusion disagrees with related known research results.

  20. An Investigation of Feature Models for Music Genre Classification using the Support Vector Classifier

    Meng, Anders; Shawe-Taylor, John


    autoregressive model for modelling short time features. Furthermore, it was investigated how these models can be integrated over a segment of short time features into a kernel such that a support vector machine can be applied. Two kernels with this property were considered, the convolution kernel and product...

  1. Online Handwritten Character Recognition of Devanagari and Telugu Characters using Support Vector Machines

    Swethalakshmi, H.; Jayaraman, Anitha; Chakravarthy, V. Srinivasa; Sekhar, C. Chandra

    2006-01-01; A system for recognition of online handwritten characters has been presented for Indian writing systems. A handwritten character is represented as a sequence of strokes whose features are extracted and classied. Support vector machines have been used for constructing the stroke recognition engine. The results have been presented after testing the system on Devanagari and Telugu scripts.

  2. Support Vector Machine for Discrimination Between Fault and Magnetizing Inrush Current in Power Transformer

    V. Malathi


    Full Text Available This study presents a novel technique based on Support Vector Machine (SVM for the classification of transient phenomena in power transformer. The SVM is a powerful method for statistical classification of data. The input data to this SVM for training comprises fault current and magnetizing inrush current. SVM classifier produces significant accuracy for classification of transient phenomena in power transformer.

  3. A divide-and-combine method for large scale nonparallel support vector machines.

    Tian, Yingjie; Ju, Xuchan; Shi, Yong


    Nonparallel Support Vector Machine (NPSVM) which is more flexible and has better generalization than typical SVM is widely used for classification. Although some methods and toolboxes like SMO and libsvm for NPSVM are used, NPSVM is hard to scale up when facing millions of samples. In this paper, we propose a divide-and-combine method for large scale nonparallel support vector machine (DCNPSVM). In the division step, DCNPSVM divide samples into smaller sub-samples aiming at solving smaller subproblems independently. We theoretically and experimentally prove that the objective function value, solutions, and support vectors solved by DCNPSVM are close to the objective function value, solutions, and support vectors of the whole NPSVM problem. In the combination step, the sub-solutions combined as initial iteration points are used to solve the whole problem by global coordinate descent which converges quickly. In order to balance the accuracy and efficiency, we adopt a multi-level structure which outperforms state-of-the-art methods. Moreover, our DCNPSVM can tackle unbalance problems efficiently by tuning the parameters. Experimental results on lots of large data sets show the effectiveness of our method in memory usage, classification accuracy and time consuming.

  4. Aero-engine fault diagnosis applying new fast support vector algorithm

    XU Qi-hua; GENG Shuai; SHI Jun


    A new fast learning algorithm was presented to solve the large-scale support vector machine ( SVM ) training problem of aero-engine fault diagnosis.The relative boundary vectors ( RBVs ) instead of all the original training samples were used for the training of the binary SVM fault classifiers.This pruning strategy decreased the number of final training sample significantly and can keep classification accuracy almost invariable.Accordingly , the training time was shortened to 1 / 20compared with basic SVM classifier.Meanwhile , owing to the reduction of support vector number , the classification time was also reduced.When sample aliasing existed , the aliasing sample points which were not of the same class were eliminated before the relative boundary vectors were computed.Besides , the samples near the relative boundary vectors were selected for SVM training in order to prevent the loss of some key sample points resulted from aliasing.This can improve classification accuracy effectively.A simulation example to classify 5classes of combination fault of aero-engine gas path components was finished and the total fault classification accuracy reached 96.1%.Simulation results show that this fast learning algorithm is effective , reliable and easy to be implemented for engineering application.

  5. Reliable Fault Classification of Induction Motors Using Texture Feature Extraction and a Multiclass Support Vector Machine

    Jia Uddin


    Full Text Available This paper proposes a method for the reliable fault detection and classification of induction motors using two-dimensional (2D texture features and a multiclass support vector machine (MCSVM. The proposed model first converts time-domain vibration signals to 2D gray images, resulting in texture patterns (or repetitive patterns, and extracts these texture features by generating the dominant neighborhood structure (DNS map. The principal component analysis (PCA is then used for the purpose of dimensionality reduction of the high-dimensional feature vector including the extracted texture features due to the fact that the high-dimensional feature vector can degrade classification performance, and this paper configures an effective feature vector including discriminative fault features for diagnosis. Finally, the proposed approach utilizes the one-against-all (OAA multiclass support vector machines (MCSVMs to identify induction motor failures. In this study, the Gaussian radial basis function kernel cooperates with OAA MCSVMs to deal with nonlinear fault features. Experimental results demonstrate that the proposed approach outperforms three state-of-the-art fault diagnosis algorithms in terms of fault classification accuracy, yielding an average classification accuracy of 100% even in noisy environments.

  6. Discussion About Nonlinear Time Series Prediction Using Least Squares Support Vector Machine

    XU Rui-Rui; BIAN Guo-Xing; GAO Chen-Feng; CHEN Tian-Lun


    The least squares support vector machine (LS-SVM) is used to study the nonlinear time series prediction.First, the parameter γ and multi-step prediction capabilities of the LS-SVM network are discussed. Then we employ clustering method in the model to prune the number of the support values. The learning rate and the capabilities of filtering noise for LS-SVM are all greatly improved.

  7. Prediction and Classification of Human G-protein Coupled Receptors Based on Support Vector Machines

    Yun-Fei Wang; Huan Chen; Yan-Hong Zhou


    A computational system for the prediction and classification of human G-protein coupled receptors (GPCRs) has been developed based on the support vector machine (SVM) method and protein sequence information. The feature vectors used to develop the SVM prediction models consist of statistically significant features selected from single amino acid, dipeptide, and tripeptide compositions of protein sequences. Furthermore, the length distribution difference between GPCRsand non-GPCRs has also been exploited to improve the prediction performance.The testing results with annotated human protein sequences demonstrate that this system can get good performance for both prediction and classification of human GPCRs.

  8. An Approach with Support Vector Machine using Variable Features Selection on Breast Cancer Prognosis

    Sandeep Chaurasia


    Full Text Available Cancer diagnosis and clinical outcome prediction are among the most important emerging applications of machine learning. In this paper we have used an approach by using support vector machine classifier to construct a model that is useful for the breast cancer survivability prediction. We have used both 5 cross and 10 cross validation of variable selection on input feature vectors and the performance measurement through bio-learning class performance while measuring AUC, specificity and sensitivity. The performance of the SVM is much better than the other machine learning classifier.

  9. Bearing Fault Diagnosis Based on Multiscale Permutation Entropy and Support Vector Machine

    Jian-Jiun Ding


    Full Text Available Bearing fault diagnosis has attracted significant attention over the past few decades. It consists of two major parts: vibration signal feature extraction and condition classification for the extracted features. In this paper, multiscale permutation entropy (MPE was introduced for feature extraction from faulty bearing vibration signals. After extracting feature vectors by MPE, the support vector machine (SVM was applied to automate the fault diagnosis procedure. Simulation results demonstrated that the proposed method is a very powerful algorithm for bearing fault diagnosis and has much better performance than the methods based on single scale permutation entropy (PE and multiscale entropy (MSE.

  10. Applying Support Vector Machine in classifying satellite images for the assessment of urban sprawl

    murgante, Beniamino; Nolè, Gabriele; Lasaponara, Rosa; Lanorte, Antonio; Calamita, Giuseppe


    In last decades the spreading of new buildings, road infrastructures and a scattered proliferation of houses in zones outside urban areas, produced a countryside urbanization with no rules, consuming soils and impoverishing the landscape. Such a phenomenon generated a huge environmental impact, diseconomies and a decrease in life quality. This study analyzes processes concerning land use change, paying particular attention to urban sprawl phenomenon. The application is based on the integration of Geographic Information Systems and Remote Sensing adopting open source technologies. The objective is to understand size distribution and dynamic expansion of urban areas in order to define a methodology useful to both identify and monitor the phenomenon. In order to classify "urban" pixels, over time monitoring of settlements spread, understanding trends of artificial territories, classifications of satellite images at different dates have been realized. In order to obtain these classifications, supervised classification algorithms have been adopted. More particularly, Support Vector Machine (SVM) learning algorithm has been applied to multispectral remote data. One of the more interesting features in SVM is the possibility to obtain good results also adopting few classification pixels of training areas. SVM has several interesting features, such as the capacity to obtain good results also adopting few classification pixels of training areas, a high possibility of configuration parameters and the ability to discriminate pixels with similar spectral responses. Multi-temporal ASTER satellite data at medium resolution have been adopted because are very suitable in evaluating such phenomena. The application is based on the integration of Geographic Information Systems and Remote Sensing technologies by means of open source software. Tools adopted in managing and processing data are GRASS GIS, Quantum GIS and R statistical project. The area of interest is located south of Bari

  11. Application of higher order spectral features and support vector machines for bearing faults classification.

    Saidi, Lotfi; Ben Ali, Jaouher; Fnaiech, Farhat


    Condition monitoring and fault diagnosis of rolling element bearings timely and accurately are very important to ensure the reliability of rotating machinery. This paper presents a novel pattern classification approach for bearings diagnostics, which combines the higher order spectra analysis features and support vector machine classifier. The use of non-linear features motivated by the higher order spectra has been reported to be a promising approach to analyze the non-linear and non-Gaussian characteristics of the mechanical vibration signals. The vibration bi-spectrum (third order spectrum) patterns are extracted as the feature vectors presenting different bearing faults. The extracted bi-spectrum features are subjected to principal component analysis for dimensionality reduction. These principal components were fed to support vector machine to distinguish four kinds of bearing faults covering different levels of severity for each fault type, which were measured in the experimental test bench running under different working conditions. In order to find the optimal parameters for the multi-class support vector machine model, a grid-search method in combination with 10-fold cross-validation has been used. Based on the correct classification of bearing patterns in the test set, in each fold the performance measures are computed. The average of these performance measures is computed to report the overall performance of the support vector machine classifier. In addition, in fault detection problems, the performance of a detection algorithm usually depends on the trade-off between robustness and sensitivity. The sensitivity and robustness of the proposed method are explored by running a series of experiments. A receiver operating characteristic (ROC) curve made the results more convincing. The results indicated that the proposed method can reliably identify different fault patterns of rolling element bearings based on vibration signals.

  12. Clinical supervision in a community setting.

    Evans, Carol; Marcroft, Emma

    Clinical supervision is a formal process of professional support, reflection and learning that contributes to individual development. First Community Health and Care is committed to providing clinical supervision to nurses and allied healthcare professionals to support the provision and maintenance of high-quality care. In 2012, we developed new guidelines for nurses and AHPs on supervision, incorporating a clinical supervision framework. This offers a range of options to staff so supervision accommodates variations in work settings and individual learning needs and styles.

  13. Breast cancer diagnosis using level-set statistics and support vector machines.

    Liu, Jianguo; Yuan, Xiaohui; Buckles, Bill P


    Breast cancer diagnosis based on microscopic biopsy images and machine learning has demonstrated great promise in the past two decades. Various feature selection (or extraction) and classification algorithms have been attempted with success. However, some feature selection processes are complex and the number of features used can be quite large. We propose a new feature selection method based on level-set statistics. This procedure is simple and, when used with support vector machines (SVM), only a small number of features is needed to achieve satisfactory accuracy that is comparable to those using more sophisticated features. Therefore, the classification can be completed in much shorter time. We use multi-class support vector machines as the classification tool. Numerical results are reported to support the viability of this new procedure.

  14. Support vector machine used to diagnose the fault of rotor broken bars of induction motors

    Zhitong, Cao; Jiazhong, Fang; Hongpingn, Chen


    The data-based machine learning is an important aspect of modern intelligent technology, while statistical learning theory (SLT) is a new tool that studies the machine learning methods in the case of a small number of samples. As a common learning method, support vector machine (SVM) is derived...... for the SVM. After a SVM is trained with learning sample vectors, so each kind of the rotor broken bar faults of induction motors can be classified. Finally the retest is demonstrated, which proves that the SVM really has preferable ability of classification. In this paper we tried applying the SVM...... from the SLT. Here we were done some analogical experiments of the rotor broken bar faults of induction motors used, analyzed the signals of the sample currents with Fourier transform, and constructed the spectrum characteristics from low frequency to high frequency used as learning sample vectors...

  15. Screw Remaining Life Prediction Based on Quantum Genetic Algorithm and Support Vector Machine

    Xiaochen Zhang


    Full Text Available To predict the remaining life of ball screw, a screw remaining life prediction method based on quantum genetic algorithm (QGA and support vector machine (SVM is proposed. A screw accelerated test bench is introduced. Accelerometers are installed to monitor the performance degradation of ball screw. Combined with wavelet packet decomposition and isometric mapping (Isomap, the sensitive feature vectors are obtained and stored in database. Meanwhile, the sensitive feature vectors are randomly chosen from the database and constitute training samples and testing samples. Then the optimal kernel function parameter and penalty factor of SVM are searched with the method of QGA. Finally, the training samples are used to train optimized SVM while testing samples are adopted to test the prediction accuracy of the trained SVM so the screw remaining life prediction model can be got. The experiment results show that the screw remaining life prediction model could effectively predict screw remaining life.

  16. Classification of Stellar Spectra with Fuzzy Minimum Within-Class Support Vector Machine

    Liu Zhong-bao; Song Wen-ai; Zhang Jing; Zhao Wen-juan


    Classification is one of the important tasks in astronomy, especially in spectra analysis. Support Vector Machine (SVM) is a typical classification method, which is widely used in spectra classification. Although it performs well in practice, its classification accuracies can not be greatly improved because of two limitations. One is it does not take the distribution of the classes into consideration. The other is it is sensitive to noise. In order to solve the above problems, inspired by the maximization of the Fisher’s Discriminant Analysis (FDA) and the SVM separability constraints, fuzzy minimum within-class support vector machine (FMWSVM) is proposed in this paper. In FMWSVM, the distribution of the classes is reflected by the within-class scatter in FDA and the fuzzy membership function is introduced to decrease the influence of the noise. The comparative experiments with SVM on the SDSS datasets verify the effectiveness of the proposed classifier FMWSVM.

  17. Credit Scoring by Fuzzy Support Vector Machines with a Novel Membership Function

    Jian Shi


    Full Text Available Due to the recent financial crisis and European debt crisis, credit risk evaluation has become an increasingly important issue for financial institutions. Reliable credit scoring models are crucial for commercial banks to evaluate the financial performance of clients and have been widely studied in the fields of statistics and machine learning. In this paper a novel fuzzy support vector machine (SVM credit scoring model is proposed for credit risk analysis, in which fuzzy membership is adopted to indicate different contribution of each input point to the learning of SVM classification hyperplane. Considering the methodological consistency, support vector data description (SVDD is introduced to construct the fuzzy membership function and to reduce the effect of outliers and noises. The SVDD-based fuzzy SVM model is tested against the traditional fuzzy SVM on two real-world datasets and the research results confirm the effectiveness of the presented method.

  18. Quality Monitoring for Laser Welding Based on High-Speed Photography and Support Vector Machine

    Teng Wang


    Full Text Available In order to improve the prediction ability of welding quality during high-power disk laser welding, a new approach was proposed and applied in the classification of the dynamic features of metal vapor plume. Six features were extracted through the color image processing method. Three features, including the area of plume, number of spatters, and horizontal coordinate of plume centroid, were selected based on the classification accuracy rates and Pearson product-moment correlation coefficients. A support vector machine model was adopted to classify the welding quality status into two categories, good or poor. The results demonstrated that the support vector machine model established according to the selected features had satisfactory prediction and generalization ability. The classification accuracy rate was higher than 90%, and the model could be applied in the prediction of welding quality during high-power disk laser welding.

  19. Difference mapping method using least square support vector regression for variable-fidelity metamodelling

    Zheng, Jun; Shao, Xinyu; Gao, Liang; Jiang, Ping; Qiu, Haobo


    Engineering design, especially for complex engineering systems, is usually a time-consuming process involving computation-intensive computer-based simulation and analysis methods. A difference mapping method using least square support vector regression is developed in this work, as a special metamodelling methodology that includes variable-fidelity data, to replace the computationally expensive computer codes. A general difference mapping framework is proposed where a surrogate base is first created, then the approximation is gained by a mapping the difference between the base and the real high-fidelity response surface. The least square support vector regression is adopted to accomplish the mapping. Two different sampling strategies, nested and non-nested design of experiments, are conducted to explore their respective effects on modelling accuracy. Different sample sizes and three approximation performance measures of accuracy are considered.

  20. Particle Swarm Optimization Based Support Vector Regression for Blind Image Restoration

    Ratnakar Dash; Pankaj Kumar Sa; Banshidhar Majhi


    This paper presents a swarm intelligence based parameter optimization of the support vector machine (SVM)for blind image restoration.In this work,SVM is used to solve a regression problem.Support vector regression (SVR)has been utilized to obtain a true mapping of images from the observed noisy blurred images.The parameters of SVR are optimized through particle swarm optimization (PSO) technique.The restoration error function has been utilized as the fitness function for PSO.The suggested scheme tries to adapt the SVM parameters depending on the type of blur and noise strength and the experimental results validate its effectiveness.The results show that the parameter optimization of the SVR model gives better performance than conventional SVR model as well as other competent schemes for blind image restoration.

  1. Constrained Run-to-Run Optimization for Batch Process Based on Support Vector Regression Model


    An iterative (run-to-run) optimization method was presented for batch processes under input constraints. Generally it is very difficult to acquire an accurate mechanistic model for a batch process. Because support vector machine is powerful for the problems characterized by small samples, nonlinearity, high dimension and local minima, support vector regression models were developed for the end-point optimization of batch processes. Since there is no analytical way to find the optimal trajectory, an iterative method was used to exploit the repetitive nature of batch processes to determine the optimal operating policy. The optimization algorithm is proved convergent. The numerical simulation shows that the method can improve the process performance through iterations.

  2. A Parallel Decision Model Based on Support Vector Machines and Its Application to Fault Diagnosis

    Yan Weiwu(阎威武); Shao Huihe


    Many industrial process systems are becoming more and more complex and are characterized by distributed features. To ensure such a system to operate under working order, distributed parameter values are often inspected from subsystems or different points in order to judge working conditions of the system and make global decisions. In this paper, a parallel decision model based on Support Vector Machine (PDMSVM) is introduced and applied to the distributed fault diagnosis in industrial process. PDMSVM is convenient for information fusion of distributed system and it performs well in fault diagnosis with distributed features. PDMSVM makes decision based on synthetic information of subsystems and takes the advantage of Support Vector Machine. Therefore decisions made by PDMSVM are highly reliable and accurate.

  3. Evaluation and recognition of skin images with aging by support vector machine

    Hu, Liangjun; Wu, Shulian; Li, Hui


    Aging is a very important issue not only in dermatology, but also cosmetic science. Cutaneous aging involves both chronological and photoaging aging process. The evaluation and classification of aging is an important issue with the medical cosmetology workers nowadays. The purpose of this study is to assess chronological-age-related and photo-age-related of human skin. The texture features of skin surface skin, such as coarseness, contrast were analyzed by Fourier transform and Tamura. And the aim of it is to detect the object hidden in the skin texture in difference aging skin. Then, Support vector machine was applied to train the texture feature. The different age's states were distinguished by the support vector machine (SVM) classifier. The results help us to further understand the mechanism of different aging skin from texture feature and help us to distinguish the different aging states.

  4. Metabolic changes in rat urine after acute paraquat poisoning and discriminated by support vector machine.

    Wen, Congcong; Wang, Zhiyi; Zhang, Meiling; Wang, Shuanghu; Geng, Peiwu; Sun, Fa; Chen, Mengchun; Lin, Guanyang; Hu, Lufeng; Ma, Jianshe; Wang, Xianqin


    Paraquat is quick-acting and non-selective, killing green plant tissue on contact; it is also toxic to human beings and animals. In this study, we developed a urine metabonomic method by gas chromatography-mass spectrometry to evaluate the effect of acute paraquat poisoning on rats. Pattern recognition analysis, including both partial least squares discriminate analysis and principal component analysis revealed that acute paraquat poisoning induced metabolic perturbations. Compared with the control group, the levels of benzeneacetic acid and hexadecanoic acid of the acute paraquat poisoning group (intragastric administration 36 mg/kg) increased, while the levels of butanedioic acid, pentanedioic acid, altronic acid decreased. Based on these urinary metabolomics data, support vector machine was applied to discriminate the metabolomic change of paraquat groups from the control group, which achieved 100% classification accuracy. In conclusion, metabonomic method combined with support vector machine can be used as a useful diagnostic tool in paraquat-poisoned rats.

  5. Support vector machine classification trees based on fuzzy entropy of classification.

    de Boves Harrington, Peter


    The support vector machine (SVM) is a powerful classifier that has recently been implemented in a classification tree (SVMTreeG). This classifier partitioned the data by finding gaps in the data space. For large and complex datasets, there may be no gaps in the data space confounding this type of classifier. A novel algorithm was devised that uses fuzzy entropy to find optimal partitions for situations when clusters of data are overlapped in the data space. Also, a kernel version of the fuzzy entropy algorithm was devised. A fast support vector machine implementation is used that has no cost C or slack variables to optimize. Statistical comparisons using bootstrapped Latin partitions among the tree classifiers were made using a synthetic XOR data set and validated with ten prediction sets comprised of 50,000 objects and a data set of NMR spectra obtained from 12 tea sample extracts.

  6. A one-layer recurrent neural network for support vector machine learning.

    Xia, Youshen; Wang, Jun


    This paper presents a one-layer recurrent neural network for support vector machine (SVM) learning in pattern classification and regression. The SVM learning problem is first converted into an equivalent formulation, and then a one-layer recurrent neural network for SVM learning is proposed. The proposed neural network is guaranteed to obtain the optimal solution of support vector classification and regression. Compared with the existing two-layer neural network for the SVM classification, the proposed neural network has a low complexity for implementation. Moreover, the proposed neural network can converge exponentially to the optimal solution of SVM learning. The rate of the exponential convergence can be made arbitrarily high by simply turning up a scaling parameter. Simulation examples based on benchmark problems are discussed to show the good performance of the proposed neural network for SVM learning.

  7. On-line least squares support vector machine algorithm in gas prediction

    ZHAO Xiao-hu; WANG Gang; ZHAO Ke-ke; TAN De-jian


    Traditional coal mine safety prediction methods are off-line and do not have dynamic prediction functions. The Support Vector Machine (SVM) is a new machine learning algorithm that has excellent properties. The least squares support vector machine (LS-SVM) algorithm is an improved algorithm of SVM. But the common LS-SVM algorithm, used directly in safety predictions, has some problems. We have first studied gas prediction problems and the basic theory of LS-SVM. Given these problems, we have investigated the affect of the time factor about safety prediction and present an on-line prediction algorithm, based on LS-SVM. Finally, given our observed data, we used the on-line algorithm to predict gas emissions and used other related algorithm to com- pare its performance. The simulation results have verified the validity of the new algorithm.

  8. Modelling of chaotic systems based on modified weighted recurrent least squares support vector machines

    Sun Jian-Cheng; Zhang Tai-Yi; Liu Feng


    Positive Lyapunov exponents cause the errors in modelling of the chaotic time series to grow exponentially. In this paper, we propose the modified version of the support vector machines (SVM) to deal with this problem. Based on recurrent least squares support vector machines (RLS-SVM), we introduce a weighted term to the cost function to compensate the prediction errors resulting from the positive global Lyapunov exponents. To demonstrate the effectiveness of our algorithm, we use the power spectrum and dynamic invariants involving the Lyapunov exponents and the correlation dimension as criterions, and then apply our method to the Santa Fe competition time series. The simulation results shows that the proposed method can capture the dynamics of the chaotic time series effectively.

  9. The new interpretation of support vector machines on statistical learning theory


    This paper is concerned with the theoretical foundation of support vector machines (SVMs). The purpose is to develop further an exact relationship between SVMs and the statistical learning theory (SLT). As a representative, the standard C-support vector classification (C-SVC) is considered here. More precisely, we show that the decision function obtained by C-SVC is just one of the decision functions obtained by solving the optimization problem derived directly from the structural risk minimization principle. In addition, an interesting meaning of the parameter C in C-SVC is given by showing that C corresponds to the size of the decision function candidate set in the structural risk minimization principle.

  10. A Novel Soft Sensor Modeling Approach Based on Least Squares Support Vector Machines

    Feng Rui(冯瑞); Song Chunlin; Zhang Yanzhu; Shao Huihe


    Artificial Neural Networks (ANNs) such as radial basis function neural networks (RBFNNs) have been successfully used in soft sensor modeling. However, the generalization ability of conventional ANNs is not very well. For this reason, we present a novel soft sensor modeling approach based on Support Vector Machines (SVMs). Since standard SVMs have the limitation of speed and size in training large data set, we hereby propose Least Squares Support Vector Machines (LS_SVMs) and apply it to soft sensor modeling. Systematic analysis is performed and the result indicates that the proposed method provides satisfactory performance with excellent approximation and generalization property. Monte Carlo simulations show that our soft sensor modeling approach achieves performance superior to the conventional method based on RBFNNs.

  11. A Gaussian Belief Propagation Solver for Large Scale Support Vector Machines

    Bickson, Danny; Dolev, Danny


    Support vector machines (SVMs) are an extremely successful type of classification and regression algorithms. Building an SVM entails solving a constrained convex quadratic programming problem, which is quadratic in the number of training samples. We introduce an efficient parallel implementation of an support vector regression solver, based on the Gaussian Belief Propagation algorithm (GaBP). In this paper, we demonstrate that methods from the complex system domain could be utilized for performing efficient distributed computation. We compare the proposed algorithm to previously proposed distributed and single-node SVM solvers. Our comparison shows that the proposed algorithm is just as accurate as these solvers, while being significantly faster, especially for large datasets. We demonstrate scalability of the proposed algorithm to up to 1,024 computing nodes and hundreds of thousands of data points using an IBM Blue Gene supercomputer. As far as we know, our work is the largest parallel implementation of bel...

  12. Product demand forecasts using wavelet kernel support vector machine and particle swarm optimization in manufacture system

    Wu, Qi


    Demand forecasts play a crucial role in supply chain management. The future demand for a certain product is the basis for the respective replenishment systems. Aiming at demand series with small samples, seasonal character, nonlinearity, randomicity and fuzziness, the existing support vector kernel does not approach the random curve of the sales time series in the space (quadratic continuous integral space). In this paper, we present a hybrid intelligent system combining the wavelet kernel support vector machine and particle swarm optimization for demand forecasting. The results of application in car sale series forecasting show that the forecasting approach based on the hybrid PSOWv-SVM model is effective and feasible, the comparison between the method proposed in this paper and other ones is also given, which proves that this method is, for the discussed example, better than hybrid PSOv-SVM and other traditional methods.

  13. Vibration reliability analysis for aeroengine compressor blade based on support vector machine response surface method

    GAO Hai-feng; BAI Guang-chen


    To ameliorate reliability analysis efficiency for aeroengine components, such as compressor blade, support vector machine response surface method (SRSM) is proposed. SRSM integrates the advantages of support vector machine (SVM) and traditional response surface method (RSM), and utilizes experimental samples to construct a suitable response surface function (RSF) to replace the complicated and abstract finite element model. Moreover, the randomness of material parameters, structural dimension and operating condition are considered during extracting data so that the response surface function is more agreeable to the practical model. The results indicate that based on the same experimental data, SRSM has come closer than RSM reliability to approximating Monte Carlo method (MCM); while SRSM (17.296 s) needs far less running time than MCM (10958 s) and RSM (9840 s). Therefore, under the same simulation conditions, SRSM has the largest analysis efficiency, and can be considered a feasible and valid method to analyze structural reliability.

  14. Accelerated Particle Swarm Optimization and Support Vector Machine for Business Optimization and Applications

    Yang, Xin-She; Fong, Simon


    Business optimization is becoming increasingly important because all business activities aim to maximize the profit and performance of products and services, under limited resources and appropriate constraints. Recent developments in support vector machine and metaheuristics show many advantages of these techniques. In particular, particle swarm optimization is now widely used in solving tough optimization problems. In this paper, we use a combination of a recently developed Accelerated PSO and a nonlinear support vector machine to form a framework for solving business optimization problems. We first apply the proposed APSO-SVM to production optimization, and then use it for income prediction and project scheduling. We also carry out some parametric studies and discuss the advantages of the proposed metaheuristic SVM.

  15. Suspended Sediment Load Prediction Using Support Vector Machines in the Goodwin Creek Experimental Watershed

    Chiang, Jie-Lun; Tsai, Kuang-Jung; Chen, Yie-Ruey; Lee, Ming-Hsi; Sun, Jai-Wei


    Strong correlation exists between river discharge and suspended sediment load. The relationship of discharge and suspended sediment load was used to estimate suspended sediment load by using regression model, artificial neural network and support vector machine in this study. Records of river discharges and suspended sediment loads in the Goodwin Creek Experimental Watershed in United States were investigated as a case study. Seventy percent of the records were used as training data set to develop prediction models. The other thirty percent records were used as verification data set. The performances of those models were evaluated by mean absolute percentage error (MAPE). The MAPEs show that support vector machine outperforms the artificial neural network and regression model. The results show that the MAPE of the proposed SVM can achieve less than 14% for 120 minutes prediction (four time steps). As a result, we believe that the proposed SVM model has high potential for predicting suspended sediment load.

  16. Application of support vector machine and particle swarm optimization in micro near infrared spectrometer

    Xiong, Yuhong; Liu, Yunxiang; Shu, Minglei


    In the process of actual measurement and analysis of micro near infrared spectrometer, genetic algorithm is used to select the wavelengths and then partial least square method is used for modeling and analyzing. Because genetic algorithm has the disadvantages of slow convergence and difficult parameter setting, and partial least square method in dealing with nonlinear data is far from being satisfactory, the practical application effect of partial least square method based on genetic algorithm is severely affected negatively. The paper introduces the fundamental principles of particle swarm optimization and support vector machine, and proposes a support vector machine method based on particle swarm optimization. The method can overcome the disadvantage of partial least squares method based on genetic algorithm to a certain extent. Finally, the method is tested by an example, and the results show that the method is effective.

  17. Integrated application of uniform design and least-squares support vector machines to transfection optimization

    Pan Jin-Shui


    Full Text Available Abstract Background Transfection in mammalian cells based on liposome presents great challenge for biological professionals. To protect themselves from exogenous insults, mammalian cells tend to manifest poor transfection efficiency. In order to gain high efficiency, we have to optimize several conditions of transfection, such as amount of liposome, amount of plasmid, and cell density at transfection. However, this process may be time-consuming and energy-consuming. Fortunately, several mathematical methods, developed in the past decades, may facilitate the resolution of this issue. This study investigates the possibility of optimizing transfection efficiency by using a method referred to as least-squares support vector machine, which requires only a few experiments and maintains fairly high accuracy. Results A protocol consists of 15 experiments was performed according to the principle of uniform design. In this protocol, amount of liposome, amount of plasmid, and the number of seeded cells 24 h before transfection were set as independent variables and transfection efficiency was set as dependent variable. A model was deduced from independent variables and their respective dependent variable. Another protocol made up by 10 experiments was performed to test the accuracy of the model. The model manifested a high accuracy. Compared to traditional method, the integrated application of uniform design and least-squares support vector machine greatly reduced the number of required experiments. What's more, higher transfection efficiency was achieved. Conclusion The integrated application of uniform design and least-squares support vector machine is a simple technique for obtaining high transfection efficiency. Using this novel method, the number of required experiments would be greatly cut down while higher efficiency would be gained. Least-squares support vector machine may be applicable to many other problems that need to be optimized.

  18. Fast Training of Support Vector Machines Using Error-Center-Based Optimization

    L. Meng; Q. H. Wu


    This paper presents a new algorithm for Support Vector Machine (SVM) training, which trains a machine based on the cluster centers of errors caused by the current machine. Experiments withvarious training sets show that the computation time of this new algorithm scales almost linear with training set size and thus may be applied to much larger training sets, in comparison to standard quadratic programming (QP) techniques.

  19. Performance and optimization of support vector machines in high-energy physics classification problems

    Sahin, M. Ö.; Krücker, D.; Melzer-Pellmann, I.-A.


    In this paper we promote the use of Support Vector Machines (SVM) as a machine learning tool for searches in high-energy physics. As an example for a new-physics search we discuss the popular case of Supersymmetry at the Large Hadron Collider. We demonstrate that the SVM is a valuable tool and show that an automated discovery-significance based optimization of the SVM hyper-parameters is a highly efficient way to prepare an SVM for such applications.


    Bhusana Premanode


    Full Text Available Inaccuracy of a kernel function used in Support Vector Machine (SVM can be found when simulated with nonlinear and stationary datasets. To minimise the error, we propose a new multiclass SVM model using mean reversion and coefficient of variance algorithm to partition and classify imbalance in datasets. By introducing a series of test statistic, simulations of the proposed algorithm outperformed the performance of the SVM model without using multiclass SVM model.

  1. Support Vector Machines and Kd-tree for Separating Quasars from Large Survey Databases


    We compare the performance of two automated classification algorithms: k-dimensional tree (kd-tree) and support vector machines (SVMs), to separate quasars from stars in the databases of the Sloan Digital Sky Survey (SDSS) and the Two Micron All Sky Survey (2MASS) catalogs. The two algorithms are trained on subsets of SDSS and 2MASS objects whose nature is known via spectroscopy. We choose different attribute combination as input patterns to train the classifier using photometric data only an...

  2. Discussion of Some Problems About Nonlinear Time Series Prediction Using v-Support Vector Machine

    GAO Cheng-Feng; CHEN Tian-Lun; NAN Tian-Shi


    Some problems in using v-support vector machine (v-SVM) for the prediction of nonlinear time series are discussed. The problems include selection of various net parameters, which affect the performance of prediction, mixture of kernels, and decomposition cooperation linear programming v-SVM regression, which result in improvements of the algorithm. Computer simulations in the prediction of nonlinear time series produced by Mackey-Glass equation and Lorenz equation provide some improved results.

  3. An improved method of support vector machine and its applications to financial time series forecasting

    LIANG Yanchun; SUN Yanfeng


    A novel method for kernel function of support vector machine is presented based on the information geometry theory. The kernel function is modified using a conformal mapping to make the kernel data-dependent so as to increase the ability of predicting high noise data of the method. Numerical simulations demonstrate the effectiveness of the method. Simulated results on the prediction of the stock price show that the improved approach possesses better forecasting precision and ability of generalization than the conventional models.

  4. A Support Vector Machine-based Evaluation Model of Customer Satisfaction Degree in Logistics

    SUN Hua-li; XIE Jian-ying


    This paper pressnts a novel evaluation model of the customer satisfaction degree (CSD) in logistics based on support vector machine (SVM). Firstly, the relation between the suppliers and the customers is analyzed. Secondly, the evaluation index system and fuzzy quantitative methods are provided. Thirdly, the CSD evaluation system including eight indexes and three ranks rinsed on one-against-one mode of SVM is built. Last simulation experiment is presented to illustrate the theoretical results.

  5. A Multiple Model Approach to Modeling Based on Fuzzy Support Vector Machines

    冯瑞; 张艳珠; 宋春林; 邵惠鹤


    A new multiple models(MM) approach was proposed to model complex industrial process by using Fuzzy Support Vector Machines (F SVMs). By applying the proposed approach to a pH neutralization titration experi-ment, F_SVMs MM not only provides satisfactory approximation and generalization property, but also achieves superior performance to USOCPN multiple modeling method and single modeling method based on standard SVMs.

  6. Drifting model approach to modeling based on weighted support vector machines

    冯瑞; 宋春林; 邵惠鹤


    This paper proposes a novel drifting modeling (DM) method. Briefly, we first employ an improved SVMs algorithm named weighted support vector machines (W_SVMs), which is suitable for locally learning, and then the DM method using the algorithm is proposed. By applying the proposed modeling method to Fluidized Catalytic Cracking Unit (FCCU), the simulation results show that the property of this proposed approach is superior to global modeling method based on standard SVMs.

  7. Generating Fuzzy Rule-based Systems from Examples Based on Robust Support Vector Machine

    JIA Jiong; ZHANG Hao-ran


    This paper firstly proposes a new support vector machine regression (SVR) with a robust loss function, and designs a gradient based algorithm for implementation of the SVR,then uses the SVR to extract fuzzy rules and designs fuzzy rule-based system. Simulations show that fuzzy rule-based system technique based on robust SVR achieves superior performance to the conventional fuzzy inference method, the proposed method provides satisfactory performance with excellent approximation and generalization property than the existing algorithm.

  8. Novel Method of Predicting Network Bandwidth Based on Support Vector Machines

    沈伟; 冯瑞; 邵惠鹤


    In order to solve the problems of small sample over-fitting and local minima when neural networks learn online, a novel method of predicting network bandwidth based on support vector machines(SVM) is proposed. The prediction and learning online will be completed by the proposed moving window learning algorithm(MWLA). The simulation research is done to validate the proposed method, which is compared with the method based on neural networks.

  9. A New Hybrid Algorithm for Bankruptcy Prediction Using Switching Particle Swarm Optimization and Support Vector Machines


    Bankruptcy prediction has been extensively investigated by data mining techniques since it is a critical issue in the accounting and finance field. In this paper, a new hybrid algorithm combining switching particle swarm optimization (SPSO) and support vector machine (SVM) is proposed to solve the bankruptcy prediction problem. In particular, a recently developed SPSO algorithm is exploited to search the optimal parameter values of radial basis function (RBF) kernel of the SVM. The new algori...

  10. Wormholes admitting conformal Killing vectors and supported by generalized Chaplygin gas

    Kuhfittig, Peter K.F. [Milwaukee School of Engineering, Department of Mathematics, Milwaukee, WI (United States)


    When Morris and Thorne first proposed that traversable wormholes may be actual physical objects, they concentrated on the geometry by specifying the shape and redshift functions. This mathematical approach necessarily raises questions regarding the determination of the required stress-energy tensor. This paper discusses a natural way to obtain a complete wormhole solution by assuming that the wormhole (1) is supported by generalized Chaplygin gas and (2) admits conformal Killing vectors. (orig.)

  11. Support Vector Machine Learning-based fMRI Data Group Analysis*

    Wang, Ze; Childress, Anna R.; Wang, Jiongjiong; Detre, John A.


    To explore the multivariate nature of fMRI data and to consider the inter-subject brain response discrepancies, a multivariate and brain response model-free method is fundamentally required. Two such methods are presented in this paper by integrating a machine learning algorithm, the support vector machine (SVM), and the random effect model. Without any brain response modeling, SVM was used to extract a whole brain spatial discriminance map (SDM), representing the brain response difference be...

  12. Interpreting linear support vector machine models with heat map molecule coloring

    Rosenbaum Lars


    Full Text Available Abstract Background Model-based virtual screening plays an important role in the early drug discovery stage. The outcomes of high-throughput screenings are a valuable source for machine learning algorithms to infer such models. Besides a strong performance, the interpretability of a machine learning model is a desired property to guide the optimization of a compound in later drug discovery stages. Linear support vector machines showed to have a convincing performance on large-scale data sets. The goal of this study is to present a heat map molecule coloring technique to interpret linear support vector machine models. Based on the weights of a linear model, the visualization approach colors each atom and bond of a compound according to its importance for activity. Results We evaluated our approach on a toxicity data set, a chromosome aberration data set, and the maximum unbiased validation data sets. The experiments show that our method sensibly visualizes structure-property and structure-activity relationships of a linear support vector machine model. The coloring of ligands in the binding pocket of several crystal structures of a maximum unbiased validation data set target indicates that our approach assists to determine the correct ligand orientation in the binding pocket. Additionally, the heat map coloring enables the identification of substructures important for the binding of an inhibitor. Conclusions In combination with heat map coloring, linear support vector machine models can help to guide the modification of a compound in later stages of drug discovery. Particularly substructures identified as important by our method might be a starting point for optimization of a lead compound. The heat map coloring should be considered as complementary to structure based modeling approaches. As such, it helps to get a better understanding of the binding mode of an inhibitor.

  13. Optical diagnosis of colon and cervical cancer by support vector machine

    Mukhopadhyay, Sabyasachi; Kurmi, Indrajit; Dey, Rajib; Das, Nandan K.; Pradhan, Sanjay; Pradhan, Asima; Ghosh, Nirmalya; Panigrahi, Prasanta K.; Mohanty, Samarendra


    A probabilistic robust diagnostic algorithm is very much essential for successful cancer diagnosis by optical spectroscopy. We report here support vector machine (SVM) classification to better discriminate the colon and cervical cancer tissues from normal tissues based on elastic scattering spectroscopy. The efficacy of SVM based classification with different kernel has been tested on multifractal parameters like Hurst exponent, singularity spectrum width in order to classify the cancer tissues.

  14. Support vector machine based fault classification and location of a long transmission line

    Papia Ray


    Full Text Available This paper investigates support vector machine based fault type and distance estimation scheme in a long transmission line. The planned technique uses post fault single cycle current waveform and pre-processing of the samples is done by wavelet packet transform. Energy and entropy are obtained from the decomposed coefficients and feature matrix is prepared. Then the redundant features from the matrix are taken out by the forward feature selection method and normalized. Test and train data are developed by taking into consideration variables of a simulation situation like fault type, resistance path, inception angle, and distance. In this paper 10 different types of short circuit fault are analyzed. The test data are examined by support vector machine whose parameters are optimized by particle swarm optimization method. The anticipated method is checked on a 400 kV, 300 km long transmission line with voltage source at both the ends. Two cases were examined with the proposed method. The first one is fault very near to both the source end (front and rear and the second one is support vector machine with and without optimized parameter. Simulation result indicates that the anticipated method for fault classification gives high accuracy (99.21% and least fault distance estimation error (0.29%.

  15. System identification modelling of ship manoeuvring motion based onε- support vector regression

    王雪刚; 邹早建; 侯先瑞; 徐锋


    Based on theε-support vector regression, three modelling methods for the ship manoeuvring motion, i.e., the white-box modelling, the grey-box modelling and the black-box modelling, are investigated. Theoo10/10,oo20/20 zigzag tests and the o35 turning circle manoeuvre are simulated. Part of the simulation data for theoo20/20 zigzag test are used to train the support vectors, and the trained support vector machine is used to predict the wholeoo20/20 zigzag test. Comparison between the simula- ted and predictedoo20/20 zigzag test shows a good predictive ability of the three modelling methods. Then all mathematical models obtained by the modelling methods are used to predict theoo10/10 zigzag test ando35 turning circle manoeuvre, and the predicted results are compared with those of simulation tests to demonstrate the good generalization performance of the mathematical models. Finally, the modelling methods are analyzed and compared with each other in terms of the application conditions, the prediction accuracy and the computation speed. An appropriate modelling method can be chosen according to the intended use of the mathematical models and the available data for the system identification.

  16. An Adaptive Support Vector Regression Machine for the State Prognosis of Mechanical Systems

    Qing Zhang


    Full Text Available Due to the unsteady state evolution of mechanical systems, the time series of state indicators exhibits volatile behavior and staged characteristics. To model hidden trends and predict deterioration failure utilizing volatile state indicators, an adaptive support vector regression (ASVR machine is proposed. In ASVR, the width of an error-insensitive tube, which is a constant in the traditional support vector regression, is set as a variable determined by the transient distribution boundary of local regions in the training time series. Thus, the localized regions are obtained using a sliding time window, and their boundaries are defined by a robust measure known as the truncated range. Utilizing an adaptive error-insensitive tube, a stabilized tolerance level for noise is achieved, whether the time series occurs in low-volatility regions or in high-volatility regions. The proposed method is evaluated by vibrational data measured on descaling pumps. The results show that ASVR is capable of capturing the local trends of the volatile time series of state indicators and is superior to the standard support vector regression for state prediction.

  17. Support vector echo-state machine for chaotic time-series prediction.

    Shi, Zhiwei; Han, Min


    A novel chaotic time-series prediction method based on support vector machines (SVMs) and echo-state mechanisms is proposed. The basic idea is replacing "kernel trick" with "reservoir trick" in dealing with nonlinearity, that is, performing linear support vector regression (SVR) in the high-dimension "reservoir" state space, and the solution benefits from the advantages from structural risk minimization principle, and we call it support vector echo-state machines (SVESMs). SVESMs belong to a special kind of recurrent neural networks (RNNs) with convex objective function, and their solution is global, optimal, and unique. SVESMs are especially efficient in dealing with real life nonlinear time series, and its generalization ability and robustness are obtained by regularization operator and robust loss function. The method is tested on the benchmark prediction problem of Mackey-Glass time series and applied to some real life time series such as monthly sunspots time series and runoff time series of the Yellow River, and the prediction results are promising.

  18. Deriving statistical significance maps for support vector regression using medical imaging data.

    Gaonkar, Bilwaj; Sotiras, Aristeidis; Davatzikos, Christos


    Regression analysis involves predicting a continuous variable using imaging data. The Support Vector Regression (SVR) algorithm has previously been used in addressing regression analysis in neuroimaging. However, identifying the regions of the image that the SVR uses to model the dependence of a target variable remains an open problem. It is an important issue when one wants to biologically interpret the meaning of a pattern that predicts the variable(s) of interest, and therefore to understand normal or pathological process. One possible approach to the identification of these regions is the use of permutation testing. Permutation testing involves 1) generation of a large set of 'null SVR models' using randomly permuted sets of target variables, and 2) comparison of the SVR model trained using the original labels to the set of null models. These permutation tests often require prohibitively long computational time. Recent work in support vector classification shows that it is possible to analytically approximate the results of permutation testing in medical image analysis. We propose an analogous approach to approximate permutation testing based analysis for support vector regression with medical imaging data. In this paper we present 1) the theory behind our approximation, and 2) experimental results using two real datasets.

  19. Implementation of algorithms based on support vector machine (SVM for electric systems: topic review

    Jefferson Jara Estupiñan


    Full Text Available Objective: To perform a review of implementation of algorithms based on support vectore machine applied to electric systems. Method: A paper search is done mainly on Biblio­graphic Indexes (BI and Bibliographic Bases with Selection Committee (BBSC about support vector machine. This work shows a qualitative and/or quan­titative description about advances and applications in the electrical environment, approaching topics such as: electrical market prediction, demand predic­tion, non-technical losses (theft, alternative energy source and transformers, among others, in each work the respective citation is done in order to guarantee the copy right and allow to the reader a dynamic mo­vement between the reading and the cited works. Results: A detailed review is done, focused on the searching of implemented algorithms in electric sys­tems and innovating application areas. Conclusion: Support vector machines have a lot of applications due to their multiple benefits, however in the electric energy area; they have not been tota­lly applied, this allow to identify a promising area of researching.

  20. Relevance Vector Machine and Support Vector Machine Classifier Analysis of Scanning Laser Polarimetry Retinal Nerve Fiber Layer Measurements

    Bowd, Christopher; Medeiros, Felipe A.; Zhang, Zuohua; Zangwill, Linda M.; Hao, Jiucang; Lee, Te-Won; Sejnowski, Terrence J.; Weinreb, Robert N.; Goldbaum, Michael H.


    Purpose To classify healthy and glaucomatous eyes using relevance vector machine (RVM) and support vector machine (SVM) learning classifiers trained on retinal nerve fiber layer (RNFL) thickness measurements obtained by scanning laser polarimetry (SLP). Methods Seventy-two eyes of 72 healthy control subjects (average age = 64.3 ± 8.8 years, visual field mean deviation =−0.71 ± 1.2 dB) and 92 eyes of 92 patients with glaucoma (average age = 66.9 ± 8.9 years, visual field mean deviation =−5.32 ± 4.0 dB) were imaged with SLP with variable corneal compensation (GDx VCC; Laser Diagnostic Technologies, San Diego, CA). RVM and SVM learning classifiers were trained and tested on SLP-determined RNFL thickness measurements from 14 standard parameters and 64 sectors (approximately 5.6° each) obtained in the circumpapillary area under the instrument-defined measurement ellipse (total 78 parameters). Tenfold cross-validation was used to train and test RVM and SVM classifiers on unique subsets of the full 164-eye data set and areas under the receiver operating characteristic (AUROC) curve for the classification of eyes in the test set were generated. AUROC curve results from RVM and SVM were compared to those for 14 SLP software-generated global and regional RNFL thickness parameters. Also reported was the AUROC curve for the GDx VCC software-generated nerve fiber indicator (NFI). Results The AUROC curves for RVM and SVM were 0.90 and 0.91, respectively, and increased to 0.93 and 0.94 when the training sets were optimized with sequential forward and backward selection (resulting in reduced dimensional data sets). AUROC curves for optimized RVM and SVM were significantly larger than those for all individual SLP parameters. The AUROC curve for the NFI was 0.87. Conclusions Results from RVM and SVM trained on SLP RNFL thickness measurements are similar and provide accurate classification of glaucomatous and healthy eyes. RVM may be preferable to SVM, because it provides a

  1. A Reflection on the Work of an Educational Psychologist in Providing Supervision for a Team of Community Based Support Workers, Supporting Families with Vulnerable Adolescents at Risk of Exclusion from School

    Maxwell, Tim


    The evolving role of the educational psychologist (EP) is discussed with an emphasis on the supervision provided for a team of support workers for vulnerable adolescents, working within a Local Service Team. This development is considered in the context of the Every Child Matters (DfES, 2004) agenda and the Farrell, Woods, Lewis, Rooney, Squire…

  2. A Reflection on the Work of an Educational Psychologist in Providing Supervision for a Team of Community Based Support Workers, Supporting Families with Vulnerable Adolescents at Risk of Exclusion from School

    Maxwell, Tim


    The evolving role of the educational psychologist (EP) is discussed with an emphasis on the supervision provided for a team of support workers for vulnerable adolescents, working within a Local Service Team. This development is considered in the context of the Every Child Matters (DfES, 2004) agenda and the Farrell, Woods, Lewis, Rooney, Squire…

  3. Support vector data description for detecting the air-ground interface in ground penetrating radar signals

    Wood, Joshua; Wilson, Joseph


    In using GPR images for landmine detection it is often useful to identify the air-ground interface in the GRP signal for alignment purposes. A common simple technique for doing this is to assume that the highest return in an A-scan is from the reflection due to the ground and to use that as the location of the interface. However there are many situations, such as the presence of nose clutter or shallow sub-surface objects, that can cause the global maximum estimate to be incorrect. A Support Vector Data Description (SVDD) is a one-class classifier related to the SVM which encloses the class in a hyper-sphere as opposed to using a hyper-plane as a decision boundary. We apply SVDD to the problem of detection of the air-ground interface by treating each sample in an A-scan, with some number of leading and trailing samples, as a feature vector. Training is done using a set of feature vectors based on known interfaces and detection is done by creating feature vectors from each of the samples in an A-scan, applying the trained SVDD to them and selecting the one with the least distance from the center of the hyper-sphere. We compare this approach with the global maximum approach, examining both the performance on human truthed data and how each method affects false alarm and true positive rates when used as the alignment method in mine detection algorithms.

  4. Ultrasonic image restoration based on support vector machine for surfacing interface testing

    Gao Shuangsheng; Gang Tie; Chi Dazhao


    In order to restore the degraded ultrasonic C-scan image for testing surfacing interface, a method based on support vector regression (SVR) network is proposed. By using the image of a simulating defect, the network is trained and a mapping relationship between the degraded and restored image is founded. The degraded C-scan image of Cu-Steel surfacing interface is processed by the trained network and improved image is obtained. The result shows that the method can effectively suppress the noise and deblur the defect edge in the image, and provide technique support for quality and reliability evaluation of the surfacing weld.

  5. Nurse Preparation and Organizational Support for Supervision of Unlicensed Assistive Personnel in Nursing Homes: A Qualitative Exploration

    Siegel, Elena O.; Young, Heather M.; Mitchell, Pamela H.; Shannon, Sarah E.


    Purpose: Nursing supervision of the routine daily care (e.g., grooming, feeding, and toileting) that is delegated to unlicensed assistive personnel (UAP) is critical to nursing home service delivery. The conditions under which the supervisory role is organized and operationalized at the work-unit level, taking into account workloads, registered…

  6. Intelligent Design of Metal Oxide Gas Sensor Arrays Using Reciprocal Kernel Support Vector Regression

    Dougherty, Andrew W.

    Metal oxides are a staple of the sensor industry. The combination of their sensitivity to a number of gases, and the electrical nature of their sensing mechanism, make the particularly attractive in solid state devices. The high temperature stability of the ceramic material also make them ideal for detecting combustion byproducts where exhaust temperatures can be high. However, problems do exist with metal oxide sensors. They are not very selective as they all tend to be sensitive to a number of reduction and oxidation reactions on the oxide's surface. This makes sensors with large numbers of sensors interesting to study as a method for introducing orthogonality to the system. Also, the sensors tend to suffer from long term drift for a number of reasons. In this thesis I will develop a system for intelligently modeling metal oxide sensors and determining their suitability for use in large arrays designed to analyze exhaust gas streams. It will introduce prior knowledge of the metal oxide sensors' response mechanisms in order to produce a response function for each sensor from sparse training data. The system will use the same technique to model and remove any long term drift from the sensor response. It will also provide an efficient means for determining the orthogonality of the sensor to determine whether they are useful in gas sensing arrays. The system is based on least squares support vector regression using the reciprocal kernel. The reciprocal kernel is introduced along with a method of optimizing the free parameters of the reciprocal kernel support vector machine. The reciprocal kernel is shown to be simpler and to perform better than an earlier kernel, the modified reciprocal kernel. Least squares support vector regression is chosen as it uses all of the training points and an emphasis was placed throughout this research for extracting the maximum information from very sparse data. The reciprocal kernel is shown to be effective in modeling the sensor

  7. SAMSVM: A tool for misalignment filtration of SAM-format sequences with support vector machine.

    Yang, Jianfeng; Ding, Xiaofan; Sun, Xing; Tsang, Shui-Ying; Xue, Hong


    Sequence alignment/map (SAM) formatted sequences [Li H, Handsaker B, Wysoker A et al., Bioinformatics 25(16):2078-2079, 2009.] have taken on a main role in bioinformatics since the development of massive parallel sequencing. However, because misalignment of sequences poses a significant problem in analysis of sequencing data that could lead to false positives in variant calling, the exclusion of misaligned reads is a necessity in analysis. In this regard, the multiple features of SAM-formatted sequences can be treated as vectors in a multi-dimension space to allow the application of a support vector machine (SVM). Applying the LIBSVM tools developed by Chang and Lin [Chang C-C, Lin C-J, ACM Trans Intell Syst Technol 2:1-27, 2011.] as a simple interface for support vector classification, the SAMSVM package has been developed in this study to enable misalignment filtration of SAM-formatted sequences. Cross-validation between two simulated datasets processed with SAMSVM yielded accuracies that ranged from 0.89 to 0.97 with F-scores ranging from 0.77 to 0.94 in 14 groups characterized by different mutation rates from 0.001 to 0.1, indicating that the model built using SAMSVM was accurate in misalignment detection. Application of SAMSVM to actual sequencing data resulted in filtration of misaligned reads and correction of variant calling.

  8. Interpreting support vector machine models for multivariate group wise analysis in neuroimaging.

    Gaonkar, Bilwaj; T Shinohara, Russell; Davatzikos, Christos


    Machine learning based classification algorithms like support vector machines (SVMs) have shown great promise for turning a high dimensional neuroimaging data into clinically useful decision criteria. However, tracing imaging based patterns that contribute significantly to classifier decisions remains an open problem. This is an issue of critical importance in imaging studies seeking to determine which anatomical or physiological imaging features contribute to the classifier's decision, thereby allowing users to critically evaluate the findings of such machine learning methods and to understand disease mechanisms. The majority of published work addresses the question of statistical inference for support vector classification using permutation tests based on SVM weight vectors. Such permutation testing ignores the SVM margin, which is critical in SVM theory. In this work we emphasize the use of a statistic that explicitly accounts for the SVM margin and show that the null distributions associated with this statistic are asymptotically normal. Further, our experiments show that this statistic is a lot less conservative as compared to weight based permutation tests and yet specific enough to tease out multivariate patterns in the data. Thus, we can better understand the multivariate patterns that the SVM uses for neuroimaging based classification.

  9. Neutron–gamma discrimination based on the support vector machine method

    Yu, Xunzhen [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Key Laboratory of High Energy Density Physics and Technology (Ministry of Education ), Sichuan University, Chengdu 610064 (China); Zhu, Jingjun [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Lin, ShinTed [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Key Laboratory of High Energy Density Physics and Technology (Ministry of Education ), Sichuan University, Chengdu 610064 (China); Wang, Li [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Department of Engineering Physics, Tsinghua University, Beijing 100084 (China); Xing, Haoyang, E-mail: [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Key Laboratory of High Energy Density Physics and Technology (Ministry of Education ), Sichuan University, Chengdu 610064 (China); Zhang, Caixun; Xia, Yuxi; Liu, Shukui [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Yue, Qian [Department of Engineering Physics, Tsinghua University, Beijing 100084 (China); Wei, Weiwei; Du, Qiang [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Tang, Changjian [School of Physical Science and Technology, Sichuan University, Chengdu 610041, Sichuan (China); Key Laboratory of High Energy Density Physics and Technology (Ministry of Education ), Sichuan University, Chengdu 610064 (China)


    In this study, the combination of the support vector machine (SVM) method with the moment analysis method (MAM) is proposed and utilized to perform neutron/gamma (n/γ) discrimination of the pulses from an organic liquid scintillator (OLS). Neutron and gamma events, which can be firmly separated on the scatter plot drawn by the charge comparison method (CCM), are detected to form the training data set and the test data set for the SVM, and the MAM is used to create the feature vectors for individual events in the data sets. Compared to the traditional methods, such as CCM, the proposed method can not only discriminate the neutron and gamma signals, even at lower energy levels, but also provide the corresponding classification accuracy for each event, which is useful in validating the discrimination. Meanwhile, the proposed method can also offer a predication of the classification for the under-energy-limit events.

  10. Classification of power quality combined disturbances based on phase space reconstruction and support vector machines


    Power Quality (PQ) combined disturbances become common along with ubiquity of voltage flickers and harmonics. This paper presents a novel approach to classify the different patterns of PQ combined disturbances. The classification system consists of two parts, namely the feature extraction and the automatic recognition. In the feature extraction stage, Phase Space Reconstruction (PSR), a time series analysis tool, is utilized to construct disturbance signal trajectories. For these trajectories, several indices are proposed to form the feature vectors. Support Vector Machines (SVMs) are then implemented to recognize the different patterns and to evaluate the efficiencies. The types of disturbances discussed include a combination of short-term disturbances (voltage sags, swells) and long-term disturbances (flickers, harmonics), as well as their homologous single ones. The feasibilities of the proposed approach are verified by simulation with thousands of PQ events. Comparison studies based on Wavelet Transform (WT) and Artificial Neural Network (ANN) are also reported to show its advantages.

  11. Clustering technique-based least square support vector machine for EEG signal classification.

    Siuly; Li, Yan; Wen, Peng Paul


    This paper presents a new approach called clustering technique-based least square support vector machine (CT-LS-SVM) for the classification of EEG signals. Decision making is performed in two stages. In the first stage, clustering technique (CT) has been used to extract representative features of EEG data. In the second stage, least square support vector machine (LS-SVM) is applied to the extracted features to classify two-class EEG signals. To demonstrate the effectiveness of the proposed method, several experiments have been conducted on three publicly available benchmark databases, one for epileptic EEG data, one for mental imagery tasks EEG data and another one for motor imagery EEG data. Our proposed approach achieves an average sensitivity, specificity and classification accuracy of 94.92%, 93.44% and 94.18%, respectively, for the epileptic EEG data; 83.98%, 84.37% and 84.17% respectively, for the motor imagery EEG data; and 64.61%, 58.77% and 61.69%, respectively, for the mental imagery tasks EEG data. The performance of the CT-LS-SVM algorithm is compared in terms of classification accuracy and execution (running) time with our previous study where simple random sampling with a least square support vector machine (SRS-LS-SVM) was employed for EEG signal classification. We also compare the proposed method with other existing methods in the literature for the three databases. The experimental results show that the proposed algorithm can produce a better classification rate than the previous reported methods and takes much less execution time compared to the SRS-LS-SVM technique. The research findings in this paper indicate that the proposed approach is very efficient for classification of two-class EEG signals.

  12. Particle Filter with Binary Gaussian Weighting and Support Vector Machine for Human Pose Interpretation

    Indah Agustien


    Full Text Available Human pose interpretation using Particle filter with Binary Gaussian Weighting and Support Vector Machine is proposed. In the proposed system, Particle filter is used to track human object, then this human object is skeletonized using thinning algorithm and classified using Support Vector Machine. The classification is to identify human pose, whether a normal or abnormal behavior. Here Particle filter is modified through weight calculation using Gaussiandistribution to reduce the computational time. The modified particle filter consists of four main phases. First, particles are generated to predict target’s location. Second, weight of certain particles is calculated and these particles are used to build Gaussian distribution. Third, weight of all particles is calculated based on Gaussian distribution. Fourth, update particles based on each weight. The modified particle filter could reduce computational time of object tracking since this method does not have to calculate particle’s weight one by one. To calculate weight, the proposed method builds Gaussian distribution and calculates particle’s weight using this distribution. Through experiment using video data taken in front of cashier of convenient store, the proposed method reduced computational time in tracking process until 68.34% in average compare to the conventional one, meanwhile the accuracy of tracking with this new method is comparable with particle filter method i.e. 90.3%. Combination particle filter with binary Gaussian weighting and support vector machine is promising for advanced early crime scene investigation.

  13. Signal and Noise Modeling of Microwave Transistors Using Characteristic Support Vector-based Sparse Regression

    F. Gunes


    Full Text Available In this work, an accurate and reliable S- and Noise (N - parameter black-box models for a microwave transistor are constructed based on the sparse regression using the Support Vector Regression Machine (SVRM as a nonlinear extrapolator trained by the data measured at the typical bias currents belonging to only a single bias voltage in the middle region of the device operation domain of (VDS/VCE, IDS/IC, f. SVRMs are novel learning machines combining the convex optimization theory with the generalization and therefore they guarantee the global minimum and the sparse solution which can be expressed as a continuous function of the input variables using a subset of the training data so called Support Vector (SVs. Thus magnitude and phase of each S- or N- parameter are expressed analytically valid in the wide range of device operation domain in terms of the Characteristic SVs obtained from the substantially reduced measured data. The proposed method is implemented successfully to modelling of the two LNA transistors ATF-551M4 and VMMK 1225 with their large operation domains and the comparative error-metric analysis is given in details with the counterpart method Generalized Regression Neural Network GRNN. It can be concluded that the Characteristic Support Vector based-sparse regression is an accurate and reliable method for the black-box signal and noise modelling of microwave transistors that extrapolates a reduced amount of training data consisting of the S- and N- data measured at the typical bias currents belonging to only a middle bias voltage in the form of continuous functions into the wide operation range.

  14. A collaborative framework for Distributed Privacy-Preserving Support Vector Machine learning.

    Que, Jialan; Jiang, Xiaoqian; Ohno-Machado, Lucila


    A Support Vector Machine (SVM) is a popular tool for decision support. The traditional way to build an SVM model is to estimate parameters based on a centralized repository of data. However, in the field of biomedicine, patient data are sometimes stored in local repositories or institutions where they were collected, and may not be easily shared due to privacy concerns. This creates a substantial barrier for researchers to effectively learn from the distributed data using machine learning tools like SVMs. To overcome this difficulty and promote efficient information exchange without sharing sensitive raw data, we developed a Distributed Privacy Preserving Support Vector Machine (DPP-SVM). The DPP-SVM enables privacy-preserving collaborative learning, in which a trusted server integrates "privacy-insensitive" intermediary results. The globally learned model is guaranteed to be exactly the same as learned from combined data. We also provide a free web-service ( for multiple participants to collaborate and complete the SVM-learning task in an efficient and privacy-preserving manner.

  15. Single face image reconstruction for super resolution using support vector regression

    Lin, Haijie; Yuan, Qiping; Chen, Zhihong; Yang, Xiaoping


    In recent years, we have witnessed the prosperity of the face image super-resolution (SR) reconstruction, especially the learning-based technology. In this paper, a novel super-resolution face reconstruction framework based on support vector regression (SVR) about a single image is presented. Given some input data, SVR can precisely predict output class labels. We regard the SR problem as the estimation of pixel labels in its high resolution version. It's effective to put local binary pattern (LBP) codes and partial pixels into input vectors during training models in our work, and models are learnt from a set of high and low resolution face image. By optimizing vector pairs which are used for learning model, the final reconstructed results were advanced. Especially to deserve to be mentioned, we can get more high frequency information by exploiting the cyclical scan actions in the process of both training and prediction. A large number of experimental data and visual observation have shown that our method outperforms bicubic interpolation and some stateof- the-art super-resolution algorithms.

  16. Seismic interpretation using Support Vector Machines implemented on Graphics Processing Units

    Kuzma, H A; Rector, J W; Bremer, D


    Support Vector Machines (SVMs) estimate lithologic properties of rock formations from seismic data by interpolating between known models using synthetically generated model/data pairs. SVMs are related to kriging and radial basis function neural networks. In our study, we train an SVM to approximate an inverse to the Zoeppritz equations. Training models are sampled from distributions constructed from well-log statistics. Training data is computed via a physically realistic forward modeling algorithm. In our experiments, each training data vector is a set of seismic traces similar to a 2-d image. The SVM returns a model given by a weighted comparison of the new data to each training data vector. The method of comparison is given by a kernel function which implicitly transforms data into a high-dimensional feature space and performs a dot-product. The feature space of a Gaussian kernel is made up of sines and cosines and so is appropriate for band-limited seismic problems. Training an SVM involves estimating a set of weights from the training model/data pairs. It is designed to be an easy problem; at worst it is a quadratic programming problem on the order of the size of the training set. By implementing the slowest part of our SVM algorithm on a graphics processing unit (GPU), we improve the speed of the algorithm by two orders of magnitude. Our SVM/GPU combination achieves results that are similar to those of conventional iterative inversion in fractions of the time.

  17. Radar Emitter Signal Recognition Using Wavelet Packet Transform and Support Vector Machines

    Jin Weidong; Zhang Gexiang; Hu Laizhao


    This paper presents a novel method for radar emitter signal recognition. First, wavelet packet transform (WPT) is introduced to extract features from radar emitter signals. Then, rough set theory is used to select the optimal feature subset with good discriminability from original feature set, and support vector machines (SVMs) are employed to design classifiers. A large number of experimental results show that the proposed method achieves very high recognition rates for 9 radar emitter signals in a wide range of signal-to-noise rates, and proves a feasible and valid method.

  18. Estimating regional conductivity in 2D disc head model by multidemensional support vector regression.

    Shen, Xueqin; Yan, Hui; Yan, Weili; Guo, Lei


    In this paper, we introduce multidimensional support vector regression (MSVR) with iterative re-weight least square (IRWLS) based procedure to estimating the regional conductivity in 2D disc head model. The results show that the method is capable of determining for the regional location of the disturbed conductivity in the 2D disc head model with single tissue and estimating for the tissue conductivities in the 2D disc head model with four kinds of tissue. The estimation errors are all within a few percent.

  19. Biometric gait recognition for mobile devices using wavelet transform and support vector machines

    Hestbek, Martin Reese; Nickel, C.; Busch, C.


    The ever growing number of mobile devices has turned the attention to security and usability. If a mobile device is lost or stolen this can lead to loss of personal information and the possibility of identity theft. People often tend not to use passwords which leads to lack of personal security...... obtained from mobile devices. Gait templates were constructed of Bark-frequency cepstral coefficients (BFCC) from the wavelet coefficients and these were arranged to train a support vector machine (SVM). A cross-day scenario demonstrates that the proposed approach shows competitive recognition performance...

  20. Support Vector Regression Model Based on Empirical Mode Decomposition and Auto Regression for Electric Load Forecasting

    Hong-Juan Li


    Full Text Available Electric load forecasting is an important issue for a power utility, associated with the management of daily operations such as energy transfer scheduling, unit commitment, and load dispatch. Inspired by strong non-linear learning capability of support vector regression (SVR, this paper presents a SVR model hybridized with the empirical mode decomposition (EMD method and auto regression (AR for electric load forecasting. The electric load data of the New South Wales (Australia market are employed for comparing the forecasting performances of different forecasting models. The results confirm the validity of the idea that the proposed model can simultaneously provide forecasting with good accuracy and interpretability.

  1. Thrust estimator design based on least squares support vector regression machine

    ZHAO Yong-ping; SUN Jian-guo


    In order to realize direct thrust control instead of traditional sensor-based control for nero-engines,it is indispensable to design a thrust estimator with high accuracy,so a scheme for thrust estimator design based on the least square support vector regression machine is proposed to solve this problem.Furthermore,numerical simulations confirm the effectiveness of our presented scheme.During the process of estimator design,a wrap per criterion that can not only reduce the computational complexity but also enhance the generalization performance is proposed to select variables as input variables for estimator.

  2. Identification of handwriting by using the genetic algorithm (GA) and support vector machine (SVM)

    Zhang, Qigui; Deng, Kai


    As portable digital camera and a camera phone comes more and more popular, and equally pressing is meeting the requirements of people to shoot at any time, to identify and storage handwritten character. In this paper, genetic algorithm(GA) and support vector machine(SVM)are used for identification of handwriting. Compare with parameters-optimized method, this technique overcomes two defects: first, it's easy to trap in the local optimum; second, finding the best parameters in the larger range will affects the efficiency of classification and prediction. As the experimental results suggest, GA-SVM has a higher recognition rate.

  3. An Auto-flag Method of Radio Visibility Data Based on Support Vector Machine

    Hui-mei, Dai; Ying, Mei; Wei, Wang; Hui, Deng; Feng, Wang


    The Mingantu Ultrawide Spectral Radioheliograph (MUSER) has entered a test observation stage. After the construction of the data acquisition and storage system, it is urgent to automatically flag and eliminate the abnormal visibility data so as to improve the imaging quality. In this paper, according to the observational records, we create a credible visibility set, and further obtain the corresponding flag model of visibility data by using the support vector machine (SVM) technique. The results show that the SVM is a robust approach to flag the MUSER visibility data, and can attain an accuracy of about 86%. Meanwhile, this method will not be affected by solar activities, such as flare eruptions.

  4. Performance and optimization of support vector machines in high-energy physics classification problems

    Sahin, Mehmet Özgür; Melzer-Pellmann, Isabell-Alissandra


    In this paper we promote the use of Support Vector Machines (SVM) as a machine learning tool for searches in high-energy physics. As an example for a new- physics search we discuss the popular case of Supersymmetry at the Large Hadron Collider. We demonstrate that the SVM is a valuable tool and show that an automated discovery- significance based optimization of the SVM hyper-parameters is a highly efficient way to prepare an SVM for such applications. A new C++ LIBSVM interface called SVM-HINT is developed and available on Github.

  5. Performance and optimization of support vector machines in high-energy physics classification problems

    Sahin, Mehmet Oezguer; Kruecker, Dirk; Melzer-Pellmann, Isabell [DESY, Hamburg (Germany)


    In this talk, the use of Support Vector Machines (SVM) is promoted for new-physics searches in high-energy physics. We developed an interface, called SVM HEP Interface (SVM-HINT), for a popular SVM library, LibSVM, and introduced a statistical-significance based hyper-parameter optimization algorithm for the new-physics searches. As example case study, a search for Supersymmetry at the Large Hadron Collider is given to demonstrate the capabilities of SVM using SVM-HINT.

  6. Hybrid RGSA and Support Vector Machine Framework for Three-Dimensional Magnetic Resonance Brain Tumor Classification

    R. Rajesh Sharma


    algorithm (RGSA. Support vector machines, over backpropagation network, and k-nearest neighbor are used to evaluate the goodness of classifier approach. The preliminary evaluation of the system is performed using 320 real-time brain MRI images. The system is trained and tested by using a leave-one-case-out method. The performance of the classifier is tested using the receiver operating characteristic curve of 0.986 (±002. The experimental results demonstrate the systematic and efficient feature extraction and feature selection algorithm to the performance of state-of-the-art feature classification methods.

  7. Analysis and prediction of nutritional requirements using structural properties of metabolic networks and support vector machines.

    Tamura, Takeyuki; Christian, Nils; Takemoto, Kazuhiro; Ebenhöh, Oliver; Akutsu, Tatsuya


    Properties of graph representation of genome scale metabolic networks have been extensively studied. However, the relationship between these structural properties and functional properties of the networks are still very unclear. In this paper, we focus on nutritional requirements of organisms as a functional property and study the relationship with structural properties of a graph representation of metabolic networks. In order to examine the relationship, we study to what extent the nutritional requirements can be predicted by using support vector machines from structural properties, which include degree exponent, edge density, clustering coefficient, degree centrality, closeness centrality, betweenness centrality and eigenvector centrality. Furthermore, we study which properties are influential to the nutritional requirements.

  8. Application of support vector machine and quantum genetic algorithm in infrared target recognition

    Wang, Hongliang; Huang, Yangwen; Ding, Haifei


    In this paper, a kind of classifier based on support vector machine (SVM) is designed for infrared target recognition. In allusion to the problem how to choose kernel parameter and error penalty factor, quantum genetic algorithm (QGA) is used to optimize the parameters of SVM model, it overcomes the shortcoming of determining its parameters after trial and error in the past. Classification experiments of infrared target features extracted by this method show that the convergence speed is fast and the rate of accurate recognition is high.

  9. Impact of Health Care Employees’ Job Satisfaction On Organizational Performance Support Vector Machine Approach

    Cemil Kuzey


    Full Text Available This study was undertaken to search for key factors that contribute to job satisfaction among health care workers, and also to determine the impact of these underlying dimensions of employee satisfaction on organizational performance. Exploratory Factor Analysis (EFA was applied to initially uncover the key factors, and then, in the next stage of analysis, a popular data mining technique, Support Vector Machine (SVM was employed on a sample of 249 to determine the impact of job satisfaction factors on organizational performance. According to the proposed model, the main factors were revealed to be management’s attitude, pay/reward, job security and colleagues.

  10. Study on flaw identification of ultrasonic signal for large shafts based on optimal support vector machine

    Zhao Xiufen; Yin Guofu; Tian Guiyun; Yin Ying


    Automatic identification of flaws is very important for ultrasonic nondestructive testing and evaluation of large shaft. A novel automatic defect identification system is presented. Wavelet packet analysis (WPA) was applied to feature extraction of ultrasonic signal, and optimal Support vector machine (SVM) was used to perform the identification task. Meanwhile, comparative study on convergent velocity and classified effect was done among SVM and several improved BP network models. To validate the method, some experiments were performed and the results show that the proposed system has very high identification performance for large shafts and the optimal SVM processes better classification performance and spreading potential than BP manual neural network under small study sample condition.

  11. Speech/Music Classification Enhancement for 3GPP2 SMV Codec Based on Support Vector Machine

    Kim, Sang-Kyun; Chang, Joon-Hyuk

    In this letter, we propose a novel approach to speech/music classification based on the support vector machine (SVM) to improve the performance of the 3GPP2 selectable mode vocoder (SMV) codec. We first analyze the features and the classification method used in real time speech/music classification algorithm in SMV, and then apply the SVM for enhanced speech/music classification. For evaluation of performance, we compare the proposed algorithm and the traditional algorithm of the SMV. The performance of the proposed system is evaluated under the various environments and shows better performance compared to the original method in the SMV.

  12. Hepatic CT image retrieval based on the combination of Gabor filters and support vector machine


    Content-based image retrieval has been an active area of research for more than ten years.Gabor schemes and support vector machine (SVM) method have been proven effective in image representation and classification. In this paper,we propose a retrieval scheme based on Gabor filters and SVMs for hepatic computed tomography (CT) images query.In our experiments,a batch of hepatic CT images containing several types of CT findings are used for the retrieval test.Precision comparison between our scheme and existing methods is presented.

  13. Support vector machine multiuser receiver for DS-CDMA signals in multipath channels.

    Chen, S; Samingan, A K; Hanzo, L


    The problem of constructing an adaptive multiuser detector (MUD) is considered for direct sequence code division multiple access (DS-CDMA) signals transmitted through multipath channels. The emerging learning technique, called support vector machines (SVM), is proposed as a method of obtaining a nonlinear MUD from a relatively small training data block. Computer simulation is used to study this SVM MUD, and the results show that it can closely match the performance of the optimal Bayesian one-shot detector. Comparisons with an adaptive radial basis function (RBF) MUD trained by an unsupervised clustering algorithm are discussed.

  14. Application of Support Vector Machine in Weld Defect Detection and Recognition of X-ray Images

    WANG Yong; GUO Hui


    Support vector machines(SVM) received wide attention for its excellent ability to learn, it has been applied in many fields. A review of the application of SVM in weld defect detection and recognition of X-ray image is been presented. We will show some commonly used methods of weld defect detection and recognition using SVM, and the advantages and disadvantages of each method will be discussed. SVM appears to be promising in weld defect detection and recognition, but future research is needed before it fully mature in this filed.

  15. Mixture gas component concentration analysis based on support vector machine and infrared spectrum

    Peng Bai; Junhua Liu


    @@ A novel quantitative analysis method of multi-component mixture gas concentration based on support vector machine (SVM) and spectroscopy is proposed. Through transformation of the kernel function, the seriously overlapped and nonlinear spectrum data are transformed in high-dimensional space, but the highdimensional data can be processed in the original space. Some factors, such as kernel function, range of the wavelength, and penalty coefficient, are discussed. This method is applied to the quantitative analysis of natural gas components concentration, and the component concentration maximal deviation is 2.28%.

  16. Prediction and analysis of chaotic time series on the basis of support vector

    Li Tianliang; He Liming; Li Haipeng


    Based on discussion on the theories of support vector machines(SVM),an one-step prediction model for time series prediction is presented,wherein the chaos theory is incorporated.Chaotic character of the time series is taken into account in the prediction procedure;parameters of reconstruction-delay and embedding-dimension for phase-space reconstruction are calculated in light of mutual-information and false-nearest-neighbor method,respectively.Precision and functionality have been demonstrated by the experimental results on the basis of the prediction of Lorenz chaotic time series.

  17. PMSVM: An Optimized Support Vector Machine Classification Algorithm Based on PCA and Multilevel Grid Search Methods

    Yukai Yao


    Full Text Available We propose an optimized Support Vector Machine classifier, named PMSVM, in which System Normalization, PCA, and Multilevel Grid Search methods are comprehensively considered for data preprocessing and parameters optimization, respectively. The main goals of this study are to improve the classification efficiency and accuracy of SVM. Sensitivity, Specificity, Precision, and ROC curve, and so forth, are adopted to appraise the performances of PMSVM. Experimental results show that PMSVM has relatively better accuracy and remarkable higher efficiency compared with traditional SVM algorithms.


    Ye Feng; Song Yonglun; Li Di; Lai Yizong


    A quality monitoring method by means of support vector machines (SVM) for robotized gas metal arc welding (GMAW) is introduced. Through the feature extraction of the welding process signal,a SVM classifier is constructed to establish the relationship between the feature of process parameters and the quality of weld penetration. Under the samples obtained from auto parts welding production line, the learning machine with a radial basis function kernel shows good performance. And this method can be feasible to identify defect online in welding production.

  19. Material grain size characterization method based on energy attenuation coefficient spectrum and support vector regression.

    Li, Min; Zhou, Tong; Song, Yanan


    A grain size characterization method based on energy attenuation coefficient spectrum and support vector regression (SVR) is proposed. First, the spectra of the first and second back-wall echoes are cut into several frequency bands to calculate the energy attenuation coefficient spectrum. Second, the frequency band that is sensitive to grain size variation is determined. Finally, a statistical model between the energy attenuation coefficient in the sensitive frequency band and average grain size is established through SVR. Experimental verification is conducted on austenitic stainless steel. The average relative error of the predicted grain size is 5.65%, which is better than that of conventional methods.

  20. Face Recognition Based on Support Vector Machine and Nearest Neighbor Classifier

    张燕昆; 刘重庆


    Support vector machine (SVM), as a novel approach in pattern recognition, has demonstrated a success in face detection and face recognition. In this paper, a face recognition approach based on the SVM classifier with the nearest neighbor classifier (NNC) is proposed. The principal component analysis (PCA) is used to reduce the dimension and extract features. Then one-against-all stratedy is used to train the SVM classifiers. At the testing stage, we propose an algorithm by combining SVM classifier with NNC to improve the correct recognition rate. We conduct the experiment on the Cambridge ORL face database. The result shows that our approach outperforms the standard eigenface approach and some other approaches.

  1. Accurate performance estimators for information retrieval based on span bound of support vector machines


    Support vector machines have met with significant success in the information retrieval field, especially in handling text classification tasks. Although various performance estimators for SVMs have been proposed,these only focus on accuracy which is based on the leave-one-out cross validation procedure. Information-retrieval-related performance measures are always neglected in a kernel learning methodology. In this paper, we have proposed a set of information-retrieval-oriented performance estimators for SVMs, which are based on the span bound of the leave-one-out procedure. Experiments have proven that our proposed estimators are both effective and stable.

  2. Performance and optimization of support vector machines in high-energy physics classification problems

    Sahin, M.Oe.; Kruecker, D.; Melzer-Pellmann, I.A.


    In this paper we promote the use of Support Vector Machines (SVM) as a machine learning tool for searches in high-energy physics. As an example for a new-physics search we discuss the popular case of Supersymmetry at the Large Hadron Collider. We demonstrate that the SVM is a valuable tool and show that an automated discovery-significance based optimization of the SVM hyper-parameters is a highly efficient way to prepare an SVM for such applications. A new C++ LIBSVM interface called SVM-HINT is developed and available on Github.

  3. DOA Finding with Support Vector Regression Based Forward–Backward Linear Prediction

    Jingjing Pan


    Full Text Available Direction-of-arrival (DOA estimation has drawn considerable attention in array signal processing, particularly with coherent signals and a limited number of snapshots. Forward–backward linear prediction (FBLP is able to directly deal with coherent signals. Support vector regression (SVR is robust with small samples. This paper proposes the combination of the advantages of FBLP and SVR in the estimation of DOAs of coherent incoming signals with low snapshots. The performance of the proposed method is validated with numerical simulations in coherent scenarios, in terms of different angle separations, numbers of snapshots, and signal-to-noise ratios (SNRs. Simulation results show the effectiveness of the proposed method.

  4. Tidal Current Short-Term Prediction Based on Support Vector Regression

    Guozhen, Yang; Haifeng, Wang; Hui, Qian; Jianming, Fang


    The traditional method of short-term tidal current prediction, harmonic method, typically needs more than 18 years of history records. The method in the article uses univariate feature selection and F-test to reduce the dimension of the data fed to support vector regressor, which reduces the need of history records to less than a year. Model parameters are selected by grid searching and cross-validation. History records from two datasets are used to build prediction models, spanning 3 months and 1 year respectively. Mean average errors of both datasets after normalizing are less than 0.05.

  5. Climate Change, Public Health, and Decision Support: The New Threat of Vector-borne Disease

    Grant, F.; Kumar, S.


    Climate change and vector-borne diseases constitute a massive threat to human development. It will not be enough to cut emissions of greenhouse gases-the tide of the future has already been established. Climate change and vector-borne diseases are already undermining the world's efforts to reduce extreme poverty. It is in the best interests of the world leaders to think in terms of concerted global actions, but adaptation and mitigation must be accomplished within the context of local community conditions, resources, and needs. Failure to act will continue to consign developed countries to completely avoidable health risks and significant expense. Failure to act will also reduce poorest of the world's population-some 2.6 billion people-to a future of diminished opportunity. Northrop Grumman has taken significant steps forward to develop the tools needed to assess climate change impacts on public health, collect relevant data for decision making, model projections at regional and local levels; and, deliver information and knowledge to local and regional stakeholders. Supporting these tools is an advanced enterprise architecture consisting of high performance computing, GIS visualization, and standards-based architecture. To address current deficiencies in local planning and decision making with respect to regional climate change and its effect on human health, our research is focused on performing a dynamical downscaling with the Weather Research and Forecasting (WRF) model to develop decision aids that translate the regional climate data into actionable information for users. For the present climate WRF was forced with the Max Planck Institute European Center/Hamburg Model version 5 (ECHAM5) General Circulation Model 20th century simulation. For the 21th century climate, we used an ECHAM5 simulation with the Special Report on Emissions (SRES) A1B emissions scenario. WRF was run in nested mode at spatial resolution of 108 km, 36 km and 12 km and 28 vertical levels

  6. Whither Supervision?

    Duncan Waite


    Full Text Available This paper inquires if the school supervision is in decadence. Dr. Waite responds that the answer will depend on which perspective you look at it. Dr. Waite suggests taking in consideration three elements that are related: the field itself, the expert in the field (the professor, the theorist, the student and the administrator, and the context. When these three elements are revised, it emphasizes that there is not a consensus about the field of supervision, but there are coincidences related to its importance and that it is related to the improvement of the practice of the students in the school for their benefit. Dr. Waite suggests that the practice on this field is not always in harmony with what the theorists affirm. When referring to the supervisor or the skilled person, the author indicates that his or her perspective depends on his or her epistemological believes or in the way he or she conceives the learning; that is why supervision can be understood in different ways. About the context, Waite suggests that there have to be taken in consideration the social or external forces that influent the people and the society, because through them the education is affected. Dr. Waite concludes that the way to understand the supervision depends on the performer’s perspective. He responds to the initial question saying that the supervision authorities, the knowledge on this field, the performers, and its practice, are maybe spread but not extinct because the supervision will always be part of the great enterprise that we called education.

  7. PROVISION OF RESEARCH SUPPORT SERVICES TO ODL LEARNERS BY TUTORS: A Focus on the Zimbabwe Open University’s Bachelor of Education (Educational Management Research Students’ Supervision Experiences

    Tichaona MAPOLISA


    Full Text Available The study examined the ODL learners’ perceptions of the quality of provision of research support services to the ODL learners by tutors. It focused on the Zimbabwe Open University’s (ZOU Bachelor of Education (Educational Management research students’ experiences. It was a qualitative multiple case study of four of the 10 Regional Centres of the ZOU. It purposively sampled 40 out of 160 research participants because they possessed desirable research characteristics for this study. The study was deemed significant in influencing tutors and policy makers to consider their research students’ supervision experiences as a basis for improving the quality of services for future research supervision practices and research projects. The study was guided by a two fold theory namely, thee Facilitation Theory (Nyawaranda, 2005 and the Nurturing Theory (Anderson, Pay and Mac Laughlin, 2006. Both theories advocate for the need of the supervisors to give their students a big heart. In terms of research supervision services offered by tutors the study indicated the time students were offered to meet research supervisors, prompt returns of marked work, and tutor student motivation and counselling as key services. In connection with the joys about research supervision, the students highly regarded: the manner in which tutors motivated them, tutors guidance in choosing research topic, tutor mentorship during research supervision and provision of workshops to polish up their research skills. In line with the challenges to the provision of research support services, three categories of challenges emerged. First, student-related challenges included lack of time, lack of money, lack of library facilities, lack of motivation and commitment to do research, lack of adequate theory in the area being researched on and family problems. Second, supervisor-related challenges included: too little direction, too little practical help given, too few meeting with students

  8. 基于支持向量机的分段线性学习方法%A Subsection Learning Algorithm Based on Support Vector Machines

    杨强; 吴中福; 王茜


    In this paper, we discuss drawback of traditional subsection learning algorithm in pattern recognition and exiting support vector machines (including kernel functions), the necessity of using subsection learning algorithm based on support vector machines as well as. In turn, a subsection learning algorithm based on support vector machines, is proposed in this paper.

  9. Supervisees' Perception of Clinical Supervision

    Willis, Lisa


    Supervisors must become aware of the possible conflicts that could arise during clinical supervision. It is important that supervisors communicate their roles and expectations effectively with their supervisees. This paper supports the notion that supervision is a mutual agreement between the supervisee and the supervisor and the roles of…

  10. A multi-label learning based kernel automatic recommendation method for support vector machine.

    Zhang, Xueying; Song, Qinbao


    Choosing an appropriate kernel is very important and critical when classifying a new problem with Support Vector Machine. So far, more attention has been paid on constructing new kernels and choosing suitable parameter values for a specific kernel function, but less on kernel selection. Furthermore, most of current kernel selection methods focus on seeking a best kernel with the highest classification accuracy via cross-validation, they are time consuming and ignore the differences among the number of support vectors and the CPU time of SVM with different kernels. Considering the tradeoff between classification success ratio and CPU time, there may be multiple kernel functions performing equally well on the same classification problem. Aiming to automatically select those appropriate kernel functions for a given data set, we propose a multi-label learning based kernel recommendation method built on the data characteristics. For each data set, the meta-knowledge data base is first created by extracting the feature vector of data characteristics and identifying the corresponding applicable kernel set. Then the kernel recommendation model is constructed on the generated meta-knowledge data base with the multi-label classification method. Finally, the appropriate kernel functions are recommended to a new data set by the recommendation model according to the characteristics of the new data set. Extensive experiments over 132 UCI benchmark data sets, with five different types of data set characteristics, eleven typical kernels (Linear, Polynomial, Radial Basis Function, Sigmoidal function, Laplace, Multiquadric, Rational Quadratic, Spherical, Spline, Wave and Circular), and five multi-label classification methods demonstrate that, compared with the existing kernel selection methods and the most widely used RBF kernel function, SVM with the kernel function recommended by our proposed method achieved the highest classification performance.

  11. Diagnosis of Chronic Kidney Disease Based on Support Vector Machine by Feature Selection Methods.

    Polat, Huseyin; Danaei Mehr, Homay; Cetin, Aydin


    As Chronic Kidney Disease progresses slowly, early detection and effective treatment are the only cure to reduce the mortality rate. Machine learning techniques are gaining significance in medical diagnosis because of their classification ability with high accuracy rates. The accuracy of classification algorithms depend on the use of correct feature selection algorithms to reduce the dimension of datasets. In this study, Support Vector Machine classification algorithm was used to diagnose Chronic Kidney Disease. To diagnose the Chronic Kidney Disease, two essential types of feature selection methods namely, wrapper and filter approaches were chosen to reduce the dimension of Chronic Kidney Disease dataset. In wrapper approach, classifier subset evaluator with greedy stepwise search engine and wrapper subset evaluator with the Best First search engine were used. In filter approach, correlation feature selection subset evaluator with greedy stepwise search engine and filtered subset evaluator with the Best First search engine were used. The results showed that the Support Vector Machine classifier by using filtered subset evaluator with the Best First search engine feature selection method has higher accuracy rate (98.5%) in the diagnosis of Chronic Kidney Disease compared to other selected methods.

  12. Prognostics of Lithium-Ion Batteries Based on Battery Performance Analysis and Flexible Support Vector Regression

    Shuai Wang


    Full Text Available Accurate prediction of the remaining useful life (RUL of lithium-ion batteries is important for battery management systems. Traditional empirical data-driven approaches for RUL prediction usually require multidimensional physical characteristics including the current, voltage, usage duration, battery temperature, and ambient temperature. From a capacity fading analysis of lithium-ion batteries, it is found that the energy efficiency and battery working temperature are closely related to the capacity degradation, which account for all performance metrics of lithium-ion batteries with regard to the RUL and the relationships between some performance metrics. Thus, we devise a non-iterative prediction model based on flexible support vector regression (F-SVR and an iterative multi-step prediction model based on support vector regression (SVR using the energy efficiency and battery working temperature as input physical characteristics. The experimental results show that the proposed prognostic models have high prediction accuracy by using fewer dimensions for the input data than the traditional empirical models.

  13. A tool for urban soundscape evaluation applying Support Vector Machines for developing a soundscape classification model.

    Torija, Antonio J; Ruiz, Diego P; Ramos-Ridao, Angel F


    To ensure appropriate soundscape management in urban environments, the urban-planning authorities need a range of tools that enable such a task to be performed. An essential step during the management of urban areas from a sound standpoint should be the evaluation of the soundscape in such an area. In this sense, it has been widely acknowledged that a subjective and acoustical categorization of a soundscape is the first step to evaluate it, providing a basis for designing or adapting it to match people's expectations as well. In this sense, this work proposes a model for automatic classification of urban soundscapes. This model is intended for the automatic classification of urban soundscapes based on underlying acoustical and perceptual criteria. Thus, this classification model is proposed to be used as a tool for a comprehensive urban soundscape evaluation. Because of the great complexity associated with the problem, two machine learning techniques, Support Vector Machines (SVM) and Support Vector Machines trained with Sequential Minimal Optimization (SMO), are implemented in developing model classification. The results indicate that the SMO model outperforms the SVM model in the specific task of soundscape classification. With the implementation of the SMO algorithm, the classification model achieves an outstanding performance (91.3% of instances correctly classified).

  14. Anticipatory Monitoring and Control of Complex Systems using a Fuzzy based Fusion of Support Vector Regressors

    Miltiadis Alamaniotis; Vivek Agarwal


    This paper places itself in the realm of anticipatory systems and envisions monitoring and control methods being capable of making predictions over system critical parameters. Anticipatory systems allow intelligent control of complex systems by predicting their future state. In the current work, an intelligent model aimed at implementing anticipatory monitoring and control in energy industry is presented and tested. More particularly, a set of support vector regressors (SVRs) are trained using both historical and observed data. The trained SVRs are used to predict the future value of the system based on current operational system parameter. The predicted values are then inputted to a fuzzy logic based module where the values are fused to obtain a single value, i.e., final system output prediction. The methodology is tested on real turbine degradation datasets. The outcome of the approach presented in this paper highlights the superiority over single support vector regressors. In addition, it is shown that appropriate selection of fuzzy sets and fuzzy rules plays an important role in improving system performance.

  15. An Artificial Intelligence Approach for Groutability Estimation Based on Autotuning Support Vector Machine

    Hong-Hai Tran


    Full Text Available Permeation grouting is a commonly used approach for soil improvement in construction engineering. Thus, predicting the results of grouting activities is a crucial task that needs to be carried out in the planning phase of any grouting project. In this research, a novel artificial intelligence approach—autotuning support vector machine—is proposed to forecast the result of grouting activities that employ microfine cement grouts. In the new model, the support vector machine (SVM algorithm is utilized to classify grouting activities into two classes: success and  failure. Meanwhile, the differential evolution (DE optimization algorithm is employed to identify the optimal tuning parameters of the SVM algorithm, namely, the penalty parameter and the kernel function parameter. The integration of the SVM and DE algorithms allows the newly established method to operate automatically without human prior knowledge or tedious processes for parameter setting. An experiment using a set of in situ data samples demonstrates that the newly established method can produce an outstanding prediction performance.

  16. Prediction of Skin Sensitization with a Particle Swarm Optimized Support Vector Machine

    Chenzhong Cao


    Full Text Available Skin sensitization is the most commonly reported occupational illness, causing much suffering to a wide range of people. Identification and labeling of environmental allergens is urgently required to protect people from skin sensitization. The guinea pig maximization test (GPMT and murine local lymph node assay (LLNA are the two most important in vivo models for identification of skin sensitizers. In order to reduce the number of animal tests, quantitative structure-activity relationships (QSARs are strongly encouraged in the assessment of skin sensitization of chemicals. This paper has investigated the skin sensitization potential of 162 compounds with LLNA results and 92 compounds with GPMT results using a support vector machine. A particle swarm optimization algorithm was implemented for feature selection from a large number of molecular descriptors calculated by Dragon. For the LLNA data set, the classification accuracies are 95.37% and 88.89% for the training and the test sets, respectively. For the GPMT data set, the classification accuracies are 91.80% and 90.32% for the training and the test sets, respectively. The classification performances were greatly improved compared to those reported in the literature, indicating that the support vector machine optimized by particle swarm in this paper is competent for the identification of skin sensitizers.

  17. Application of Support Vector Machine to Reliability Analysis of Engine Systems

    Zhang Xinfeng


    Full Text Available Reliability analysis plays a very important role for assessing the performance and making maintenance plans of engine systems. This research presents a comparative study of the predictive performances of support vector machines (SVM , least square support vector machine (LSSVM and neural network time series models for forecasting failures and reliability in engine systems. Further, the reliability indexes of engine systems are computed by the weibull probability paper programmed with Matlab. The results shows that the probability distribution of the forecasting outcomes is consistent to the distribution of the actual data, which all follow weibull distribution and the predictions by SVM and LSSVM can provide accurate predictions of the characteristic life. So SVM and LSSVM are both another choice of engine system reliability analysis. Moreover, the predictive precise of the method based on LSSVM is higher than that of SVM. In small samples, the prediction by LSSVM will be more popular, because its compution cost is lower and the precise can be more satisfied.

  18. Using support vector machines to improve elemental ion identification in macromolecular crystal structures

    Morshed, Nader [University of California, Berkeley, CA 94720 (United States); Lawrence Berkeley National Laboratory, Berkeley, CA 94720 (United States); Echols, Nathaniel, E-mail: [Lawrence Berkeley National Laboratory, Berkeley, CA 94720 (United States); Adams, Paul D., E-mail: [Lawrence Berkeley National Laboratory, Berkeley, CA 94720 (United States); University of California, Berkeley, CA 94720 (United States)


    A method to automatically identify possible elemental ions in X-ray crystal structures has been extended to use support vector machine (SVM) classifiers trained on selected structures in the PDB, with significantly improved sensitivity over manually encoded heuristics. In the process of macromolecular model building, crystallographers must examine electron density for isolated atoms and differentiate sites containing structured solvent molecules from those containing elemental ions. This task requires specific knowledge of metal-binding chemistry and scattering properties and is prone to error. A method has previously been described to identify ions based on manually chosen criteria for a number of elements. Here, the use of support vector machines (SVMs) to automatically classify isolated atoms as either solvent or one of various ions is described. Two data sets of protein crystal structures, one containing manually curated structures deposited with anomalous diffraction data and another with automatically filtered, high-resolution structures, were constructed. On the manually curated data set, an SVM classifier was able to distinguish calcium from manganese, zinc, iron and nickel, as well as all five of these ions from water molecules, with a high degree of accuracy. Additionally, SVMs trained on the automatically curated set of high-resolution structures were able to successfully classify most common elemental ions in an independent validation test set. This method is readily extensible to other elemental ions and can also be used in conjunction with previous methods based on a priori expectations of the chemical environment and X-ray scattering.

  19. River Flow Estimation from Upstream Flow Records Using Support Vector Machines

    Halil Karahan


    Full Text Available A novel architecture for flood routing model has been proposed and its efficiency is validated on several problems by employing support vector machines. The architecture is designed by including the inputs and observed and calculated outflows from the previous time step output. Whole observed data have been used for determining the model parameters in the heuristic methods given in the literature, which constitutes the major disadvantage of the existing approaches. Moreover, using the whole data for training may lead to overtraining problem that causes overfitting of estimations and data. Therefore, in this study, 60–90% of the data are randomly selected for training and then the remaining data are used for validation. In order to take the effects of the measurement errors into consideration, the data are corrupted by some additive noise. The results show that the proposed architecture improves the model performance under noisy and missing data conditions and that support vector machines can be powerful alternative in flood routing modeling.

  20. A Novel Method for Flatness Pattern Recognition via Least Squares Support Vector Regression


    To adapt to the new requirement of the developing flatness control theory and technology, cubic patterns were introduced on the basis of the traditional linear, quadratic and quartic flatness basic patterns. Linear, quadratic, cubic and quartic Legendre orthogonal polynomials were adopted to express the flatness basic patterns. In order to over- come the defects live in the existent recognition methods based on fuzzy, neural network and support vector regres- sion (SVR) theory, a novel flatness pattern recognition method based on least squares support vector regression (LS-SVR) was proposed. On this basis, for the purpose of determining the hyper-parameters of LS-SVR effectively and enhan- cing the recognition accuracy and generalization performance of the model, particle swarm optimization algorithm with leave-one-out (LOO) error as fitness function was adopted. To overcome the disadvantage of high computational complexity of naive cross-validation algorithm, a novel fast cross-validation algorithm was introduced to calculate the LOO error of LDSVR. Results of experiments on flatness data calculated by theory and a 900HC cold-rolling mill practically measured flatness signals demonstrate that the proposed approach can distinguish the types and define the magnitudes of the flatness defects effectively with high accuracy, high speed and strong generalization ability.

  1. Support Vector Regression-Based Adaptive Divided Difference Filter for Nonlinear State Estimation Problems

    Hongjian Wang


    Full Text Available We present a support vector regression-based adaptive divided difference filter (SVRADDF algorithm for improving the low state estimation accuracy of nonlinear systems, which are typically affected by large initial estimation errors and imprecise prior knowledge of process and measurement noises. The derivative-free SVRADDF algorithm is significantly simpler to compute than other methods and is implemented using only functional evaluations. The SVRADDF algorithm involves the use of the theoretical and actual covariance of the innovation sequence. Support vector regression (SVR is employed to generate the adaptive factor to tune the noise covariance at each sampling instant when the measurement update step executes, which improves the algorithm’s robustness. The performance of the proposed algorithm is evaluated by estimating states for (i an underwater nonmaneuvering target bearing-only tracking system and (ii maneuvering target bearing-only tracking in an air-traffic control system. The simulation results show that the proposed SVRADDF algorithm exhibits better performance when compared with a traditional DDF algorithm.

  2. Human action recognition with group lasso regularized-support vector machine

    Luo, Huiwu; Lu, Huanzhang; Wu, Yabei; Zhao, Fei


    The bag-of-visual-words (BOVW) and Fisher kernel are two popular models in human action recognition, and support vector machine (SVM) is the most commonly used classifier for the two models. We show two kinds of group structures in the feature representation constructed by BOVW and Fisher kernel, respectively, since the structural information of feature representation can be seen as a prior for the classifier and can improve the performance of the classifier, which has been verified in several areas. However, the standard SVM employs L2-norm regularization in its learning procedure, which penalizes each variable individually and cannot express the structural information of feature representation. We replace the L2-norm regularization with group lasso regularization in standard SVM, and a group lasso regularized-support vector machine (GLRSVM) is proposed. Then, we embed the group structural information of feature representation into GLRSVM. Finally, we introduce an algorithm to solve the optimization problem of GLRSVM by alternating directions method of multipliers. The experiments evaluated on KTH, YouTube, and Hollywood2 datasets show that our method achieves promising results and improves the state-of-the-art methods on KTH and YouTube datasets.

  3. Ameliorated Austenite Carbon Content Control in Austempered Ductile Irons by Support Vector Regression

    Chan-Yun Yang


    Full Text Available Austempered ductile iron has emerged as a notable material in several engineering fields, including marine applications. The initial austenite carbon content after austenization transform but before austempering process for generating bainite matrix proved critical in controlling the resulted microstructure and thus mechanical properties. In this paper, support vector regression is employed in order to establish a relationship between the initial carbon concentration in the austenite with austenization temperature and alloy contents, thereby exercising improved control in the mechanical properties of the austempered ductile irons. Particularly, the paper emphasizes a methodology tailored to deal with a limited amount of available data with intrinsically contracted and skewed distribution. The collected information from a variety of data sources presents another challenge of highly uncertain variance. The authors present a hybrid model consisting of a procedure of a histogram equalizer and a procedure of a support-vector-machine (SVM- based regression to gain a more robust relationship to respond to the challenges. The results show greatly improved accuracy of the proposed model in comparison to two former established methodologies. The sum squared error of the present model is less than one fifth of that of the two previous models.

  4. [NIR spectroscopy based on least square support vector machines for quality prediction of tomato juice].

    Huang, Kang; Wang, Hui-jun; Xu, Hui-rong; Wang, Jian-ping; Ying, Yi-bin


    The application of least square support vector machines (LS-SVM) regression method based on statistics study theory to the analysis with near infrared (NIR) spectra of tomato juice was introduced in the present paper. In this method, LS-SVM was used for establishing model of spectral analysis, and was applied to predict the sugar contents (SC) and available acid (VA) in tomato juice samples. NIR transmission spectra of tomato juice were measured in the spectral range of 800-2,500 nm using InGaAs detector. The radial basis function (RBF) was adopted as a kernel function of LS-SVM. Sixty seven tomato juice samples were used as calibration set, and thirty three samples were used as validation set. The results of the method for sugar contents (SC) and available acid (VA) prediction were: a high correlation coefficient of 0.9903 and 0.9675, and a low root mean square error of prediction (RMSEP) of 0.0056 degree Brix and 0.0245, respectively. And compared to PLS and PCR methods, the performance of the LSSVM method was better. The results indicated that it was possible to built statistic models to quantify some common components in tomato juice using near-infrared (NIR) spectroscopy and least square support vector machines (LS-SVM) regression method as a nonlinear multivariate calibration procedure, and LS-SVM could be a rapid and accurate method for juice components determination based on NIR spectra.

  5. SNPs selection using support vector regression and genetic algorithms in GWAS.

    de Oliveira, Fabrízzio Condé; Borges, Carlos Cristiano Hasenclever; Almeida, Fernanda Nascimento; e Silva, Fabyano Fonseca; da Silva Verneque, Rui; da Silva, Marcos Vinicius G B; Arbex, Wagner


    This paper proposes a new methodology to simultaneously select the most relevant SNPs markers for the characterization of any measurable phenotype described by a continuous variable using Support Vector Regression with Pearson Universal kernel as fitness function of a binary genetic algorithm. The proposed methodology is multi-attribute towards considering several markers simultaneously to explain the phenotype and is based jointly on statistical tools, machine learning and computational intelligence. The suggested method has shown potential in the simulated database 1, with additive effects only, and real database. In this simulated database, with a total of 1,000 markers, and 7 with major effect on the phenotype and the other 993 SNPs representing the noise, the method identified 21 markers. Of this total, 5 are relevant SNPs between the 7 but 16 are false positives. In real database, initially with 50,752 SNPs, we have reduced to 3,073 markers, increasing the accuracy of the model. In the simulated database 2, with additive effects and interactions (epistasis), the proposed method matched to the methodology most commonly used in GWAS. The method suggested in this paper demonstrates the effectiveness in explaining the real phenotype (PTA for milk), because with the application of the wrapper based on genetic algorithm and Support Vector Regression with Pearson Universal, many redundant markers were eliminated, increasing the prediction and accuracy of the model on the real database without quality control filters. The PUK demonstrated that it can replicate the performance of linear and RBF kernels.

  6. Fuzzy nonlinear proximal support vector machine for land extraction based on remote sensing image.

    Xiaomei Zhong

    Full Text Available Currently, remote sensing technologies were widely employed in the dynamic monitoring of the land. This paper presented an algorithm named fuzzy nonlinear proximal support vector machine (FNPSVM by basing on ETM(+ remote sensing image. This algorithm is applied to extract various types of lands of the city Da'an in northern China. Two multi-category strategies, namely "one-against-one" and "one-against-rest" for this algorithm were described in detail and then compared. A fuzzy membership function was presented to reduce the effects of noises or outliers on the data samples. The approaches of feature extraction, feature selection, and several key parameter settings were also given. Numerous experiments were carried out to evaluate its performances including various accuracies (overall accuracies and kappa coefficient, stability, training speed, and classification speed. The FNPSVM classifier was compared to the other three classifiers including the maximum likelihood classifier (MLC, back propagation neural network (BPN, and the proximal support vector machine (PSVM under different training conditions. The impacts of the selection of training samples, testing samples and features on the four classifiers were also evaluated in these experiments.

  7. Fuzzy Support Vector Machine-based Multi-agent Optimal Path

    Gireesh Kumar T


    Full Text Available A mobile robot to navigate purposefully from a start location to a target location, needs three basic requirements: sensing, learning, and reasoning. In the existing system, the mobile robot navigates in a known environment on a predefined path. However, the pervasive presence of uncertainty in sensing and learning, makes the choice of a suitable tool of reasoning and decision-making that can deal with incomplete information, vital to ensure a robust control system. This problem can be overcome by the proposed navigation method using fuzzy support vector machine (FSVM. It proposes a fuzzy logic-based support vector machine (SVM approach to secure a collision-free path avoiding multiple dynamic obstacles. The navigator consists of an FSVM-based collision avoidance. The decisions are taken at each step for the mobile robot to attain the goal position without collision. Fuzzy-SVM rule bases are built, which require simple evaluation data rather than thousands of input-output training data. The effectiveness of the proposed method is verified by a series of simulations and implemented with a microcontroller for navigation.Defence Science Journal, 2010, 60(4, pp.387-391, DOI:

  8. Fuzzy-based multi-kernel spherical support vector machine for effective handwritten character recognition



    Due to constant advancement of computer tools, automated conversion of images of typed,handwritten and printed text is important for various applications, which has led to intense research for several years in the field of offline handwritten character recognition. Handwritten character recognition is complex because characters differ by writing style, shapes and writing devices. To resolve this problem, we propose a fuzzy-based multi-kernel spherical support vector machine. Initially, the input image is fed into the pre-processing step to acquire suitable images. Then, histogram of oriented gradient (HOG) descriptor is utilised forfeature extraction. The HOG descriptor constitutes a histogram estimation and normalisation computation. The features are then classified using the proposed classifier for character recognition. In the proposed classifier, we design a new multi-kernel function based on the fuzzy triangular membership function. Finally, a newly developed multi-kernel function is incorporated into the spherical support vector machine to enhance the performance significantly. The experimental results are evaluated and performance is analysed by metrics such as false acceptance rate, false rejection rate and accuracy, which is implemented in MATLAB. Then, the performance is compared with existing systems based on the percentage of training data samples. Thus, the outcome of our proposed system attains 99% higher accuracy, which ensures efficient recognition performance

  9. Support Vector Machine-Based Human Behavior Classification in Crowd through Projection and Star Skeletonization

    Yogameena, B.


    Full Text Available Problem statement: Detection of individual’s abnormal human behaviors in the crowd has become a critical problem because in the event of terror strikes. This study presented a real-time video surveillance system which classifies normal and abnormal behaviors in crowds. The aim of this research was to provide a system which can aid in monitoring crowded urban environments. Approach: The proposed behaviour classification was through projection which separated individuals and using star skeletonization the features like body posture and the cyclic motion cues were obtained. Using these cues the Support Vector Machine (SVM classified the normal and abnormal behaviors of human. Results: Experimental results demonstrated the method proposed was robust and efficient in the classification of normal and abnormal human behaviors. A comparative study of classification accuracy between principal component analysis and Support Vector Machine (SVM classification was also presented. Conclusion: The proposed method classified the behavior such as running people in a crowded environment, bending down movement while most are walking or standing, a person carrying a long bar and a person waving hand in the crowd is classified.

  10. Multi-Scale Analysis Based Ball Bearing Defect Diagnostics Using Mahalanobis Distance and Support Vector Machine

    Chun-Chieh Wang


    Full Text Available The objective of this research is to investigate the feasibility of utilizing the multi-scale analysis and support vector machine (SVM classification scheme to diagnose the bearing faults in rotating machinery. For complicated signals, the characteristics of dynamic systems may not be apparently observed in a scale, particularly for the fault-related features of rotating machinery. In this research, the multi-scale analysis is employed to extract the possible fault-related features in different scales, such as the multi-scale entropy (MSE, multi-scale permutation entropy (MPE, multi-scale root-mean-square (MSRMS and multi-band spectrum entropy (MBSE. Some of the features are then selected as the inputs of the support vector machine (SVM classifier through the Fisher score (FS as well as the Mahalanobis distance (MD evaluations. The vibration signals of bearing test data at Case Western Reserve University (CWRU are utilized as the illustrated examples. The analysis results demonstrate that an accurate bearing defect diagnosis can be achieved by using the extracted machine features in different scales. It can be also noted that the diagnostic results of bearing faults can be further enhanced through the feature selection procedures of FS and MD evaluations.

  11. Electrocardiogram Pattern Recognition and Analysis Based on Artificial Neural Networks and Support Vector Machines: A Review

    Mario Sansone


    Full Text Available Computer systems for Electrocardiogram (ECG analysis support the clinician in tedious tasks (e.g., Holter ECG monitored in Intensive Care Units or in prompt detection of dangerous events (e.g., ventricular fibrillation. Together with clinical applications (arrhythmia detection and heart rate variability analysis, ECG is currently being investigated in biometrics (human identification, an emerging area receiving increasing attention. Methodologies for clinical applications can have both differences and similarities with respect to biometrics. This paper reviews methods of ECG processing from a pattern recognition perspective. In particular, we focus on features commonly used for heartbeat classification. Considering the vast literature in the field and the limited space of this review, we dedicated a detailed discussion only to a few classifiers (Artificial Neural Networks and Support Vector Machines because of their popularity; however, other techniques such as Hidden Markov Models and Kalman Filtering will be also mentioned.

  12. Support-vector-machine tree-based domain knowledge learning toward automated sports video classification

    Xiao, Guoqiang; Jiang, Yang; Song, Gang; Jiang, Jianmin


    We propose a support-vector-machine (SVM) tree to hierarchically learn from domain knowledge represented by low-level features toward automatic classification of sports videos. The proposed SVM tree adopts a binary tree structure to exploit the nature of SVM's binary classification, where each internal node is a single SVM learning unit, and each external node represents the classified output type. Such a SVM tree presents a number of advantages, which include: 1. low computing cost; 2. integrated learning and classification while preserving individual SVM's learning strength; and 3. flexibility in both structure and learning modules, where different numbers of nodes and features can be added to address specific learning requirements, and various learning models can be added as individual nodes, such as neural networks, AdaBoost, hidden Markov models, dynamic Bayesian networks, etc. Experiments support that the proposed SVM tree achieves good performances in sports video classifications.

  13. New Fuzzy Support Vector Machine for the Class Imbalance Problem in Medical Datasets Classification

    Xiaoqing Gu


    Full Text Available In medical datasets classification, support vector machine (SVM is considered to be one of the most successful methods. However, most of the real-world medical datasets usually contain some outliers/noise and data often have class imbalance problems. In this paper, a fuzzy support machine (FSVM for the class imbalance problem (called FSVM-CIP is presented, which can be seen as a modified class of FSVM by extending manifold regularization and assigning two misclassification costs for two classes. The proposed FSVM-CIP can be used to handle the class imbalance problem in the presence of outliers/noise, and enhance the locality maximum margin. Five real-world medical datasets, breast, heart, hepatitis, BUPA liver, and pima diabetes, from the UCI medical database are employed to illustrate the method presented in this paper. Experimental results on these datasets show the outperformed or comparable effectiveness of FSVM-CIP.

  14. Multiple support vector machines for land cover change detection: An application for mapping urban extensions

    Nemmour, Hassiba; Chibani, Youcef

    The reliability of support vector machines for classifying hyper-spectral images of remote sensing has been proven in various studies. In this paper, we investigate their applicability for land cover change detection. First, SVM-based change detection is presented and performed for mapping urban growth in the Algerian capital. Different performance indicators, as well as a comparison with artificial neural networks, are used to support our experimental analysis. In a second step, a combination framework is proposed to improve change detection accuracy. Two combination rules, namely, Fuzzy Integral and Attractor Dynamics, are implemented and evaluated with respect to individual SVMs. Recognition rates achieved by individual SVMs, compared to neural networks, confirm their efficiency for land cover change detection. Furthermore, the relevance of SVM combination is highlighted.

  15. On-line forecasting model for zinc output based on self-tuning support vector regression and its application

    胡志坤; 桂卫华; 彭小奇


    An on-line forecasting model based on self-tuning support vectors regression for zinc output was put forward to maximize zinc output by adjusting operational parameters in the process of imperial smelting furnace. In this model, the mathematical model of support vector regression was converted into the same format as support vector machine for classification. Then a simplified sequential minimal optimization for classification was applied to train the regression coefficient vector α- α* and threshold b. Sequentially penalty parameter C was tuned dynamically through forecasting result during the training process. Finally, an on-line forecasting algorithm for zinc output was proposed. The simulation result shows that in spite of a relatively small industrial data set, the effective error is less than 10% with a remarkable performance of real time. The model was applied to the optimization operation and fault diagnosis system for imperial smelting furnace.

  16. Enhanced land use/cover classification of heterogeneous tropical landscapes using support vector machines and textural homogeneity

    Paneque-Gálvez, Jaime; Mas, Jean-François; Moré, Gerard; Cristóbal, Jordi; Orta-Martínez, Martí; Luz, Ana Catarina; Guèze, Maximilien; Macía, Manuel J.; Reyes-García, Victoria


    Land use/cover classification is a key research field in remote sensing and land change science as thematic maps derived from remotely sensed data have become the basis for analyzing many socio-ecological issues. However, land use/cover classification remains a difficult task and it is especially challenging in heterogeneous tropical landscapes where nonetheless such maps are of great importance. The present study aims at establishing an efficient classification approach to accurately map all broad land use/cover classes in a large, heterogeneous tropical area, as a basis for further studies (e.g., land use/cover change, deforestation and forest degradation). Specifically, we first compare the performance of parametric (maximum likelihood), non-parametric (k-nearest neighbor and four different support vector machines - SVM), and hybrid (unsupervised-supervised) classifiers, using hard and soft (fuzzy) accuracy assessments. We then assess, using the maximum likelihood algorithm, what textural indices from the gray-level co-occurrence matrix lead to greater classification improvements at the spatial resolution of Landsat imagery (30 m), and rank them accordingly. Finally, we use the textural index that provides the most accurate classification results to evaluate whether its usefulness varies significantly with the classifier used. We classified imagery corresponding to dry and wet seasons and found that SVM classifiers outperformed all the rest. We also found that the use of some textural indices, but particularly homogeneity and entropy, can significantly improve classifications. We focused on the use of the homogeneity index, which has so far been neglected in land use/cover classification efforts, and found that this index along with reflectance bands significantly increased the overall accuracy of all the classifiers, but particularly of SVM. We observed that improvements in producer's and user's accuracies through the inclusion of homogeneity were different

  17. The VIMOS Public Extragalactic Redshift Survey (VIPERS). A support vector machine classification of galaxies, stars, and AGNs

    Małek, K.; Solarz, A.; Pollo, A.; Fritz, A.; Garilli, B.; Scodeggio, M.; Iovino, A.; Granett, B. R.; Abbas, U.; Adami, C.; Arnouts, S.; Bel, J.; Bolzonella, M.; Bottini, D.; Branchini, E.; Cappi, A.; Coupon, J.; Cucciati, O.; Davidzon, I.; De Lucia, G.; de la Torre, S.; Franzetti, P.; Fumana, M.; Guzzo, L.; Ilbert, O.; Krywult, J.; Le Brun, V.; Le Fevre, O.; Maccagni, D.; Marulli, F.; McCracken, H. J.; Paioro, L.; Polletta, M.; Schlagenhaufer, H.; Tasca, L. A. M.; Tojeiro, R.; Vergani, D.; Zanichelli, A.; Burden, A.; Di Porto, C.; Marchetti, A.; Marinoni, C.; Mellier, Y.; Moscardini, L.; Nichol, R. C.; Peacock, J. A.; Percival, W. J.; Phleps, S.; Wolk, M.; Zamorani, G.


    Aims: The aim of this work is to develop a comprehensive method for classifying sources in large sky surveys and to apply the techniques to the VIMOS Public Extragalactic Redshift Survey (VIPERS). Using the optical (u∗,g',r',i') and near-infrared (NIR) data (z', Ks), we develop a classifier, based on broad-band photometry, for identifying stars, active galactic nuclei (AGNs), and galaxies, thereby improving the purity of the VIPERS sample. Methods: Support vector machine (SVM) supervised learning algorithms allow the automatic classification of objects into two or more classes based on a multidimensional parameter space. In this work, we tailored the SVM to classifying stars, AGNs, and galaxies and applied this classification to the VIPERS data. We trained the SVM using spectroscopically confirmed sources from the VIPERS and VVDS surveys. Results: We tested two SVM classifiers and concluded that including NIR data can significantly improve the efficiency of the classifier. The self-check of the best optical + NIR classifier has shown 97% accuracy in the classification of galaxies, 97% for stars, and 95% for AGNs in the 5-dimensional colour space. In the test of VIPERS sources with 99% redshift confidence, the classifier gives an accuracy equal to 94% for galaxies, 93% for stars, and 82% for AGNs. The method was applied to sources with low-quality spectra to verify their classification, hence increasing the security of measurements for almost 4900 objects. Conclusions: We conclude that the SVM algorithm trained on a carefully selected sample of galaxies, AGNs, and stars outperforms simple colour-colour selection methods and can be regarded as a very efficient classification method particularly suitable for modern large surveys. Based on observations collected at the European Southern Observatory, Cerro Paranal, Chile, using the Very Large Telescope under programme 182.A-0886 and partly 070.A-9007. Also based on observations obtained with MegaPrime/MegaCam, a joint

  18. Prediction of endoplasmic reticulum resident proteins using fragmented amino acid composition and support vector machine

    Ravindra Kumar


    Full Text Available Background The endoplasmic reticulum plays an important role in many cellular processes, which includes protein synthesis, folding and post-translational processing of newly synthesized proteins. It is also the site for quality control of misfolded proteins and entry point of extracellular proteins to the secretory pathway. Hence at any given point of time, endoplasmic reticulum contains two different cohorts of proteins, (i proteins involved in endoplasmic reticulum-specific function, which reside in the lumen of the endoplasmic reticulum, called as endoplasmic reticulum resident proteins and (ii proteins which are in process of moving to the extracellular space. Thus, endoplasmic reticulum resident proteins must somehow be distinguished from newly synthesized secretory proteins, which pass through the endoplasmic reticulum on their way out of the cell. Approximately only 50% of the proteins used in this study as training data had endoplasmic reticulum retention signal, which shows that these signals are not essentially present in all endoplasmic reticulum resident proteins. This also strongly indicates the role of additional factors in retention of endoplasmic reticulum-specific proteins inside the endoplasmic reticulum. Methods This is a support vector machine based method, where we had used different forms of protein features as inputs for support vector machine to develop the prediction models. During training leave-one-out approach of cross-validation was used. Maximum performance was obtained with a combination of amino acid compositions of different part of proteins. Results In this study, we have reported a novel support vector machine based method for predicting endoplasmic reticulum resident proteins, named as ERPred. During training we achieved a maximum accuracy of 81.42% with leave-one-out approach of cross-validation. When evaluated on independent dataset, ERPred did prediction with sensitivity of 72.31% and specificity of 83

  19. Prediction of the beta-hairpins in proteins using support vector machine.

    Hu, Xiu Zhen; Li, Qian Zhong


    By using of the composite vector with increment of diversity and scoring function to express the information of sequence, a support vector machine (SVM) algorithm for predicting beta-hairpin motifs is proposed. The prediction is done on a dataset of 3,088 non homologous proteins containing 6,027 beta-hairpins. The overall accuracy of prediction and Matthew's correlation coefficient are 79.9% and 0.59 for the independent testing dataset. In addition, a higher accuracy of 83.3% and Matthew's correlation coefficient of 0.67 in the independent testing dataset are obtained on a dataset previously used by Kumar et al. (Nuclic Acid Res 33:154-159). The performance of the method is also evaluated by predicting the beta-hairpins of in the CASP6 proteins, and the better results are obtained. Moreover, this method is used to predict four kinds of supersecondary structures. The overall accuracy of prediction is 64.5% for the independent testing dataset.

  20. Prediction of Solar Flare Size and Time-to-Flare Using Support Vector Machine Regression

    Boucheron, Laura E; McAteer, R T James


    We study the prediction of solar flare size and time-to-flare using 38 features describing magnetic complexity of the photospheric magnetic field. This work uses support vector regression to formulate a mapping from the 38-dimensional feature space to a continuous-valued label vector representing flare size or time-to-flare. When we consider flaring regions only, we find an average error in estimating flare size of approximately half a \\emph{geostationary operational environmental satellite} (\\emph{GOES}) class. When we additionally consider non-flaring regions, we find an increased average error of approximately 3/4 a \\emph{GOES} class. We also consider thresholding the regressed flare size for the experiment containing both flaring and non-flaring regions and find a true positive rate of 0.69 and a true negative rate of 0.86 for flare prediction. The results for both of these size regression experiments are consistent across a wide range of predictive time windows, indicating that the magnetic complexity fe...

  1. Fully Parallel Self-Learning Analog Support Vector Machine Employing Compact Gaussian Generation Circuits

    Zhang, Renyuan; Shibata, Tadashi


    An analog support vector machine (SVM) processor employing a fully parallel self-learning circuitry was developed for the classification of highly dimensional patterns. To implement a highly dimensional Gaussian function, which is the most powerful kernel function in classification algorithms but computationally expensive, a compact analog Gaussian generation circuit was developed. By employing this proposed Gaussian generation circuit, a fully parallel self-learning processor based on an SVM algorithm was built for 64 dimension pattern classification. The chip real estate occupied by the processor is very small. The object images from two classes were converted into 64 dimension vectors using the algorithm developed in a previous work and fed into the processor. The learning process autonomously proceeded without any clock-based control and self-converged within a single clock cycle of the system (at 10 MHz). Some test object images were used to verify the learning performance. According to the circuit simulation results, it was shown that all the test images were classified into correct classes in real time. A proof-of-concept chip was designed in a 0.18 µm complementary metal-oxide-semiconductor (CMOS) technology, and the performance of the proposed SVM processor was confirmed from the measurement results of the fabricated chips.

  2. Supervision, support and mentoring interventions for health practitioners in rural and remote contexts: an integrative review and thematic synthesis of the literature to identify mechanisms for successful outcomes


    Objective To identify mechanisms for the successful implementation of support strategies for health-care practitioners in rural and remote contexts. Design This is an integrative review and thematic synthesis of the empirical literature that examines support interventions for health-care practitioners in rural and remote contexts. Results This review includes 43 papers that evaluated support strategies for the rural and remote health workforce. Interventions were predominantly training and education programmes with limited evaluations of supervision and mentoring interventions. The mechanisms associated with successful outcomes included: access to appropriate and adequate training, skills and knowledge for the support intervention; accessible and adequate resources; active involvement of stakeholders in programme design, implementation and evaluation; a needs analysis prior to the intervention; external support, organisation, facilitation and/or coordination of the programme; marketing of the programme; organisational commitment; appropriate mode of delivery; leadership; and regular feedback and evaluation of the programme. Conclusion Through a synthesis of the literature, this research has identified a number of mechanisms that are associated with successful support interventions for health-care practitioners in rural and remote contexts. This research utilised a methodology developed for studying complex interventions in response to the perceived limitations of traditional systematic reviews. This synthesis of the evidence will provide decision-makers at all levels with a collection of mechanisms that can assist the development and implementation of support strategies for staff in rural and remote contexts. PMID:24521004

  3. Support vector machine-based feature extractor for L/H transitions in JETa)

    González, S.; Vega, J.; Murari, A.; Pereira, A.; Ramírez, J. M.; Dormido-Canto, S.; Jet-Efda Contributors


    Support vector machines (SVM) are machine learning tools originally developed in the field of artificial intelligence to perform both classification and regression. In this paper, we show how SVM can be used to determine the most relevant quantities to characterize the confinement transition from low to high confinement regimes in tokamak plasmas. A set of 27 signals is used as starting point. The signals are discarded one by one until an optimal number of relevant waveforms is reached, which is the best tradeoff between keeping a limited number of quantities and not loosing essential information. The method has been applied to a database of 749 JET discharges and an additional database of 150 JET discharges has been used to test the results obtained.

  4. Acoustic Biometric System Based on Preprocessing Techniques and Linear Support Vector Machines.

    del Val, Lara; Izquierdo-Fuente, Alberto; Villacorta, Juan J; Raboso, Mariano


    Drawing on the results of an acoustic biometric system based on a MSE classifier, a new biometric system has been implemented. This new system preprocesses acoustic images, extracts several parameters and finally classifies them, based on Support Vector Machine (SVM). The preprocessing techniques used are spatial filtering, segmentation-based on a Gaussian Mixture Model (GMM) to separate the person from the background, masking-to reduce the dimensions of images-and binarization-to reduce the size of each image. An analysis of classification error and a study of the sensitivity of the error versus the computational burden of each implemented algorithm are presented. This allows the selection of the most relevant algorithms, according to the benefits required by the system. A significant improvement of the biometric system has been achieved by reducing the classification error, the computational burden and the storage requirements.

  5. Nonlinear decoupling controller design based on least squares support vector regression

    WEN Xiang-jun; ZHANG Yu-nong; YAN Wei-wu; XU Xiao-ming


    Support Vector Machines (SVMs) have been widely used in pattern recognition and have also drawn considerable interest in control areas. Based on a method of least squares SVM (LS-SVM) for multivariate function estimation, a generalized inverse system is developed for the linearization and decoupling control ora general nonlinear continuous system. The approach of inverse modelling via LS-SVM and parameters optimization using the Bayesian evidence framework is discussed in detail. In this paper, complex high-order nonlinear system is decoupled into a number of pseudo-linear Single Input Single Output (SISO) subsystems with linear dynamic components. The poles of pseudo-linear subsystems can be configured to desired positions. The proposed method provides an effective alternative to the controller design of plants whose accurate mathematical model is unknown or state variables are difficult or impossible to measure. Simulation results showed the efficacy of the method.

  6. Support-vector-based emergent self-organising approach for emotional understanding

    Nguwi, Yok-Yen; Cho, Siu-Yeung


    This study discusses the computational analysis of general emotion understanding from questionnaires methodology. The questionnaires method approaches the subject by investigating the real experience that accompanied the emotions, whereas the other laboratory approaches are generally associated with exaggerated elements. We adopted a connectionist model called support-vector-based emergent self-organising map (SVESOM) to analyse the emotion profiling from the questionnaires method. The SVESOM first identifies the important variables by giving discriminative features with high ranking. The classifier then performs the classification based on the selected features. Experimental results show that the top rank features are in line with the work of Scherer and Wallbott [(1994), 'Evidence for Universality and Cultural Variation of Differential Emotion Response Patterning', Journal of Personality and Social Psychology, 66, 310-328], which approached the emotions physiologically. While the performance measures show that using the full features for classifications can degrade the performance, the selected features provide superior results in terms of accuracy and generalisation.

  7. Splicing-site recognition of rice (Oryza sativa L.)DNA sequences by support vector machines

    彭司华; 樊龙江; 彭小宁; 庄树林; 杜维; 陈良标


    Motivation: It was found that high accuracy splicing-site recognition of rice (Oryza sativa L.) DNA sequence is especially difficult. We described a new method for the splicing-site recognition of rice DNA sequences. Method: Based on the intron in eukaryotic organisms conforming to the principle of GT-AG, we used support vector machines (SVM) to predict the splicing sites. By machine learning, we built a model and used it to test the effect of the test data set of true and pseudo splicing sites. Results: The prediction accuracy we obtained was 87.53% at the true 5' end splicing site and 87.37% at the true 3' end splicing sites. The results suggested that the SVM approach could achieve higher accuracy than the previous approaches.

  8. Robust GRAPPA reconstruction using sparse multi-kernel learning with least squares support vector regression.

    Xu, Lin; Feng, Yanqiu; Liu, Xiaoyun; Kang, Lili; Chen, Wufan


    Accuracy of interpolation coefficients fitting to the auto-calibrating signal data is crucial for k-space-based parallel reconstruction. Both conventional generalized autocalibrating partially parallel acquisitions (GRAPPA) reconstruction that utilizes linear interpolation function and nonlinear GRAPPA (NLGRAPPA) reconstruction with polynomial kernel function are sensitive to interpolation window and often cannot consistently produce good results for overall acceleration factors. In this study, sparse multi-kernel learning is conducted within the framework of least squares support vector regression to fit interpolation coefficients as well as to reconstruct images robustly under different subsampling patterns and coil datasets. The kernel combination weights and interpolation coefficients are adaptively determined by efficient semi-infinite linear programming techniques. Experimental results on phantom and in vivo data indicate that the proposed method can automatically achieve an optimized compromise between noise suppression and residual artifacts for various sampling schemes. Compared with NLGRAPPA, our method is significantly less sensitive to the interpolation window and kernel parameters.

  9. Analysis of dengue infection based on Raman spectroscopy and support vector machine (SVM).

    Khan, Saranjam; Ullah, Rahat; Khan, Asifullah; Wahab, Noorul; Bilal, Muhammad; Ahmed, Mushtaq


    The current study presents the use of Raman spectroscopy combined with support vector machine (SVM) for the classification of dengue suspected human blood sera. Raman spectra for 84 clinically dengue suspected patients acquired from Holy Family Hospital, Rawalpindi, Pakistan, have been used in this study.The spectral differences between dengue positive and normal sera have been exploited by using effective machine learning techniques. In this regard, SVM models built on the basis of three different kernel functions including Gaussian radial basis function (RBF), polynomial function and linear functionhave been employed to classify the human blood sera based on features obtained from Raman Spectra.The classification model have been evaluated with the 10-fold cross validation method. In the present study, the best performance has been achieved for the polynomial kernel of order 1. A diagnostic accuracy of about 85% with the precision of 90%, sensitivity of 73% and specificity of 93% has been achieved under these conditions.

  10. Efficient Discriminate Component Analysis using Support Vector Machine Classifier on Invariant Pose and Illumination Face Images

    R. Rajalakshmi


    Full Text Available Face recognition is the process of categorizing a person in an image by evaluating with a known face image library. The pose and illumination variations are two main practical confronts for an automatic face recognition system. This study proposes a novel face recognition algorithm known as Efficient Discriminant Component Analysis (EDCA for face recognition under varying poses and illumination conditions. This EDCA algorithm overcomes the high dimensionality problem in the feature space by extracting features from the low dimensional frequency band of the image. It combines the features of both LDA and PCA algorithms and these features are used in the training set and is classified using Support Vector Machine classifier. The experiments were performed on the CMU-PIE datasets. The experimental results show that the proposed algorithm produces a higher recognition rate than the existing LDA and PCA based face recognition techniques.

  11. Acoustic Biometric System Based on Preprocessing Techniques and Linear Support Vector Machines

    Lara del Val


    Full Text Available Drawing on the results of an acoustic biometric system based on a MSE classifier, a new biometric system has been implemented. This new system preprocesses acoustic images, extracts several parameters and finally classifies them, based on Support Vector Machine (SVM. The preprocessing techniques used are spatial filtering, segmentation—based on a Gaussian Mixture Model (GMM to separate the person from the background, masking—to reduce the dimensions of images—and binarization—to reduce the size of each image. An analysis of classification error and a study of the sensitivity of the error versus the computational burden of each implemented algorithm are presented. This allows the selection of the most relevant algorithms, according to the benefits required by the system. A significant improvement of the biometric system has been achieved by reducing the classification error, the computational burden and the storage requirements.

  12. A font and size-independent OCR system for printed Kannada documents using support vector machines

    T V Ashwin; P S Sastry


    This paper describes an OCR system for printed text documents in Kannada, a South Indian language. The input to the system would be the scanned image of a page of text and the output is a machine editable file compatible with most typesetting software. The system first extracts words from the document image and then segments the words into sub-character level pieces. The segmentation algorithm is motivated by the structure of the script. We propose a novel set of features for the recognition problem which are computationally simple to extract. The final recognition is achieved by employing a number of 2-class classifiers based on the Support Vector Machine (SVM) method. The recognition is independent of the font and size of the printed text and the system is seen to deliver reasonable performance.

  13. Bio-signal analysis system design with support vector machines based on cloud computing service architecture.

    Shen, Chia-Ping; Chen, Wei-Hsin; Chen, Jia-Ming; Hsu, Kai-Ping; Lin, Jeng-Wei; Chiu, Ming-Jang; Chen, Chi-Huang; Lai, Feipei


    Today, many bio-signals such as Electroencephalography (EEG) are recorded in digital format. It is an emerging research area of analyzing these digital bio-signals to extract useful health information in biomedical engineering. In this paper, a bio-signal analyzing cloud computing architecture, called BACCA, is proposed. The system has been designed with the purpose of seamless integration into the National Taiwan University Health Information System. Based on the concept of. NET Service Oriented Architecture, the system integrates heterogeneous platforms, protocols, as well as applications. In this system, we add modern analytic functions such as approximated entropy and adaptive support vector machine (SVM). It is shown that the overall accuracy of EEG bio-signal analysis has increased to nearly 98% for different data sets, including open-source and clinical data sets.

  14. A reliability assessment method based on support vector machines for CNC equipment


    With the applications of high technology,a catastrophic failure of CNC equipment rarely occurs at normal operation conditions.So it is difficult for traditional reliability assessment methods based on time-to-failure distributions to deduce the reliability level.This paper presents a novel reliability assessment methodology to estimate the reliability level of equipment with machining performance degradation data when only a few samples are available.The least squares support vector machines(LS-SVM) are introduced to analyze the performance degradation process on the equipment.A two-stage parameter optimization and searching method is proposed to improve the LS-SVM regression performance and a reliability assessment model based on the LS-SVM is built.A machining performance degradation experiment has been carried out on an OTM650 machine tool to validate the effectiveness of the proposed reliability assessment methodology.

  15. Sleep–Wake Transition in Narcolepsy and Healthy Controls Using a Support Vector Machine

    Jensen, Julie B; Sorensen, Helge B D; Kempfner, Jacob


    transformation and were given as input to a support vector machine classifier. The classification algorithm was assessed by hold-out validation and 10-fold cross-validation. The data used to validate the classifier were derived from polysomnographic recordings of 47 narcoleptic patients (33 with cataplexy and 14...... without cataplexy) and 15 healthy controls. Compared with manual scorings, an accuracy of 90% was achieved in the hold-out validation, and the area under the receiver operating characteristic curve was 95%. Sensitivity and specificity were 90% and 88%, respectively. The 10-fold cross-validation procedure...... yielded an accuracy of 88%, an area under the receiver operating characteristic curve of 92%, a sensitivity of 87%, and a specificity of 87%. Narcolepsy with cataplexy patients experienced significantly more sleep-wake transitions during night than did narcolepsy without cataplexy patients (P = 0...

  16. Hybrid independent component analysis and twin support vector machine learning scheme for subtle gesture recognition.

    Naik, Ganesh R; Kumar, Dinesh K; Jayadeva


    Myoelectric signal classification is one of the most difficult pattern recognition problems because large variations in surface electromyogram features usually exist. In the literature, attempts have been made to apply various pattern recognition methods to classify surface electromyography into components corresponding to the activities of different muscles, but this has not been very successful, as some muscles are bigger and more active than others. This results in dataset discrepancy during classification. Multicategory classification problems are usually solved by solving many, one-versus-rest binary classification tasks. These subtasks unsurprisingly involve unbalanced datasets. Consequently, we need a learning methodology that can take into account unbalanced datasets in addition to large variations in the distributions of patterns corresponding to different classes. Here, we attempt to address the above issues using hybrid features extracted from independent component analysis and twin support vector machine techniques.

  17. Ice breakup forecast in the reach of the Yellow River: the support vector machines approach

    H. Zhou


    Full Text Available Accurate lead-time forecast of ice breakup is one of the key aspects for ice flood prevention and reducing losses. In this paper, a new data-driven model based on the Statistical Learning Theory was employed for ice breakup prediction. The model, known as Support Vector Machine (SVM, follows the principle that aims at minimizing the structural risk rather than the empirical risk. In order to estimate the appropriate parameters of the SVM, Multiobjective Shuffled Complex Evolution Metropolis (MOSCEM-UA algorithm is performed through exponential transformation. A case study was conducted in the reach of the Yellow River. Results from the proposed model showed a promising performance compared with that from artificial neural network, so the model can be considered as an alternative and practical tool for ice breakup forecast.

  18. A Method for Extracting Important Segments from Documents Using Support Vector Machines

    Suzuki, Daisuke; Utsumi, Akira

    In this paper we propose an extraction-based method for automatic summarization. The proposed method consists of two processes: important segment extraction and sentence compaction. The process of important segment extraction classifies each segment in a document as important or not by Support Vector Machines (SVMs). The process of sentence compaction then determines grammatically appropriate portions of a sentence for a summary according to its dependency structure and the classification result by SVMs. To test the performance of our method, we conducted an evaluation experiment using the Text Summarization Challenge (TSC-1) corpus of human-prepared summaries. The result was that our method achieved better performance than a segment-extraction-only method and the Lead method, especially for sentences only a part of which was included in human summaries. Further analysis of the experimental results suggests that a hybrid method that integrates sentence extraction with segment extraction may generate better summaries.

  19. Rapid authentication of adulteration of olive oil by near-infrared spectroscopy using support vector machines

    Wu, Jingzhu; Dong, Jingjing; Dong, Wenfei; Chen, Yan; Liu, Cuiling


    A classification method of support vector machines with linear kernel was employed to authenticate genuine olive oil based on near-infrared spectroscopy. There were three types of adulteration of olive oil experimented in the study. The adulterated oil was respectively soybean oil, rapeseed oil and the mixture of soybean and rapeseed oil. The average recognition rate of second experiment was more than 90% and that of the third experiment was reach to 100%. The results showed the method had good performance in classifying genuine olive oil and the adulteration with small variation range of adulterated concentration and it was a promising and rapid technique for the detection of oil adulteration and fraud in the food industry.

  20. Automatic SLEEP staging: From young aduslts to elderly patients using multi-class support vector machine

    Kempfner, Jacob; Jennum, Poul; Sorensen, Helge B. D.


    , and not the affected sleep events. The age-related influences are then reduced by robust subject-specific scaling. The classification of the three sleep stages are achieved by a multi-class support vector machine using the one-versus-rest scheme. It was possible to obtain a high classification accuracy of 0......Aging is a process that is inevitable, and makes our body vulnerable to age-related diseases. Age is the most consistent factor affecting the sleep structure. Therefore, new automatic sleep staging methods, to be used in both of young and elderly patients, are needed. This study proposes...... an automatic sleep stage detector, which can separate wakefulness, rapid-eye-movement (REM) sleep and non-REM (NREM) sleep using only EEG and EOG. Most sleep events, which define the sleep stages, are reduced with age. This is addressed by focusing on the amplitude of the clinical EEG bands...

  1. Deep learning of support vector machines with class probability output networks.

    Kim, Sangwook; Yu, Zhibin; Kil, Rhee Man; Lee, Minho


    Deep learning methods endeavor to learn features automatically at multiple levels and allow systems to learn complex functions mapping from the input space to the output space for the given data. The ability to learn powerful features automatically is increasingly important as the volume of data and range of applications of machine learning methods continues to grow. This paper proposes a new deep architecture that uses support vector machines (SVMs) with class probability output networks (CPONs) to provide better generalization power for pattern classification problems. As a result, deep features are extracted without additional feature engineering steps, using multiple layers of the SVM classifiers with CPONs. The proposed structure closely approaches the ideal Bayes classifier as the number of layers increases. Using a simulation of classification problems, the effectiveness of the proposed method is demonstrated.


    Mihaela GHEORGHE


    Full Text Available Support vector machine represents an important tool for artificial neural networks techniques including classification and prediction. It offers a solution for a wide range of different issues in which cases the traditional optimization algorithms and methods cannot be applied directly due to different constraints, including memory restrictions, hidden relationships between variables, very high volume of computations that needs to be handled. One of these issues relates to medical diagnosis, a subset of the medical field. In this paper, the SVM learning algorithm is tested on a diabetes dataset and the results obtained for training with different kernel functions are presented and analyzed in order to determine a good approach from a telemedicine perspective.

  3. Support vector machines for prediction of protein signal sequences and their cleavage sites.

    Cai, Yu-Dong; Lin, Shuo-liang; Chou, Kuo-Chen


    Given a nascent protein sequence, how can one predict its signal peptide or "Zipcode" sequence? This is an important problem for scientists to use signal peptides as a vehicle to find new drugs or to reprogram cells for gene therapy (see, e.g. K.C. Chou, Current Protein and Peptide Science 2002;3:615-22). In this paper, support vector machines (SVMs), a new machine learning method, is applied to approach this problem. The overall rate of correct prediction for 1939 secretary proteins and 1440 nonsecretary proteins was over 91%. It has not escaped our attention that the new method may also serve as a useful tool for further investigating many unclear details regarding the molecular mechanism of the ZIP code protein-sorting system in cells. Copyright 2002 Elsevier Science Inc.

  4. Reducing U2R and R2L category false negative rates with support vector machines

    Maček Nemanja


    Full Text Available The KDD Cup '99 is commonly used dataset for training and testing IDS machine learning algorithms. Some of the major downsides of the dataset are the distribution and the proportions of U2R and R2L instances, which represent the most dangerous attack types, as well as the existence of R2L attack instances identical to normal traffic. This enforces minor category detection complexity and causes problems while building a machine learning model capable of detecting these attacks with sufficiently low false negative rate. This paper presents a new support vector machine based intrusion detection system that classifies unknown data instances according both to the feature values and weight factors that represent importance of features towards the classification. Increased detection rate and significantly decreased false negative rate for U2R and R2L categories, that have a very few instances in the training set, have been empirically proven.

  5. Supplier Short Term Load Forecasting Using Support Vector Regression and Exogenous Input

    Matijaš, Marin; Vukićcević, Milan; Krajcar, Slavko


    In power systems, task of load forecasting is important for keeping equilibrium between production and consumption. With liberalization of electricity markets, task of load forecasting changed because each market participant has to forecast their own load. Consumption of end-consumers is stochastic in nature. Due to competition, suppliers are not in a position to transfer their costs to end-consumers; therefore it is essential to keep forecasting error as low as possible. Numerous papers are investigating load forecasting from the perspective of the grid or production planning. We research forecasting models from the perspective of a supplier. In this paper, we investigate different combinations of exogenous input on the simulated supplier loads and show that using points of delivery as a feature for Support Vector Regression leads to lower forecasting error, while adding customer number in different datasets does the opposite.

  6. Process Optimization of Ultrasonic Extraction of Puerarin Based on Support Vector Machine

    Juan Chen; Xiaoyi Huang; Yanlei Qi; Xin Qi; Qing Guo


    In ultrasonic extraction technology, optimization of technical parameters often considers extraction medium only, without including ultrasonic parameters. This paper focuses on controlling the ultrasonic extraction process of puerarin, investigating the influence of ultrasonic parameters on extraction rate, and empirical y analyzing the main components of Pueraria, i.e., isoflavone compounds. A method is presented combining orthogonal experi-mental design with a support vector machine and a predictive model is established for optimization of technical parameters. From the analysis with the predictive model, appropriate process parameters are achieved for higher extraction rate. With these parameters in the ultrasonic extraction of puerarin, the experimental result is satisfactory. This method is of significance to the study of extracting root-stock plant medicines.

  7. Comparison on neural networks and support vector machines in suppliers' selection

    Hu Guosheng; Zhang Guohong


    Suppliers' selection in supply chain management (SCM) has attracted considerable research interests in recent years. Recent literatures show that neural networks achieve better performance than traditional statistical methods. However, neural networks have inherent drawbacks, such as local optimization solution, lack generalization,and uncontrolled convergence. A relatively new machine learning technique, support vector machine (SVM), which overcomes the drawbacks of neural networks, is introduced to provide a model with better explanatory power to select ideal supplier partners. Meanwhile, in practice, the suppliers' samples are very insufficient. SVMs are adaptive to deal with small samples' training and testing. The prediction accuracies for BPNN and SVM methods are compared to choose the appreciating suppliers. The actual examples illustrate that SVM methods are superior to BPNN.

  8. Predicting and Classifying User Identification Code System Based on Support Vector Machines


    In digital fingerprinting, preventing piracy of images by colluders is an important and tedious issue. Each image will be embedded with a unique User IDentification (U ID) code that is the fingerprint for tracking the authorized user. The proposed hiding scheme makes use of a random number generator to scramble two copies of a UID,which will then be hidden in the randomly selected medium frequency coefficients of the host image. The linear support vector machine (SVM) will be used to train classifications by calculating the normalized correlation (NC) for the 2-class UID codes. The trained classifications will be the models used for identifying unreadable UID codes.Experimental results showed that the success of predicting the unreadable UID codes can be increased by applying SVM. The proposed scheme can be used to provide protections to intellectual property rights of digital images and to keep track of users to prevent collaborative piracies.

  9. Improving linearity of position-sensitive detector using support vector machines

    Meiying Ye


    An intelligent method for improving position linearity of position-sensitive detector (PSD), based on support vector machines (SVMs), is developed. The SVM is established based on the structural risk minimization principle rather than minimizing the empirical error commonly implemented in neural networks.SVM can achieve higher generalization performance. Training SVM is equivalent to solving a linearly constrained quadratic programming problem, thus the solution of SVM is always unique and globally optimal.The improving position linearity procedure has been illustrated using a two-dimensional (2D) PSD. It is pointed out that the position linearity of the measuring system with a proper SVM correction is improved by two orders of magnitude in the measurement range.


    LIU Guanjun; LIU Xinmin; QIU Jing; HU Niaoqing


    Aiming at solving the problems of machine-learning in fault diagnosis, a diagnosis approach is proposed based on hidden Markov model (HMM) and support vector machine (SVM). HMM usually describes intra-class measure well and is good at dealing with continuous dynamic signals. SVM expresses inter-class difference effectively and has perfect classify ability. This approach is built on the merit of HMM and SVM. Then, the experiment is made in the transmission system of a helicopter. With the features extracted from vibration signals in gearbox, this HMM-SVM based diagnostic approach is trained and used to monitor and diagnose the gearbox's faults. The result shows that this method is better than HMM-based and SVM-based diagnosing methods in higher diagnostic accuracy with small training samples.

  11. Support-Vector-Machine-Based False Alarm Filter of Mechatronic Built-in Test


    Diagnosing intermittent fault is an important approach to reduce built-in test (BIT) false alarms. Aiming at solving the shortcoming of the present diagnostic method of intermittent fault, and according to the merit of support vector machines ( SVM) which can be trained with a small-sample, an SVM-based diagnostic model of 3 states that include OK state, intermittent state and faulty state is presented. With the features based on the reflection coefficients of an alarm rate(AR) model extracted from small vibration samples, these models are trained to diagnose intermittent faults. The experimental results show that this method can diagnose multiple intermittent faults accurately with small training samples and BIT false alarms are reduced.

  12. Water Quantity Prediction Using Least Squares Support Vector Machines (LS-SVM Method

    Nian Zhang


    Full Text Available The impact of reliable estimation of stream flows at highly urbanized areas and the associated receiving waters is very important for water resources analysis and design. We used the least squares support vector machine (LS-SVM based algorithm to forecast the future streamflow discharge. A Gaussian Radial Basis Function (RBF kernel framework was built on the data set to optimize the tuning parameters and to obtain the moderated output. The training process of LS-SVM was designed to select both kernel parameters and regularization constants. The USGS real-time water data were used as time series input. 50% of the data were used for training, and 50% were used for testing. The experimental results showed that the LS-SVM algorithm is a reliable and efficient method for streamflow prediction, which has an important impact to the water resource management field.

  13. Particulate matter characterization by gray level co-occurrence matrix based support vector machines.

    Manivannan, K; Aggarwal, P; Devabhaktuni, V; Kumar, A; Nims, D; Bhattacharya, P


    An efficient and highly reliable automatic selection of optimal segmentation algorithm for characterizing particulate matter is presented in this paper. Support vector machines (SVMs) are used as a new self-regulating classifier trained by gray level co-occurrence matrix (GLCM) of the image. This matrix is calculated at various angles and the texture features are evaluated for classifying the images. Results show that the performance of GLCM-based SVMs is drastically improved over the previous histogram-based SVMs. Our proposed GLCM-based approach of training SVM predicts a robust and more accurate segmentation algorithm than the standard histogram technique, as additional information based on the spatial relationship between pixels is incorporated for image classification. Further, the GLCM-based SVM classifiers were more accurate and required less training data when compared to the artificial neural network (ANN) classifiers.

  14. Application of neural networks and support vector machine for significant wave height prediction

    Jadran Berbić


    Full Text Available For the purposes of planning and operation of maritime activities, information about wave height dynamics is of great importance. In the paper, real-time prediction of significant wave heights for the following 0.5–5.5 h is provided, using information from 3 or more time points. In the first stage, predictions are made by varying the quantity of significant wave heights from previous time points and various ways of using data are discussed. Afterwards, in the best model, according to the criteria of practicality and accuracy, the influence of wind is taken into account. Predictions are made using two machine learning methods – artificial neural networks (ANN and support vector machine (SVM. The models were built using the built-in functions of software Weka, developed by Waikato University, New Zealand.

  15. Application of the Support Vector Machine to Predict Subclinical Mastitis in Dairy Cattle

    Nazira Mammadova


    Full Text Available This study presented a potentially useful alternative approach to ascertain the presence of subclinical and clinical mastitis in dairy cows using support vector machine (SVM techniques. The proposed method detected mastitis in a cross-sectional representative sample of Holstein dairy cattle milked using an automatic milking system. The study used such suspected indicators of mastitis as lactation rank, milk yield, electrical conductivity, average milking duration, and control season as input data. The output variable was somatic cell counts obtained from milk samples collected monthly throughout the 15 months of the control period. Cattle were judged to be healthy or infected based on those somatic cell counts. This study undertook a detailed scrutiny of the SVM methodology, constructing and examining a model which showed 89% sensitivity, 92% specificity, and 50% error in mastitis detection.

  16. Detection of ventricular suction in an implantable rotary blood pump using support vector machines.

    Wang, Yu; Faragallah, George; Divo, Eduardo; Simaan, Marwan A


    A new suction detection algorithm for rotary Left Ventricular Assist Devices (LVAD) is presented. The algorithm is based on a Lagrangian Support Vector Machine (LSVM) model. Six suction indices are derived from the LVAD pump flow signal and form the inputs to the LSVM classifier. The LSVM classifier is trained and tested to classify pump flow patterns into three states: No Suction, Approaching Suction, and Suction. The proposed algorithm has been tested using existing in vivo data. When compared to three existing methods, the proposed algorithm produced superior performance in terms of classification accuracy, stability, and learning speed. The ability of the algorithm to detect suction provides a reliable platform in the development of a pump speed controller that has the capability of avoiding suction.

  17. Botnet Detection Using Support Vector Machines with Artificial Fish Swarm Algorithm

    Kuan-Cheng Lin


    Full Text Available Because of the advances in Internet technology, the applications of the Internet of Things have become a crucial topic. The number of mobile devices used globally substantially increases daily; therefore, information security concerns are increasingly vital. The botnet virus is a major threat to both personal computers and mobile devices; therefore, a method of botnet feature characterization is proposed in this study. The proposed method is a classified model in which an artificial fish swarm algorithm and a support vector machine are combined. A LAN environment with several computers which has infected by the botnet virus was simulated for testing this model; the packet data of network flow was also collected. The proposed method was used to identify the critical features that determine the pattern of botnet. The experimental results indicated that the method can be used for identifying the essential botnet features and that the performance of the proposed method was superior to that of genetic algorithms.

  18. Cervical cancer survival prediction using hybrid of SMOTE, CART and smooth support vector machine

    Purnami, S. W.; Khasanah, P. M.; Sumartini, S. H.; Chosuvivatwong, V.; Sriplung, H.


    According to the WHO, every two minutes there is one patient who died from cervical cancer. The high mortality rate is due to the lack of awareness of women for early detection. There are several factors that supposedly influence the survival of cervical cancer patients, including age, anemia status, stage, type of treatment, complications and secondary disease. This study wants to classify/predict cervical cancer survival based on those factors. Various classifications methods: classification and regression tree (CART), smooth support vector machine (SSVM), three order spline SSVM (TSSVM) were used. Since the data of cervical cancer are imbalanced, synthetic minority oversampling technique (SMOTE) is used for handling imbalanced dataset. Performances of these methods are evaluated using accuracy, sensitivity and specificity. Results of this study show that balancing data using SMOTE as preprocessing can improve performance of classification. The SMOTE-SSVM method provided better result than SMOTE-TSSVM and SMOTE-CART.

  19. The Research and Application of Visual Saliency and Adaptive Support Vector Machine in Target Tracking Field

    Yuantao Chen


    Full Text Available The efficient target tracking algorithm researches have become current research focus of intelligent robots. The main problems of target tracking process in mobile robot face environmental uncertainty. They are very difficult to estimate the target states, illumination change, target shape changes, complex backgrounds, and other factors and all affect the occlusion in tracking robustness. To further improve the target tracking’s accuracy and reliability, we present a novel target tracking algorithm to use visual saliency and adaptive support vector machine (ASVM. Furthermore, the paper’s algorithm has been based on the mixture saliency of image features. These features include color, brightness, and sport feature. The execution process used visual saliency features and those common characteristics have been expressed as the target’s saliency. Numerous experiments demonstrate the effectiveness and timeliness of the proposed target tracking algorithm in video sequences where the target objects undergo large changes in pose, scale, and illumination.

  20. Acoustic Biometric System Based on Preprocessing Techniques and Linear Support Vector Machines

    del Val, Lara; Izquierdo-Fuente, Alberto; Villacorta, Juan J.; Raboso, Mariano


    Drawing on the results of an acoustic biometric system based on a MSE classifier, a new biometric system has been implemented. This new system preprocesses acoustic images, extracts several parameters and finally classifies them, based on Support Vector Machine (SVM). The preprocessing techniques used are spatial filtering, segmentation—based on a Gaussian Mixture Model (GMM) to separate the person from the background, masking—to reduce the dimensions of images—and binarization—to reduce the size of each image. An analysis of classification error and a study of the sensitivity of the error versus the computational burden of each implemented algorithm are presented. This allows the selection of the most relevant algorithms, according to the benefits required by the system. A significant improvement of the biometric system has been achieved by reducing the classification error, the computational burden and the storage requirements. PMID:26091392