Loading...
Search for: manifold-assumption
0.01 seconds

    Online Semi-supervised Learning and its Application in Image Classification

    , M.Sc. Thesis Sharif University of Technology Shaban, Amir Reza (Author) ; Rabiee, Hamid Reza (Supervisor)
    Abstract
    Image classification, i.e. the task of assigning an image to a class chosen from a predefined set of classes, has addressed in this thesis. At first the classifier is divided into two major sub partitions, feature extraction and classifier. Then we show that by using local feature extraction techniques such as BOW the classification accuracy will improve. In addition, using unlabeled data is argued as the fact to deal with high nonlinear structure of features. Recently, many SSL methods have been developed based on the manifold assumption in a batch mode. However, when data arrive sequentially and in large quantities, both computation and storage limitations become a bottleneck. So in large... 

    Improving Graph Construction for Semi-supervised Learning in Computer Vision Applications

    , M.Sc. Thesis Sharif University of Technology Mahdieh, Mostafa (Author) ; Rabiee, Hamid Reza (Supervisor)
    Abstract
    Semi-supervised Learning (SSL) is an extremely useful approach in many applications where unlabeled data can be easily obtained. Graph based methods are among the most studied branches in SSL. Since neighborhood graph is a key component in these methods, we focus on methods of graph construction in this project. Graph construction methods based on Euclidean distance have the common problem of creating shortcut edges. Shortcut edges refer to the edges which connect two nearby points that are far apart on the manifold. Specifically, we show both in theory and practice that using geodesic distance for selecting and weighting edges results in more appropriate neighborhood graphs. We propose an... 

    Adaptation for Evolving Domains

    , M.Sc. Thesis Sharif University of Technology Bitarafan, Adeleh (Author) ; Soleymani Baghshah, Mahdieh (Supervisor)
    Abstract
    Until now many domain adaptation methods have been proposed. A major limitation of almost all of these methods is their assumption that all test data belong to a single stationary target distribution and a large amount of unlabeled data is available for modeling this target distribution. In fact, in many real world applications, such as classifying scene image with gradually changing lighting and spam email identification, data arrives sequentially and the data distribution is continuously evolving. In this thesis, we tackle the problem of adaptation to a continuously evolving target domain that has been recently introduced and propose the Evolving Domain Adaptation (EDA) method to classify... 

    Manifold coarse graining for online semi-supervised learning

    , Article Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5 September 2011 through 9 September 2011 ; Volume 6911 LNAI, Issue PART 1 , September , 2011 , Pages 391-406 ; 03029743 (ISSN) ; 9783642237799 (ISBN) Farajtabar, M ; Shaban, A ; Rabiee, H. R ; Rohban, M. H ; Sharif University of Technology
    2011
    Abstract
    When the number of labeled data is not sufficient, Semi-Supervised Learning (SSL) methods utilize unlabeled data to enhance classification. Recently, many SSL methods have been developed based on the manifold assumption in a batch mode. However, when data arrive sequentially and in large quantities, both computation and storage limitations become a bottleneck. In this paper, we present a new semi-supervised coarse graining (CG) algorithm to reduce the required number of data points for preserving the manifold structure. First, an equivalent formulation of Label Propagation (LP) is derived. Then a novel spectral view of the Harmonic Solution (HS) is proposed. Finally an algorithm to reduce... 

    Semi-Supervised Kernel Learning for Pattern Classification

    , Ph.D. Dissertation Sharif University of Technology Rohban, Mohammad Hossein (Author) ; Rabiee, Hamid Reza (Supervisor)
    Abstract
    Supervised kernel learning has been the focus of research in recent years. Although these methods are developed based on rigorous frameworks, they fail to improve the classification accuracy in real world applications. In order to find the origin of this problem, it should be noted that the kernel function represents a prior knowledge on the labeling function. Similar to other learning problem, learning this prior knowledge needs another prior knowledge. In supervised kernel learning, only naive assumptions can be used as the prior knowledge. These include minimizing the ℓ1 and ℓ2 norms of the kernel parameters.
    As an alternative approach, in Semi-Supervised Learning (SSL), unlabeled... 

    Supervised neighborhood graph construction for semi-supervised classification

    , Article Pattern Recognition ; Volume 45, Issue 4 , April , 2012 , Pages 1363-1372 ; 00313203 (ISSN) Rohban, M. H ; Rabiee, H. R ; Sharif University of Technology
    Abstract
    Graph based methods are among the most active and applicable approaches studied in semi-supervised learning. The problem of neighborhood graph construction for these methods is addressed in this paper. Neighborhood graph construction plays a key role in the quality of the classification in graph based methods. Several unsupervised graph construction methods have been proposed that have addressed issues such as data noise, geometrical properties of the underlying manifold and graph hyper-parameters selection. In contrast, in order to adapt the graph construction to the given classification task, many of the recent graph construction methods take advantage of the data labels. However, these... 

    Efficient iterative Semi-Supervised Classification on manifold

    , Article Proceedings - IEEE International Conference on Data Mining, ICDM ; 2011 , Pages 228-235 ; 15504786 (ISSN); 9780769544090 (ISBN) Farajtabar, M ; Rabiee, H. R ; Shaban, A ; Soltani Farani, A ; National Science Foundation (NSF) - Where Discoveries Begin; University of Technology Sydney; Google; Alberta Ingenuity Centre for Machine Learning; IBM Research ; Sharif University of Technology
    Abstract
    Semi-Supervised Learning (SSL) has become a topic of recent research that effectively addresses the problem of limited labeled data. Many SSL methods have been developed based on the manifold assumption, among them, the Local and Global Consistency (LGC) is a popular method. The problem with most of these algorithms, and in particular with LGC, is the fact that their naive implementations do not scale well to the size of data. Time and memory limitations are the major problems faced in large-scale problems. In this paper, we provide theoretical bounds on gradient descent, and to overcome the aforementioned problems, a new approximate Newton's method is proposed. Moreover, convergence...