Loading...
Search for: metric-learning
0.007 seconds

    Metric learning for semi-supervised clustering using pairwise constraints and the geometrical structure of data

    , Article Intelligent Data Analysis ; Volume 13, Issue 6 , 2009 , Pages 887-899 ; 1088467X (ISSN) Baghshah Soleymani, B ; Bagheri Shouraki, S ; Sharif University of Technology
    Abstract
    Metric learning is a powerful approach for semi-supervised clustering. In this paper, a metric learning method considering both pairwise constraints and the geometrical structure of data is introduced for semi-supervised clustering. At first, a smooth metric is found (based on an optimization problem) using positive constraints as supervisory information. Then, an extension of this method employing both positive and negative constraints is introduced. As opposed to the existing methods, the extended method has the capability of considering both positive and negative constraints while considering the topological structure of data. The proposed metric learning method can improve performance of... 

    Multiple metric learning for graph based human pose estimation

    , Article Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Daegu, Korea ; Volume 8228 LNCS, Issue PART 3 , November , 2013 , Pages 200-208 ; 03029743 (ISSN) ; 9783642420504 (ISBN) Zolfaghari, M ; Gozlou, M. G ; Shalmani, M. T. M ; Sharif University of Technology
    2013
    Abstract
    In this paper, a multiple metric learning scheme for human pose estimation from a single image is proposed. Here, we focused on a big challenge of this problem which is; different 3D poses might correspond to similar inputs. To address this ambiguity, some Euclidean distance based approaches use prior knowledge or pose model that can work properly, provided that the model parameters are being estimated accurately. In the proposed method, the manifold of data is divided into several clusters and then, we learn a new metric for each partition by utilizing not only input features, but also their corresponding poses. The manifold clustering allows the decomposition of multiple manifolds into a... 

    Probabilistic non-linear distance metric learning for constrained clustering

    , Article MultiClust 2013 - 4th Workshop on Multiple Clusterings, Multi-View Data, and Multi-Source Knowledge-Driven Clustering, in Conj. with the 19th ACM SIGKDD Int. Conf. on KDD 2013 ; 2013 ; 9781450323345 (ISBN) Babagholami Mohamadabadi, B ; Zarghami, A ; Pourhaghighi, H. A ; Manzuri Shalmani, M. T ; Sharif University of Technology
    2013
    Abstract
    Distance metric learning is a powerful approach to deal with the clustering problem with side information. For semi-supervised clustering, usually a set of pairwise similarity and dissimilarity constraints is provided as supervisory information. Although some of the existing methods can use both equivalence (similarity) and inequivalence (dissimilarity) constraints, they are usually limited to learning a global Mahalanobis metric (i.e., finding a linear transformation). Moreover, they find metrics only according to the data points appearing in constraints, and cannot utilize information of other data points. In this paper, we propose a probabilistic metric learning algorithm which uses... 

    Multi-modal deep distance metric learning

    , Article Intelligent Data Analysis ; Volume 21, Issue 6 , 2017 , Pages 1351-1369 ; 1088467X (ISSN) Roostaiyan, S. M ; Imani, E ; Soleymani Baghshah, M ; Sharif University of Technology
    IOS Press  2017
    Abstract
    In many real-world applications, data contain heterogeneous input modalities (e.g., web pages include images, text, etc.). Moreover, data such as images are usually described using different views (i.e. different sets of features). Learning a distance metric or similarity measure that originates from all input modalities or views is essential for many tasks such as content-based retrieval ones. In these cases, similar and dissimilar pairs of data can be used to find a better representation of data in which similarity and dissimilarity constraints are better satisfied. In this paper, we incorporate supervision in the form of pairwise similarity and/or dissimilarity constraints into... 

    Predicting Novelty Concepts in Data Streams

    , M.Sc. Thesis Sharif University of Technology Soudani, Heydar (Author) ; Beigy, Hamid (Supervisor)
    Abstract
    Many real-world environment challenges are not considered in laboratory-controlled models. Although different and powerful models have been developed for object detection and classification in diverse applications, many fail in the real world. One of the most important challenges is dealing with unknown data at the inference time. The second challenge is to change the characteristics of the data distribution over time, known as concept drift. These two important challenges are explored in the Data Stream environment, along with many of the events that a model may face in the real world. To address the challenges of learning in a data stream environment, this thesis first designs a... 

    Multi-modal distance metric learning: A bayesian non-parametric approach

    , Article Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6 September 2014 through 12 September 2014 ; Volume 8927 , September , 2015 , Pages 63-77 ; 03029743 (ISSN) ; 9783319161983 (ISBN) Babagholami Mohamadabadi, B ; Roostaiyan, S. M ; Zarghami, A ; Baghshah, M. S ; Rother, C ; Agapito, L ; Bronstein, M. M ; Sharif University of Technology
    Springer Verlag  2015
    Abstract
    In many real-world applications (e.g. social media application), data usually consists of diverse input modalities that originates from various heterogeneous sources. Learning a similarity measure for such data is of great importance for vast number of applications such as classification, clustering, retrieval, etc. Defining an appropriate distance metric between data points with multiple modalities is a key challenge that has a great impact on the performance of many multimedia applications. Existing approaches for multi-modal distance metric learning only offer point estimation of the distance matrix and/or latent features, and can therefore be unreliable when the number of training... 

    Clustering based on the Structure of the Data and Side Information

    , Ph.D. Dissertation Sharif University of Technology Soleymani Baghshah, Mahdieh (Author) ; Bagheri Shouraki, Saeed (Supervisor)
    Abstract
    Clustering is one of the important problems in machine learning, data mining, and pattern recognition fields. When the considered feature space for data representation is not suitable for discrimination of data groups, the data clustering problem may be a difficult problem that cannot be solved properly. In the other words, when the Euclidean distance cannot describe the dissimilarity of data pairs appropriately, the common clustering algorithms may not be helpful and the clusters show arbitrary shapes and spread in such spaces. Although since the late 1990’s several algorithms have been proposed for finding clusters of arbitrary structures, these algorithms cannot yield desirable... 

    3D Human pToopsice Estimation

    , M.Sc. Thesis Sharif University of Technology Zolfaghari, Mohammad Reza (Author) ; Manzuri Shalmani, Mohammad Taghi (Supervisor)
    Abstract
    The purpose of this project is estimating the two-or three-dimensional human condition using existing data(images or video). Human pose estimation can be used in applications، including the detection of human behavior، animation،human computer interaction، physical therapy and، etc . We use sparse representation method to estimating human pose In this project .Sparse representation methods in recent years has been used in many fields and probably in pose estimation can achieve good results with this method  

    Non-linear metric learning using pairwise similarity and dissimilarity constraints and the geometrical structure of data

    , Article Pattern Recognition ; Volume 43, Issue 8 , August , 2010 , Pages 2982-2992 ; 00313203 (ISSN) Soleymani Baghshah, M ; Bagheri Shouraki, S ; Sharif University of Technology
    2010
    Abstract
    The problem of clustering with side information has received much recent attention and metric learning has been considered as a powerful approach to this problem. Until now, various metric learning methods have been proposed for semi-supervised clustering. Although some of the existing methods can use both positive (must-link) and negative (cannot-link) constraints, they are usually limited to learning a linear transformation (i.e., finding a global Mahalanobis metric). In this paper, we propose a framework for learning linear and non-linear transformations efficiently. We use both positive and negative constraints and also the intrinsic topological structure of data. We formulate our metric... 

    Learning a metric when clustering data points in the presence of constraints

    , Article Advances in Data Analysis and Classification ; Volume 14, Issue 1 , 2020 , Pages 29-56 Abin, A. A ; Bashiri, M. A ; Beigy, H ; Sharif University of Technology
    Springer  2020
    Abstract
    Learning an appropriate distance measure under supervision of side information has become a topic of significant interest within machine learning community. In this paper, we address the problem of metric learning for constrained clustering by considering three important issues: (1) considering importance degree for constraints, (2) preserving the topological structure of data, and (3) preserving some natural distribution properties in the data. This work provides a unified way to handle different issues in constrained clustering by learning an appropriate distance measure. It has modeled the first issue by injecting the importance degree of constraints directly into an objective function.... 

    Robust Speaker Verification in Total Variability Space

    , M.Sc. Thesis Sharif University of Technology La’l Mohammadi, Mahnoosh (Author) ; Sameti, Hossein (Supervisor)
    Abstract
    Our study is mainly related to speaker verification systems. Given a speech segment and a claimed identity, these systems must decide whether the claimant is admissible or a fraud. Our main focus in on making the speaker verification system robust in case of limited training data. When there is limited training data, the accuracy of speaker verification systems reduces drastically. Our main purpose is to review this problem deeply and to represent methods in order to encounter this challenge. Recently, some methods such as PLDA and distance metric learning have been applied in text-independent speaker verification in order to encounter limited data crisis. One of the important cases in which... 

    Multi-Modal Distance Metric Learning

    , M.Sc. Thesis Sharif University of Technology Roostaiyan, Mahdi (Author) ; Soleymani, Mahdieh (Supervisor)
    Abstract
    In many real-world applications, data contain multiple input channels (e.g., web pages include text, images and etc). In these cases, supervisory information may also be available in the form of distance constraints such as similar and dissimilar pairs from user feedbacks. Distance metric learning in these environments can be used for different goals such as retrieval and recommendation. In this research, we used from dual-wing harmoniums to combining text and image modals to a unified latent space when similar-dissimilar pairs are available. Euclidean distance of data represented in this latent space used as a distance metric. In this thesis, we extend the dual-wing harmoniums for... 

    Online Distance Metric Learning

    , M.Sc. Thesis Sharif University of Technology Vazifedan, Afrooz (Author) ; Beigy, Hamid (Supervisor)
    Abstract
    Distance Metric Learning algorithms have been widely used in Machine Learning methods recently. In these algorithms a distance function between objecs (data points) is learned based on their labels or similarity and dissimilarity constraints. Recent works have shown that a good precision is obtained in classification or clustering methods which use these functions. Since in the current systems many of data points do not exist at the beginning and are added to the training set as the algorithm is run, online methods are needed to update learned metric due to new data.
    In this thesis, we proposed a new online distance metric learning method that has higher performance than existing... 

    Metric learning for graph based semi-supervised human pose estimation

    , Article Proceedings - International Conference on Pattern Recognition ; 2012 , Pages 3386-3389 ; 10514651 (ISSN) ; 9784990644109 (ISBN) Pourdamghani, N ; Rabiee, H. R ; Zolfaghari, M ; Sharif University of Technology
    2012
    Abstract
    Discriminative approaches to human pose estimation have became popular in recent years. These approaches face a big challenge: Similar inputs might correspond to very dissimilar poses. This property misleads the mapping functions which rely on the Euclidean distances in the input space. In this paper, we use the distances between the labels of the training data to learn a metric and map the input data to a space where this problem is minimized. Our mapping is linear and hence preserves the manifold structure of the input data. We benefit from the unlabeled data to estimate this manifold in the new space as a nearest neighbor graph. We finally utilize Tikhonov regularization to find a smooth... 

    Noise-tolerant model selection and parameter estimation for complex networks

    , Article Physica A: Statistical Mechanics and its Applications ; Volume 427 , 2015 , Pages 100-112 ; 03784371 (ISSN) Aliakbary, S ; Motallebi, S ; Rashidian, S ; Habibi, J ; Movaghar, A ; Sharif University of Technology
    Elsevier  2015
    Abstract
    Real networks often exhibit nontrivial topological features that do not occur in random graphs. The need for synthesizing realistic networks has resulted in development of various network models. In this paper, we address the problem of selecting and calibrating the model that best fits a given target network. The existing model fitting approaches mostly suffer from sensitivity to network perturbations, lack of the parameter estimation component, dependency on the size of the networks, and low accuracy. To overcome these limitations, we considered a broad range of network features and employed machine learning techniques such as genetic algorithms, distance metric learning, nearest neighbor... 

    Low-rank kernel learning for semi-supervised clustering

    , Article Proceedings of the 9th IEEE International Conference on Cognitive Informatics, ICCI 2010, 7 July 2010 through 9 July 2010, Beijing ; 2010 , Pages 567-572 ; 9781424480401 (ISBN) Soleymani Baghshah, M ; Bagheri Shouraki, S ; Sharif University of Technology
    2010
    Abstract
    In the last decade, there has been a growing interest in distance function learning for semi-supervised clustering settings. In addition to the earlier methods that learn Mahalanobis metrics (or equivalently, linear transformations), some nonlinear metric learning methods have also been recently introduced. However, these methods either allow limited choice of distance metrics yielding limited flexibility or learn nonparametric kernel matrices and scale very poorly (prohibiting applicability to medium and large data sets). In this paper, we propose a novel method that learns low-rank kernel matrices from pairwise constraints and unlabeled data. We formulate the proposed method as a trace... 

    Kernel-based metric learning for semi-supervised clustering

    , Article Neurocomputing ; Volume 73, Issue 7-9 , 2010 , Pages 1352-1361 ; 09252312 (ISSN) Soleymani Baghshah, M ; Bagheri Shouraki, S ; Sharif University of Technology
    2010
    Abstract
    Distance metric plays an important role in many machine learning algorithms. Recently, there has been growing interest in distance metric learning for semi-supervised setting. In the last few years, many methods have been proposed for metric learning when pairwise similarity (must-link) and/or dissimilarity (cannot-link) constraints are available along with unlabeled data. Most of these methods learn a global Mahalanobis metric (or equivalently, a linear transformation). Although some recently introduced methods have devised nonlinear extensions of linear metric learning methods, they usually allow only limited forms of distance metrics and also can use only similarity constraints. In this... 

    Semi-supervised metric learning using pairwise constraints

    , Article 21st International Joint Conference on Artificial Intelligence, IJCAI-09, Pasadena, CA, 11 July 2009 through 17 July 2009 ; 2009 , Pages 1217-1222 ; 10450823 (ISSN) ; 9781577354260 (ISBN) Soleymani Baghshah, M ; Bagheri Shouraki, S ; Sharif University of Technology
    Abstract
    Distance metric has an important role in many machine learning algorithms. Recently, metric learning for semi-supervised algorithms has received much attention. For semi-supervised clustering, usually a set of pairwise similarity and dissimilarity constraints is provided as supervisory information. Until now, various metric learning methods utilizing pairwise constraints have been proposed. The existing methods that can consider both positive (must-link) and negative (cannot-link) constraints find linear transformations or equivalently global Mahalanobis metrics. Additionally, they find metrics only according to the data points appearing in constraints (without considering other data...