Loading...
Search for: mutual-informations
0.007 seconds
Total 52 records

    Cluster-based sparse topical coding for topic mining and document clustering

    , Article Advances in Data Analysis and Classification ; Volume 12, Issue 3 , 2018 , Pages 537-558 ; 18625347 (ISSN) Ahmadi, P ; Gholampour, I ; Tabandeh, M ; Sharif University of Technology
    Springer Verlag  2018
    Abstract
    In this paper, we introduce a document clustering method based on Sparse Topical Coding, called Cluster-based Sparse Topical Coding. Topic modeling is capable of improving textual document clustering by describing documents via bag-of-words models and projecting them into a topic space. The latent semantic descriptions derived by the topic model can be utilized as features in a clustering process. In our proposed method, document clustering and topic modeling are integrated in a unified framework in order to achieve the highest performance. This framework includes Sparse Topical Coding, which is responsible for topic mining, and K-means that discovers the latent clusters in documents... 

    Φ-Entropic measures of correlation

    , Article IEEE Transactions on Information Theory ; Volume 64, Issue 4 , 2018 , Pages 2193-2211 ; 00189448 (ISSN) Beigi, S ; Gohari, A ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2018
    Abstract
    A measure of correlation is said to have the tensorization property if it does not change when computed for i.i.d. copies. More precisely, a measure of correlation between two random variables X, Y denoted by rho (X, Y), has the tensorization property if ρ(Xn, Yn)=ρ (X, Y) where (Xn, Yn) denotes n i.i.d. copies of (X, Y). Two well-known examples of such measures are the maximal correlation and the hypercontractivity ribbon (HC ribbon). We show that the maximal correlation and the HC ribbon are special cases of the new notion of Φ-ribbons, defined in this paper for a class of convex functions Φ. Φ-ribbon reduces to the HC ribbon and the maximal correlation for special choices of Φ, and is a... 

    Improving LF-MMI using unconstrained supervisions for ASR

    , Article 2018 IEEE Spoken Language Technology Workshop, SLT 2018, 18 December 2018 through 21 December 2018 ; 2019 , Pages 43-47 ; 9781538643341 (ISBN) Hadian, H ; Povey, D ; Sameti, H ; Trmal, J ; Khudanpur, S ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2019
    Abstract
    We present our work on improving the numerator graph for discriminative training using the lattice-free maximum mutual information (MMI) criterion. Specifically, we propose a scheme for creating unconstrained numerator graphs by removing time constraints from the baseline numerator graphs. This leads to much smaller graphs and therefore faster preparation of training supervisions. By testing the proposed un-constrained supervisions using factorized time-delay neural network (TDNN) models, we observe 0.5% to 2.6% relative improvement over the state-of-the-art word error rates on various large-vocabulary speech recognition databases. © 2018 IEEE  

    Unsupervised image segmentation by mutual information maximization and adversarial regularization

    , Article IEEE Robotics and Automation Letters ; Volume 6, Issue 4 , 2021 , Pages 6931-6938 ; 23773766 (ISSN) Mirsadeghi, S. E ; Royat, A ; Rezatofighi, H ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2021
    Abstract
    Semantic segmentation is one of the basic, yet essential scene understanding tasks for an autonomous agent. The recent developments in supervised machine learning and neural networks have enjoyed great success in enhancing the performance of the state-of-the-art techniques for this task. However, their superior performance is highly reliant on the availability of a large-scale annotated dataset. In this letter, we propose a novel fully unsupervised semantic segmentation method, the so-called Information Maximization and Adversarial Regularization Segmentation (InMARS). Inspired by human perception which parses a scene into perceptual groups, rather than analyzing each pixel individually, our... 

    Continuous emotion recognition during music listening using EEG signals: A fuzzy parallel cascades model

    , Article Applied Soft Computing ; Volume 101 , 2021 ; 15684946 (ISSN) Hasanzadeh, F ; Annabestani, M ; Moghimi, S ; Sharif University of Technology
    Elsevier Ltd  2021
    Abstract
    A controversial issue in artificial intelligence is human emotion recognition. This paper presents a fuzzy parallel cascades (FPC) model for predicting the continuous subjective emotional appraisal of music by time-varying spectral content of electroencephalogram (EEG) signals. The EEG, along with an emotional appraisal of 15 subjects, was recorded during listening to seven musical excerpts. The emotional appraisement was recorded along the valence and arousal emotional axes as a continuous signal. The FPC model was composed of parallel cascades with each cascade containing a fuzzy logic-based system. The FPC model performance was evaluated using linear regression (LR), support vector... 

    Designing an Estimation of Distribution Algorithm Based on Data Mining Methods

    , M.Sc. Thesis Sharif University of Technology Akbari Azirani, Elham (Author) ; Beigy, Hamid (Supervisor)
    Abstract
    Estimation of distribution algorithms (EDA) are optimization methods that search the solution space by building and sampling probabilistic models. The linkage tree genetic algorithm (LTGA), which can be considered an estimation of distribution algorithm, uses hierarchical clustering to build a hierarchical linkage model called the linkage tree, and gene-pool optimal mixing algorithm to generate new solutions. While the LTGA performs very well on problems with separable sub-problems, its performance deteriorates on ones with overlapping sub-problems. This thesis presents a comparison of the effect of different pre-constructed models in the LTGA's performance. Several important factors that... 

    Using the Echo of Rotating Parts to Recognize a Radar Target

    , M.Sc. Thesis Sharif University of Technology Johari, Mohammad Mahdi (Author) ; Nayebi, Mohammad Mahdi (Supervisor)
    Abstract
    Target recognition techniques based on micro Doppler phenomenon are popular because they are applicable even on low resolution radars, in contrast to other techniques such as High Resolution Range Profile (HRRP) which need high resolution in range or angle. Usually, main purpose of such techniques is generating robust features against target initial state, velocity, aspect angle, etc. rather than features which exactly identify a target. Main approaches in the literature are based on time-frequency transforms (TFT) such as spectrogram in order to generate features to classify targets, but in this thesis, we propose a totally different method using Recurrence Plot for generating features... 

    Predicting the Optimal Operation Pattern of Municipal Wastewater Treatment Plant Using Artificial Intelligence Approaches

    , M.Sc. Thesis Sharif University of Technology Hakimi, Mahdi (Author) ; Torkian, Ayoub (Supervisor)
    Abstract
    With the growth of the population and the significant expansion of industries in the last century, many environmental problems have plagued developed and developing countries. One of these environmental problems is water pollution. Observing the effects of water pollution over time, sanitary and industrial wastewater treatment was proposed as a reliable solution. With technology development, wastewater treatment requirements have become stricter. The increase in energy consumption and wastewater treatment costs due to population growth and industrialization on the one hand and strict regulations, on the other hand, have forced those involved in this field to employ a variety of technical and... 

    An extended distributed learning automata based algorithm for solving the community detection problem in social networks

    , Article 2017 25th Iranian Conference on Electrical Engineering, ICEE 2017, 2 May 2017 through 4 May 2017 ; 2017 , Pages 1520-1526 ; 9781509059638 (ISBN) Ghamgosar, M ; Daliri Khomami, M. M ; Bagherpour, N ; Reza, M ; Sharif University of Technology
    Abstract
    Due to unstoppable growth of social networks and the large number of users, the detection of communities have become one of the most popular and successful domain of research areas. Detecting communities is a significant aspect in analyzing networks because of its various applications such as sampling, link prediction and communications among members of social networks. There have been proposed many different algorithms for solving community detection problem containing optimization methods. In this paper we propose a novel algorithm based on extended distributed learning automata for solving this problem. Our proposed algorithm benefits from cooperation between learning automata to detect... 

    End-to-end speech recognition using lattice-free MMI

    , Article 19th Annual Conference of the International Speech Communication, INTERSPEECH 2018, 2 September 2018 through 6 September 2018 ; Volume 2018-September , 2018 , Pages 12-16 ; 2308457X (ISSN) Hadian, H ; Sameti, H ; Povey, D ; Khudanpur, S ; Sharif University of Technology
    International Speech Communication Association  2018
    Abstract
    We present our work on end-to-end training of acoustic models using the lattice-free maximum mutual information (LF-MMI) objective function in the context of hidden Markov models. By end-to-end training, we mean flat-start training of a single DNN in one stage without using any previously trained models, forced alignments, or building state-tying decision trees. We use full biphones to enable context-dependent modeling without trees, and show that our end-to-end LF-MMI approach can achieve comparable results to regular LF-MMI on well-known large vocabulary tasks. We also compare with other end-to-end methods such as CTC in character-based and lexicon-free settings and show 5 to 25 percent... 

    Image registration based on low rank matrix: rank-regularized SSD

    , Article IEEE Transactions on Medical Imaging ; January , 2018 , Pages 138-150 ; 02780062 (ISSN) Ghaffari, A ; Fatemizadeh, E ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2018
    Abstract
    Similarity measure is a main core of image registration algorithms. Spatially varying intensity distortion is an important challenge, which affects the performance of similarity measures. Correlation among the pixels is the main characteristic of this distortion. Similarity measures such as sum-of-squared-differences (SSD) and mutual information ignore this correlation; hence, perfect registration cannot be achieved in the presence of this distortion. In this paper, we model this correlation with the aid of the low rank matrix theory. Based on this model, we compensate this distortion analytically and introduce rank-regularized SSD (RRSSD). This new similarity measure is a modified SSD based... 

    Adversarial orthogonal regression: Two non-linear regressions for causal inference

    , Article Neural Networks ; Volume 143 , 2021 , Pages 66-73 ; 08936080 (ISSN) Heydari, M. R ; Salehkaleybar, S ; Zhang, K ; Sharif University of Technology
    Elsevier Ltd  2021
    Abstract
    We propose two nonlinear regression methods, namely, Adversarial Orthogonal Regression (AdOR) for additive noise models and Adversarial Orthogonal Structural Equation Model (AdOSE) for the general case of structural equation models. Both methods try to make the residual of regression independent from regressors, while putting no assumption on noise distribution. In both methods, two adversarial networks are trained simultaneously where a regression network outputs predictions and a loss network that estimates mutual information (in AdOR) and KL-divergence (in AdOSE). These methods can be formulated as a minimax two-player game; at equilibrium, AdOR finds a deterministic map between inputs...