Loading...
Search for: mutual-informations
0.012 seconds
Total 52 records

    On Different Information Theoretic Security Measures in Communication Network

    , M.Sc. Thesis Sharif University of Technology Kavian, Masoud (Author) ; Aref, Mohammad Reza (Supervisor) ; Mirmohseni, Mahtab (Co-Supervisor)
    Abstract
    Reliable and secure communication requires low error probability and low information leakage, respectively. In this thesis we study different security parameters in communication networks. Three important security metrics are noted by weak, strong, and perfect secrecy. A weak condition on secrecy requires the percentage of the message leaked to the adversary vanish as the code length increases, while a strong condition on secrecy requires the total amount of leaked information (not its percentage) vanish as length increases. Perfect secrecy requires absoloutely zero leakage of information for every given block length. An intriguing question is to determine the secrecy rate under secrecy... 

    Multivariate Mutual Information via Secret-key Agreement

    , M.Sc. Thesis Sharif University of Technology Mostafa Zadflah Chobari, Mohammad (Author) ; Ebrahimi, Javad (Supervisor)
    Abstract
    Shannon (1948) for the first time defined the "mutual information'' parameter for two random variables, but still there is no common definition for multivariate mutual information has been agreed upon, despite the multitude of research on the subject and various proposed definitions. In 2015, a study suggested that the maximum rate of secret-key, in the secret-key agreement problem, is a suitable candidate for defining multivariate mutual information. Csiszár and Narayan's research on the secret-key agreement problem provides an accessible bound for the maximum rate of secret-key rate, which in the bivariate case is the shannon's mutual information. The proposed definition has all expected... 

    Non-Rigid Medical Image Registration Based on Information Theory

    , M.Sc. Thesis Sharif University of Technology Khorsandi, Rahman (Author) ; Fatemizadeh, Emadoddin (Supervisor)
    Abstract
    The registration of images is a fundamental task in numerous applications in medical image processing. The importance of medical image registraiton due to the imaging systems development in last decades is obvious to every one. Especially the wide employment and different capabilities of these systems has caused more attention to this field of image processing. Th e application of medical image registraiton is extended from clinical diagnosis and treatment evaluation, to image guided surgery. The dimension of images as well as modalities of imaging and imaging subjectshas made a wide variety of problems in this branch of image processing. Registration, briefly speaking, is a geometrical... 

    Predicting the Optimal Operation Pattern of Municipal Wastewater Treatment Plant Using Artificial Intelligence Approaches

    , M.Sc. Thesis Sharif University of Technology Hakimi, Mahdi (Author) ; Torkian, Ayoub (Supervisor)
    Abstract
    With the growth of the population and the significant expansion of industries in the last century, many environmental problems have plagued developed and developing countries. One of these environmental problems is water pollution. Observing the effects of water pollution over time, sanitary and industrial wastewater treatment was proposed as a reliable solution. With technology development, wastewater treatment requirements have become stricter. The increase in energy consumption and wastewater treatment costs due to population growth and industrialization on the one hand and strict regulations, on the other hand, have forced those involved in this field to employ a variety of technical and... 

    Quantum Estimation: Properties and Calculation of the Quantum Fisher Information and Adaptive Scheme

    , Ph.D. Dissertation Sharif University of Technology Hassani, Majid (Author) ; Rezakhani, Ali (Supervisor)
    Abstract
    In this thesis , we study quantum estimation , its primary tools and different approaches . To this end , along with reviewing the main concepts of classical and quantum estimation , the Cramer-Rao inequlity which establishes a lower bound on the precision of estimation has been used . This lower bound can be calculated using the quantum Fisher information . In order to explore properties of the quantum Fisher information , we study the continuity relation of this quantity in the most general case and we calculate it for different quantum states . To underline the importance of the continuity relation , one can demonstrate an estimate of the value of the quantum Fisher information... 

    Using the Echo of Rotating Parts to Recognize a Radar Target

    , M.Sc. Thesis Sharif University of Technology Johari, Mohammad Mahdi (Author) ; Nayebi, Mohammad Mahdi (Supervisor)
    Abstract
    Target recognition techniques based on micro Doppler phenomenon are popular because they are applicable even on low resolution radars, in contrast to other techniques such as High Resolution Range Profile (HRRP) which need high resolution in range or angle. Usually, main purpose of such techniques is generating robust features against target initial state, velocity, aspect angle, etc. rather than features which exactly identify a target. Main approaches in the literature are based on time-frequency transforms (TFT) such as spectrogram in order to generate features to classify targets, but in this thesis, we propose a totally different method using Recurrence Plot for generating features... 

    Designing an Estimation of Distribution Algorithm Based on Data Mining Methods

    , M.Sc. Thesis Sharif University of Technology Akbari Azirani, Elham (Author) ; Beigy, Hamid (Supervisor)
    Abstract
    Estimation of distribution algorithms (EDA) are optimization methods that search the solution space by building and sampling probabilistic models. The linkage tree genetic algorithm (LTGA), which can be considered an estimation of distribution algorithm, uses hierarchical clustering to build a hierarchical linkage model called the linkage tree, and gene-pool optimal mixing algorithm to generate new solutions. While the LTGA performs very well on problems with separable sub-problems, its performance deteriorates on ones with overlapping sub-problems. This thesis presents a comparison of the effect of different pre-constructed models in the LTGA's performance. Several important factors that... 

    Recognizing Center of Siezur with Clustering Algorithm

    , M.Sc. Thesis Sharif University of Technology Akhshi, Amin (Author) ; Rahimitabar, Mohammad Reza (Supervisor)
    Abstract
    Complex systems are composed of a large number of subsystems behaving in a collective manner. In such systems, which are usually far from equilibrium, collective behavior arises due to self-organization and results in the formation of temporal, spatial, spatio-temporall structures. Examples of complex systems are turbulent flow, stock markets, dynamics of a brain, etc. In study of the complex systems, we always encounter with handling and analysing of a Big-Data set. There are several approaches to overcome this problem, among which the most powerful method is the clustering analysis. Clustering algorithm is based on the classifying of dynamics of complex system using some similarity... 

    One-shot achievability via fidelity

    , Article IEEE International Symposium on Information Theory - Proceedings, 14 June 2015 through 19 June 2015 ; Volume 2015-June , 2015 , Pages 301-305 ; 21578095 (ISSN) ; 9781467377041 (ISBN) Yassaee, M. H ; Sharif University of Technology
    2015
    Abstract
    This paper provides a universal framework for establishing one-shot achievability results for coordination and secrecy problems. The framework is built on our previous framework [Yassaee et al. 13] for proving one-shot achievability results in the context of source and channel coding problems. In the coordination and secrecy problems, one needs to compare an induced distribution by encoding/decoding with an ideal distribution (satisfying some desirable properties) using a suitable criterion. In this paper, we use fidelity as a criterion for measuring the closeness of induced distribution with the ideal distribution. The framework exploits the stochastic mutual information coders at the... 

    Multiple access wiretap channels with strong secrecy

    , Article 2010 IEEE Information Theory Workshop, ITW 2010 - Proceedings, 30 August 2010 through 3 September 2010, Dublin ; 2010 ; 9781424482641 (ISBN) Yassaee, M. H ; Aref, M. R ; Sharif University of Technology
    2010
    Abstract
    The problem of secure communication over multiple-Access Wiretap channel (MAC-WTC) under strong secrecy criterion is investigated. A new technique based on channel output statistics approximation is developed for establishing the strong security over multi-user channels. In particular, this technique shows that how simple wiretap coding results in secure communication under strong secrecy criterion instead of weak secrecy criterion. As a side result of the paper, two results on the output statistics of MAC are provided. Such results can be used to approximate the mutual information between input and output of MAC with respect to a given codebook of arbitrary rate  

    ECG denoising using mutual information based classification of IMFs and interval thresholding

    , Article 2015 38th International Conference on Telecommunications and Signal Processing, TSP 2015, 9 July 2015 through 11 July 2015 ; July , 2015 , Page(s): 1 - 6 ; 9781479984985 (ISBN) Taghavi, M ; Shamsollahi, M. B ; Senhadji, L ; Molnar K ; Herencsar N ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2015
    Abstract
    The Electrocardiogram (ECG) is widely used for diagnosis of heart diseases. Therefore, the quality of information extracted from the ECG has a vital role. In real recordings, ECG is corrupted by artifacts such as prolonged repolarization, respiration, changes of electrode position, muscle contraction, and power line interface. In this paper, a denoising technique for ECG signals based on Empirical Mode Decomposition (EMD) is proposed. We use Ensemble Empirical Mode Decomposition (EEMD) to overcome the limitations of EMD. Moreover, to overcome the limitations of thresholding methods we use the combination of mutual information and two EMD based interval thresholding approaches. Our new method... 

    Sensitivity of the secrecy capacity of a wiretap channel to the channel gains with imperfect channel information

    , Article IWCIT 2017 - Iran Workshop on Communication and Information Theory, 3 May 2017 through 4 May 2017 ; 2017 ; 9781509047833 (ISBN) Sedighizad, M ; Bafghi, H. G ; Seyfe, B ; Sharif University of Technology
    Abstract
    In this paper, the impact of a small variations in the channel gains on the secrecy rate of the wiretap channel is studied, in which it is assumed that the imperfect channel knowledge is available at the transmitter. First, we consider general additive noise model for both legitimate and eavesdropper channels in the wiretap channel, and compute the variation of the secrecy rate resulting from the small variations in the channel gains. Then, we focus on the Gaussian wiretap channel, as a special case and calculate the sensitivity of the secrecy capacity to the channel gains with imperfect channel knowledge. Interestingly, it is shown that in some situations the effect of the channel variation... 

    Electrode selection for noninvasive fetal electrocardiogram extraction using mutual information criteria

    , Article AIP Conference Proceedings ; Volume 872 , 2006 , Pages 97-104 ; 0094243X (ISSN) Sameni, R ; Vrins, F ; Parmentier, F ; Hérail, C ; Vigneron, V ; Verleysen, M ; Jutten, C ; Shamsollahi, M. B ; Sharif University of Technology
    2006
    Abstract
    Blind source separation (BSS) techniques have revealed to be promising approaches for the noninvasive extraction of fetal cardiac signals from maternal abdominal recordings. From previous studies, it is now believed that a carefully selected array of electrodes well-placed over the abdomen of a pregnant woman contains the required 'information' for BSS, to extract the complete fetal components. Based on this idea, previous works have involved array recording systems and sensor selection strategies based on the Mutual Information (MI) criterion. In this paper the previous works have been extended, by considering the 3-dimensional aspects of the cardiac electrical activity. The proposed method... 

    Blind source separation by adaptive estimation of score function difference

    , Article Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) ; Volume 3195 , 2004 , Pages 9-17 ; 03029743 (ISSN); 3540230564 (ISBN); 9783540230564 (ISBN) Samadi, S ; Babaie Zadeh, M ; Jutten, C ; Nayebi, K ; Sharif University of Technology
    Springer Verlag  2004
    Abstract
    In this paper, an adaptive algorithm for blind source separation in linear instantaneous mixtures is proposed, and it is shown to be the optimum version of the EASI algorithm. The algorithm is based on minimization of mutual information of outputs. This minimization is done using adaptive estimation of a recently proposed non-parametric "gradient" for mutual information. © Springer-Verlag 2004  

    Is independent component analysis appropriate for multivariate resolution in analytical chemistry?

    , Article TrAC - Trends in Analytical Chemistry ; Volume 31 , 2012 , Pages 134-143 ; 01659936 (ISSN) Parastar, H ; Jalali Heravi, M ; Tauler, R ; Sharif University of Technology
    2012
    Abstract
    In this article, we examine Independent Component Analysis (ICA) and the concept of Mutual information (MI) as a quantitative measure of independence from the point of view of analytical chemistry. We compare results obtained by different ICA methods with results obtained by Multivariate Curve Resolution Alternating Least Squares (MCR-ALS). These results have shown that, when non-negativity constraints are applied, values of MI increase considerably and the resolved components cannot anymore be considered to be independent (i.e. they can only be considered to be the " least dependent" components). MI values of profiles resolved by MCR-ALS and ICA did not differ significantly when... 

    Application of 3D-wavelet statistics to video analysis

    , Article Multimedia Tools and Applications ; Volume 65, Issue 3 , 2013 , Pages 441-465 ; 13807501 (ISSN) Omidyeganeh, M ; Ghaemmaghami, S ; Shirmohammadi, S ; Sharif University of Technology
    2013
    Abstract
    Video activity analysis is used in various video applications such as human action recognition, video retrieval, video archiving. In this paper, we propose to apply 3D wavelet transform statistics to natural video signals and employ the resulting statistical attributes for video modeling and analysis. From the 3D wavelet transform, we investigate the marginal and joint statistics as well as the Mutual Information (MI) estimates. We show that marginal histograms are approximated quite well by Generalized Gaussian Density (GGD) functions; and the MI between coefficients decreases when the activity level increases in videos. Joint statistics attributes are applied to scene activity grouping,... 

    Video activity analysis based on 3D wavelet statistical properties

    , Article 11th International Conference on Advanced Communication Technology, ICACT 2009, Phoenix Park, 15 February 2009 through 18 February 2009 ; Volume 3 , 2009 , Pages 2054-2058 ; 17389445 (ISSN); 9788955191387 (ISBN) Omidyeganeh, M ; Ghaemmagham, S ; Khalilain, H ; IEEE Communications Society, IEEE ComSoc; IEEE Region 10 and IEEE Daejeon Section; Korean Institute of Communication Sciences, KICS; lEEK Communications Society, IEEK ComSoc; Korean Institute of Information Scientists and Engineers, KIISE; et al ; Sharif University of Technology
    2009
    Abstract
    A video activity analysis is presented based on 3D wavelet transform. Marginal and joint statistics as well as mutual information estimates are extracted. Marginal histograms are approximated by Generalized Gaussian Density (GGD) functions. The mutual information between coefficients -as a quantitative estimate of joint statistics- decreases when the activity in the video increases. The relationship between kurtosis graphs, extracted from joint distributions and video activity, is deduced. Results show that the type of activity in the video can be figured out from Kurtosis curves. The GGD and the Kullback-Leibler distance (KLD) are used to retrieve and locate 96% of videos properly  

    A comparative study of mutual information analysis under a Gaussian assumption

    , Article Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 25 August 2009 through 27 August 2009, Busan ; Volume 5932 LNCS , 2009 , Pages 193-205 ; 03029743 (ISSN) ; 3642108377 (ISBN) Moradi, A ; Mousavi, N ; Paar, C ; Salmasizadeh, M ; Sharif University of Technology
    Abstract
    In CHES 2008 a generic side-channel distinguisher, Mutual Information, has been introduced to be independent of the relation between measurements and leakages as well as between leakages and data processed. Assuming a Gaussian model for the side-channel leakages, correlation power analysis (CPA) is capable of revealing the secrets efficiently. The goal of this paper is to compare mutual information analysis (MIA) and CPA when leakage of the target device fits into a Gaussian assumption. We first theoretically examine why MIA can reveal the correct key guess amongst other hypotheses, and then compare it with CPA proofs. As our theoretical comparison confirms and shown recently in ACNS 2009... 

    Blind separation of bilinear mixtures using mutual information minimization

    , Article Machine Learning for Signal Processing XIX - Proceedings of the 2009 IEEE Signal Processing Society Workshop, MLSP 2009, 2 September 2009 through 4 September 2009, Grenoble ; 2009 ; 9781424449484 (ISBN) Mokhtari, F ; Babaie Zadeh, M ; Jutten, C ; Sharif University of Technology
    Abstract
    In this paper an approach for blind source separation in bilinear (or linear quadratic) mixtures is presented. The proposed algorithm employs the same recurrent structure as [Hosseini and Deville, 2003) for separating these mixtures . However, instead of maximal likelihood, our algorithm is based on minimizing the mutual information of the outputs for recovering the independent components. Simulation results show the efficiency of the proposed algorithm. © 2009 IEEE  

    A correlation measure based on vector-valued Lp norms

    , Article 2019 IEEE International Symposium on Information Theory, ISIT 2019, 7 July 2019 through 12 July 2019 ; Volume 2019-July , 2019 , Pages 1132-1136 ; 21578095 (ISSN); 9781538692912 (ISBN) Mojahedian, M. M ; Beigi, S ; Gohari, A ; Yassaee, M. H ; Aref, M. R ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2019
    Abstract
    In this paper, a new measure of correlation is introduced. This measure depends on a parameter α, and is defined in terms of vector-valued Lp norms. The measure is within a constant of the exponential of α-Rényi mutual information, and reduces to the trace norm (total variation distance) for α = 1. We provide some properties and applications of this measure of correlation. In particular, we establish a bound on the secrecy exponent of the wiretap channel (under the total variation metric) in terms of the α-Rényi mutual information according to Csiszár's proposal. © 2019 IEEE