Loading...
Search for:
outlier
0.009 seconds
Total 29 records
Rigorous modeling of gypsum solubility in Na-Ca-Mg-Fe-Al-H-Cl-H2O system at elevated temperatures
, Article Neural Computing and Applications ; Volume 25, Issue 3 , September , 2014 , pp 955-965 ; ISSN: 09410643 ; Gharagheizi, F ; Lemraski, A. S ; Jamialahmadi, M ; Mohammadi, A. H ; Ebrahimi, M ; Sharif University of Technology
Abstract
Precipitation and scaling of calcium sulfate have been known as major problems facing process industries and oilfield operations. Most scale prediction models are based on aqueous thermodynamics and solubility behavior of salts in aqueous electrolyte solutions. There is yet a huge interest in developing reliable, simple, and accurate solubility prediction models. In this study, a comprehensive model based on least-squares support vector machine (LS-SVM) is presented, which is mainly devoted to calcium sulfate dihydrate (or gypsum) solubility in aqueous solutions of mixed electrolytes covering wide temperature ranges. In this respect, an aggregate of 880 experimental data were gathered from...
An algorithm for discovering clusters of different densities or shapes in noisy data sets
, Article Proceedings of the ACM Symposium on Applied Computing ; March , 2013 , Pages 144-149 ; 9781450316569 (ISBN) ; Hosseini, M. J ; Abin, A. A ; Beigy, H ; Sharif University of Technology
2013
Abstract
In clustering spatial data, we are given a set of points in Rn and the objective is to find the clusters (representing spatial objects) in the set of points. Finding clusters with different shapes, sizes, and densities in data with noise and potentially outliers is a challenging task. This problem is especially studied in machine learning community and has lots of applications. We present a novel clustering technique, which can solve mentioned issues considerably. In the proposed algorithm, we let the structure of the data set itself find the clusters, this is done by having points actively send and receive feedbacks to each other. The idea of the proposed method is to transform the input...
SC-RANSAC: spatial consistency on RANSAC
, Article Multimedia Tools and Applications ; 2018 ; 13807501 (ISSN) ; Hekmatian, H ; Kashani Nezhad, M. A ; Kasaei, S ; Sharif University of Technology
Springer New York LLC
2018
Abstract
The goal of robust parameter estimation is developing a model which can properly fit to data. Parameter estimation of a geometric model, in presence of noise and error, is an important step in many image processing and computer vision applications. As the random sample consensus (RANSAC) algorithm is one of the most well-known algorithms in this field, there have been several attempts to improve its performance. In this paper, after giving a short review on existing methods, a robust and efficient method that detects the gross outliers to increase the inlier to outlier ratio in a reduced set of corresponding image points is proposed. It has a new hypothesis and verification scheme which...
SC-RANSAC: Spatial consistency on RANSAC
, Article Multimedia Tools and Applications ; Volume 78, Issue 7 , 2019 , Pages 9429-9461 ; 13807501 (ISSN) ; Hekmatian, H ; Kashani Nezhad, M. A ; Kasaei, S ; Sharif University of Technology
Springer New York LLC
2019
Abstract
The goal of robust parameter estimation is developing a model which can properly fit to data. Parameter estimation of a geometric model, in presence of noise and error, is an important step in many image processing and computer vision applications. As the random sample consensus (RANSAC) algorithm is one of the most well-known algorithms in this field, there have been several attempts to improve its performance. In this paper, after giving a short review on existing methods, a robust and efficient method that detects the gross outliers to increase the inlier to outlier ratio in a reduced set of corresponding image points is proposed. It has a new hypothesis and verification scheme which...
Graph-Based Outlier Detection
, M.Sc. Thesis Sharif University of Technology ; Daneshgar, Amir (Supervisor)
Abstract
One of the most heatedly debated issues in Computer Science is Outlier Detection due to its vast and substantial applications such as credit cards, Image Processing,tax fraud detection, and medical approaches. Consequently, Outlier detection has been researched within various domains and knowledge disciplines. On the other hand, the research attempts have not been sufficient to overcome this critical problem considerably inasmuch as nearly all proposed techniques are associated with a special kind of applications or datasets.Firstly, this thesis attempts to provide a precise definition which not only excludes other one’s drawbacks, but also has its distinctive merits. Three essential...
An intelligent modeling approach for prediction of thermal conductivity of CO2
, Article Journal of Natural Gas Science and Engineering ; Volume 27 , November , 2015 , Pages 138-150 ; 18755100 (ISSN) ; Esmaili, S ; Rashid, S ; Suleymani, M ; Sharif University of Technology
Elsevier
2015
Abstract
In the design of a carbon dioxide capture and storage (CCS) process, the thermal conductivity of carbon dioxide is of special concern. Hence, it is quite important to search for a quick and accurate determination of thermal conductivity of CO2 for precise modeling and evaluation of such a process. To achieve this aim, a robust computing methodology, entitled least square support vector machine (LSSVM) modeling, which is coupled with an optimization approach, was used to model this transport property. The model was constructed and evaluated employing a comprehensive data bank (more than 550 data series) covering wide ranges of pressures and temperatures. Before constructing the model, outlier...
Robust Clustering Using Outlier-Sparsity Regularization
, M.Sc. Thesis Sharif University of Technology ; Daneshgar, Amir (Supervisor)
Abstract
Although clustering algorithms such as k-means and probabilistic clustering are quite popular and widely used nowadays, their performance are too sensitive to the presence of outliers where Even few outliers can compromise the ability of these algorithms to extract hidden data substructures. In this thesis, after going through the basics of some optimization methods such as BCD, EM, and MM, in Section 2 and a review of relevant clustering methods in Section 3, we explore the results of [Forero, et al., Robust clustering using outlier-sparsity regularization. IEEE Trans. Signal Process. (60), 2012] in Sections 4 and 5 where the outliers are handled by introducing a regularization term in the...
Sparse based similarity measure for mono-modal image registration
, Article Iranian Conference on Machine Vision and Image Processing, MVIP ; Sept , 2013 , Pages 462-466 ; 21666776 (ISSN) ; 9781467361842 (ISBN) ; Fatemizadeh, E ; Sharif University of Technology
IEEE Computer Society
2013
Abstract
Similarity measure is an important key in image registration. Most traditional intensity-based similarity measures (e.g., SSD, CC, MI, and CR) assume stationary image and pixel by pixel independence. Hence, perfect image registration cannot be achieved especially in presence of spatially-varying intensity distortions and outlier objects that appear in one image but not in the other. Here, we suppose that non stationary intensity distortion (such as Bias field or Outlier) has sparse representation in transformation domain. Based on this as-sumption, the zero norm (ℓ0)of the residual image between two registered images in transform domain is introduced as a new similarity measure in presence...
Phase-I robust parameter estimation of simple linear profiles in multistage processes
, Article Communications in Statistics: Simulation and Computation ; 2019 ; 03610918 (ISSN) ; Akhavan Niaki, T ; Sharif University of Technology
Taylor and Francis Inc
2019
Abstract
This paper addresses the problem of robust parameter estimation of simple linear profiles in multistage processes in the presence of outliers in Phase I. In this regard, two robust approaches, namely the Huber’s M-estimator and the MM estimator, are proposed to estimate the parameters of the process in Phase I in the presence of outliers in historical data. In addition, the U statistic is applied to the robust parameter estimates to remove the effect of the cascade property in multistage processes and as a result, to obtain adjusted robust estimates of the parameters of simple linear profiles. The performance of the proposed methods is evaluated under weak and strong autocorrelations...
Phase-I robust parameter estimation of simple linear profiles in multistage processes
, Article Communications in Statistics: Simulation and Computation ; 2019 ; 03610918 (ISSN) ; Akhavan Niaki, S. T ; Sharif University of Technology
Taylor and Francis Inc
2019
Abstract
This paper addresses the problem of robust parameter estimation of simple linear profiles in multistage processes in the presence of outliers in Phase I. In this regard, two robust approaches, namely the Huber’s M-estimator and the MM estimator, are proposed to estimate the parameters of the process in Phase I in the presence of outliers in historical data. In addition, the U statistic is applied to the robust parameter estimates to remove the effect of the cascade property in multistage processes and as a result, to obtain adjusted robust estimates of the parameters of simple linear profiles. The performance of the proposed methods is evaluated under weak and strong autocorrelations...
An Outlier Detection and Cleaning Algorithm in Classification Applications
, M.Sc. Thesis Sharif University of Technology ; Beigy, Hamid (Supervisor)
Abstract
Increasing information in real world needs the special instrument for data saving, cleaning and processing. Data cleaning is so important steps in machine learning application that include various kind of procedures such as, duplicate detection, fill out missing value and outlier detection. Outliers are observation, which deviates so much from other observations as to arouse suspicions that it was generated by a different mechanism. Many researches has been carried out in the machine learning field with regards to the outlier detection that has applications in real world, like: Intrusion detection for network security, fraud detection in credit cards, fault detection for security in critical...
Approximating k-Center with Outliers in the Sliding Window Model
, M.Sc. Thesis Sharif University of Technology ; Zarrabi Zadeh, Hamid (Supervisor)
Abstract
With the emergence of massive datasets, storing all of the data in memory is not feasible for many problems. This fact motivated the introduction of new data processing models such as the streaming model. In this model, data points arrive one by one and the available memory is too small to store all of the data points. For many problems, more recent data points are more important than the old ones. The sliding window model captures this fact by trying to find the solution for the n most recent data points using only o(n) memory. The k-center problem is an important optimization problem in which given a graph, we are interested in labeling k vertices of the graph as centers such that the...
Pupil Detection and Eye Tracking
, M.Sc. Thesis Sharif University of Technology ; Babaie Zadeh, Massoud (Supervisor)
Abstract
About a century, “Eye Tracking” has been studied, and it has two definitions: • The process of measuring the point of gaze (where one is looking). • The process of measuring the motion of an eye relative to the head. Eye tracking technology has been used in many fields such as psychology. However, applications of this technology has been recently considered in marketing, computer interfacing, entertainment, training and so forth. Since pupil is a distinc area in eye images, pupil detection is one of the effective solutions of eye tracking. In most of the pupil detection approaches, the edge points of the pupil contour are detected firstly, and then the optimal ellipse is fitted to them....
Clustering and outlier detection using isoperimetric number of trees
, Article Pattern Recognition ; Volume 46, Issue 12 , December , 2013 , Pages 3371-3382 ; 00313203 (ISSN) ; Javadi, R ; Shariat Razavi, S. B ; Sharif University of Technology
2013
Abstract
We propose a graph-based data clustering algorithm which is based on exact clustering of a minimum spanning tree in terms of a minimum isoperimetry criteria. We show that our basic clustering algorithm runs in O(nlogn) and with post-processing in almost O(nlogn) (average case) and O(n2) (worst case) time where n is the size of the data-set. It is also shown that our generalized graph model, which also allows the use of potentials at vertices, can be used to extract an extra piece of information related to anomalous data patterns and outliers. In this regard, we propose an algorithm that extracts outliers in parallel to data clustering. We also provide a comparative performance analysis of...
Robust Huber similarity measure for image registration in the presence of spatially-varying intensity distortion
, Article Signal Processing ; Volume 109 , April , 2015 , Pages 54-68 ; 01651684 (ISSN) ; Fatemizadeh, E ; Sharif University of Technology
Elsevier
2015
Abstract
Similarity measure is an important part of image registration. The main challenge of similarity measure is lack of robustness to different distortions. A well-known distortion is spatially-varying intensity distortion. Its main characteristic is correlation among pixels. Most traditional intensity based similarity measures (e.g., SSD, MI) assume stationary image and pixel to pixel independence. Hence, these similarity measures are not robust against spatially-varying intensity distortion. Here, we suppose that non-stationary intensity distortion has a sparse representation in transform domain, i.e. its distribution has high peak at origin and a long tail. We use two viewpoints of Maximum...
A streaming algorithm for 2-center with outliers in high dimensions
, Article Computational Geometry: Theory and Applications ; Volume 60 , 2017 , Pages 26-36 ; 09257721 (ISSN) ; Zarrabi Zadeh, H ; Sharif University of Technology
Abstract
We study the 2-center problem with outliers in high-dimensional data streams. Given a stream of points in arbitrary d dimensions, the goal is to find two congruent balls of minimum radius covering all but at most z points. We present a (1.8+ε)-approximation streaming algorithm, improving over the previous (4+ε)-approximation algorithm available for the problem. The space complexity and update time of our algorithm are poly(d,z,1/ε), independent of the size of the stream. © 2016 Elsevier B.V
Multi-Resolution Denoising of Well Test Data
, Ph.D. Dissertation Sharif University of Technology ; Soltanieh, Mohammad (Supervisor) ; Farhadpour, Farhad Ali (Co-Advisor)
Abstract
Permanent Downhole Gauge (PDG) has been employed since 1990s to acquire more information and better access to well and control production. PDG provides huge amount of pressure transient data during well test operation and production. However, such data are encountering with various noise and outliers. The noise and outliers can cause misleading and misinterpretation results. Therefore, denoising and outlier removal are two imperative steps before pressure transient analysis. The conventional denoising methods are mostly based on wavelet thresholding methods that preserve mean of data and have good performance when noise distribution is Gaussian distribution. However, noise distribution...
Image Registration Using Graph-based Methods
, M.Sc. Thesis Sharif University of Technology ; Fatemizadeh, Emadeddin (Supervisor)
Abstract
Nowadays, image registration is considered as one of usual issues in medical researches whose new findings are expanding outstandingly and it has reached a high level of maturity. Generally speaking, image registration is a task to reliably estimate the geometric transformation such that two images can be precisely aligned. With respect to different uses of image registration in medical applications, it has attracted the attention of many scholars and there has been made significant improvement in this realm. Image registration is still one of the active branches in medical image processing due to its wide applications and problems. Graphs, thanks to their geometric structures and intuitive...
Developing Robust Image Similarity Measure in Feature Based Image Registration
, M.Sc. Thesis Sharif University of Technology ; Fatemizadeh, Emad (Supervisor)
Abstract
Image registration is an important preprocessing step in analysis of medical images. Detection, Treatment plan, disease grows process analysis and assistance in surgical applications are some of medical images applications. We need to be able to compare different modalities in medical images such as X-ray, PET, MRI, and CT... , or sometimes doctors need to take images of a patient in a same modality but in different times and directions. In which in order to be able to do theses comparisons we need to first align these images by using image registration methods. Image registration is an image processing method in which tries to find a geometrical transformation that would map different...
Towards Robust Anomaly Detectors by Fake Data Generation
, M.Sc. Thesis Sharif University of Technology ; Rohban, Mohammad Hossein (Supervisor)
Abstract
Detecting out-of-distribution (OOD) input samples at the inference time is a key element in the trustworthy deployment of intelligent models. While there has been a tremendous improvement in various flavors of OOD detection in recent years, the detection performance under adversarial settings lags far behind the performance in the standard setting. In order to bridge this gap, we introduce RODEO in this paper, a data-centric approach that generates effective outliers for robust OOD detection. More specifically, we first show that targeting the classification of adversarially perturbed in- and out-of-distribution samples through outlier exposure (OE) could be an effective strategy for the...