Sharif Digital Repository

Content-based image retrieval (CBIR) has turned into an important and active potential research field with the advance of multimedia and imaging technology. It makes use of image features, such as color, texture and shape, to index images with minimal human intervention. A CBIR system can be used to locate medical images in large databases. In this paper we propose a CBIR system which describes the methodology for retrieving digital human brain magnetic resonance images (MRI) based on textural features and the Adaptive neuro-fuzzy inference system (ANFIS) learning to retrieve similar images from database in two categories: normal and tumoral. A fuzzy classifier has been used, because of the... 

In this paper, we propose a mapping from low level feature space to the semantic space drawn by the users through relevance feedback to enhance the performance of current content based image retrieval (CBIR) systems. The proposed approach makes a rule base for its inference and configures it using the feedbacks gathered from users during the life cycle of the system. Each rule makes a hypercube (HC) in the feature space corresponding to a semantic concept in the semantic space. Both short and long term strategies are taken to improve the accuracy of the system in response to each feedback of the user and gradually bridge the semantic gap. A scoring paradigm is designed to determine the... 

In this paper we propose a method for CBIR based on the combination of texture, edge map and color. As texture of edges yields important information about the images, we utilized an adaptive edge detector that produces a binary edge image. Also, using the statistics of color in two different color spaces provides complementary information to retrieve images. Our method is time efficient since we have applied texture calculations on the binary edge image. Our experimental results showed both the higher accuracy and lower time complexity of our method with similar related works using SIMPLIcity database  

Automatic image annotation is a challenging problem in the field of image retrieval. Dealing with large databases makes the annotation problem more difficult and therefore an effective approach is needed to manage such databases. In this work, an annotation system has been developed which considers images in separate categories and constructs a profiling model for each category. To describe an image, we propose a new feature extraction method based on color and texture information that describes image content using discrete distribution signatures. Image signatures of one category are partitioned using spectral clustering and a prototype is determined for each cluster by solving an... 

Active learning has been a popular area of research in recent years. It can be used to improve the performance of learning tasks by asking the labels of unlabeled data from the user. In these methods, the goal is to achieve the highest possible accuracy gain while posing minimum queries to the user. The existing approaches for active learning have been mostly applicable to the traditional binary or multi-class classification problems. However, in many real-world situations, we encounter problems in which we have access only to samples of one class. These problems are known as one-class learning or outlier detection problems and the User relevance feedback in image retrieval systems is an... 

To reduce the semantic gap in the content based image retrieval (CBIR) systems we propose a fuzzy rule base approach. By submitting a query to the proposed system, it first extracts its low-level features and then checks its rule base for determining the proper weight vector for its distance measure. It then uses this weight vector to determine what images are more similar to the query image. For the training purpose, an algorithm is provided by which the system adjusts its fuzzy rules' parameters by gathering the trainers' opinions on which and how much the image pairs are relevant. For further improving the performance of the system, a feature space dimensionality reduction method is also... 

A probabilistic formulation for semantic image annotation and retrieval is proposed. Annotation and retrieval are posed as classification problems where each class is defined as the group of database images labeled with a common semantic label. It is shown that, by establishing this one-to-one correspondence between semantic labels and semantic classes, a minimum probability of error annotation and retrieval are feasible with algorithms that are 1) conceptually simple and 2) computationally efficient. In this article, a content-based image retrieval and annotation architecture is proposed. Its attitude is decreasing the semantic gap by partitioning the image to its semantic regions and using... 

In recent years there has been a great effort to enhance the computer-aided diagnosis systems, since proven similar pathologies, in the past, plays an important role in diagnosis of the current cases, content based medical image retrieval has been emerged. In this work we have designed a decision making machine in which utilizes sparse representation technique to preserve semantic category relevance among the retrieved images and the query image, this machine comprises optimized wavelets (adapted using lifting scheme) to extract appropriate visual features in order to grasp visual content of the images, afterwards by using some classical methods, Raw data vectors become applicable for sparse... 

To enable a relevance feedback paradigm to evolve itself by users' feedback, a reinforcement learning method is proposed. The feature space of the medical images is partitioned into positive and negative hypercubes by the system. Each hypercube constitutes an individual in a genetic algorithm infrastructure. The rules take recombination and mutation operators to make new rules for better exploring the feature space. The effectiveness of the rules is checked by a scoring method by which the ineffective rules will be omitted gradually and the effective ones survive. Our experiments on a set of 10,004 images from the IRMA database show that the proposed approach can better describe the semantic... 

Image registration is an important task in medical image processing. Assuming spatially stationary intensity relation among images, conventional area based algorithms such as CC (Correlation Coefficients) and MI (Mutual Information), show weaker results alongside spatially varying intensity distortion. In this research, a structural representation of images is introduced. It allows us to use simpler similarity metrics in multimodal images which are also robust against the mentioned distortion field. The efficiency of this presentation in non-rigid image registration in the presence of spatial varying distortion field is examined. Experimental results on synthetic and real-world data sets... 

Nowadays, the number of digital images has increased so that the management of this volume of data needs an efficient system for browsing, categorising and searching. Automatic image annotation is designed for assigning tags to images for more accurate retrieval. Non-negative matrix factorisation (NMF) is a traditional machine learning technique for decomposing a matrix into a set of basis and coefficients under the non-negative constraints. In this study, the authors propose a two-step algorithm for designing an automatic image annotation system that employs the NMF framework for its first step and a variant of K-nearest neighbourhood as its second step. In the first step, a new multimodal... 

We present an Autoregressive (AR) modeling method for video signal analysis based on 2D Wavelet Statistics. The video signal is assumed to be a combination of spatial feature time series that are temporally approximated by the AR model. The AR model yields a linear approximation to the temporal evolution of a stationary stochastic process. Generalized Gaussian Density (GGD) parameters, extracted from 2D wavelet transform subbands, are used as the spatial features. Wavelet transform efficiently resembles the Human Visual System (HVS) characteristics and captures more suitable features, as compared to color histogram features. The AR model describes each spatial feature vector as a linear... 

Since expertise elicited from past resolved cases plays an important role in medical application and images acquired from various cases have a great contribution to diagnosis of the abnormalities, Content based medical image retrieval has become an active research area for many scientists, In this article we proposed a new framework to retrieve visually similar images from a large database, in which visual relevance is regarded as much as the semantic category similarity, we used optimized wavelet transform as the multi-resolution analysis of the images and extracted various statistical SGLDM features from different resolutions then after reducing feature space we used error correcting codes... 

Recently many works focus on the vehicle type recognition because it is important in security and authentication systems. Computational complexity and low recognition rate especially when the system has to recognize among a large number of vehicles, are two major problems in vehicle type recognition. In recent years wavelet and contourlet transform have been applied in the recognition tasks successfully. In this paper we proposed a method for recognizing vehicle type in different lighting conditions. We used wavelet and contourlet as tools for feature extraction. These features are powerful and robust to illumination and scale variation. We reduced the dimension of feature vector by resizing... 

Searching large image databases is a time consuming process when done manually. Current CBIR methods mostly rely on training data in specific domains. When source and domain of images are unknown, unsupervised methods provide better solutions. In this work, we use a hierarchical clustering scheme to group images in an unknown and large image database. In addition, the user should provide the current class assignment of a small number of images as a feedback to the system. The proposed method uses this feedback to guess the number of required clusters, and optimizes the weight vector in an iterative manner. In each step, after modification of the weight vector, the images are reclustered. We... 

In visual surveillance, detecting and localising abnormal events are of great interest. In this study, an unsupervised method is proposed to automatically discover abnormal events occurring in traffic videos. For learning typical motion patterns occurring in such videos, a group sparse topical coding (GSTC) framework and an improved version of it are applied to optical flow features extracted from video clips. Then a very simple and efficient algorithm is proposed for GSTC. It is shown that discovered motion patterns can be employed directly in detecting abnormal events. A variety of abnormality metrics based on the resulting sparse codes for detection of abnormality are investigated.... 

Discriminative subspace analysis is a popular approach for a variety of applications. There is a growing interest in subspace learning techniques for face recognition. Principal component analysis (PCA) and eigenfaces are two important subspace analysis methods have been widely applied in a variety of areas. However, the excessive dimension of data space often causes the curse of dimensionality dilemma, expensive computational cost, and sometimes the singularity problem. In this paper, a new supervised discriminative subspace analysis is presented by encoding face image as a high order general tensor. As face space can be considered as a nonlinear submanifold embedded in the tensor space, a... 

In automatic image annotation (AIA) different features describe images from different aspects or views. Part of information embedded in some views is common for all views, while other parts are individual and specific. In this paper, we present the Mvg-NMF approach, a multi-view-group non-negative matrix factorization (NMF) method for an AIA system which considers both common and individual factors. The NMF framework discovers a latent space by decomposing data into a set of non-negative basis vectors and coefficients. The views divided into homogeneous groups and latent spaces are extracted for each group. After mapping the test images into these spaces, a unified distance matrix is... 

Automatic Image Annotation (AIA) helps image retrieval systems by predicting tags for images. In this paper, we propose an AIA system using Non-negative Matrix Factorization (NMF) framework. The NMF framework discovers a latent space, by factorizing data into a set of non-negative basis and coefficients. To model the images, multiple features are extracted, each one represents images from a specific view. We use multi-view graph regularization NMF and allow NMF to choose a different number of basis vectors for each view. For tag prediction, each test image is mapped onto the multiple latent spaces. The distances of images in these spaces are used to form a unified distance matrix. The... 

In many real-world applications, data contain heterogeneous input modalities (e.g., web pages include images, text, etc.). Moreover, data such as images are usually described using different views (i.e. different sets of features). Learning a distance metric or similarity measure that originates from all input modalities or views is essential for many tasks such as content-based retrieval ones. In these cases, similar and dissimilar pairs of data can be used to find a better representation of data in which similarity and dissimilarity constraints are better satisfied. In this paper, we incorporate supervision in the form of pairwise similarity and/or dissimilarity constraints into...