Sharif Digital Repository

Background: Type-2 diabetes mellitus is characterized by insulin resistance and impaired insulin secretion in the human body. Many endeavors have been made in terms of controlling and reducing blood glucose via the medium of automated controlling tools to increase precision and efficiency and reduce human error. Recently, reinforcement learning algorithms are proved to be powerful in the field of intelligent control, which was the motivation for the current study. Methods: For the first time, a reinforcement algorithm called normalized advantage function (NAF) algorithm has been applied as a model-free reinforcement learning method to regulate the blood glucose level of type-2 diabetic... 

By generalising dictionary learning (DL) algorithms to multidimensional (MD) mode and using them in applications where signals are inherently multidimensional, such as in three-dimensional (3D) inverse synthetic aperture radar (ISAR) imaging, it is possible to achieve much higher speed and less computational complexity. In this study, the formulation of the multidimensional dictionary learning (MDDL) problem is expressed and two algorithms are proposed to solve it. The first one is based on the method of optimum directions (MOD) algorithm for 1D dictionary learning (1DDL), which uses alternating minimisation and gradient projection approach. As the MDDL problem is non-convex, the second... 

In this paper, a target parameter estimation problem is addressed for the recently emerging frequency diverse array multiple-input multiple-output (FDA-MIMO) radar system, utilizing sparse learning. The scene is modeled as a two dimensional (2D) angle-incremental range grid. To solve the resulting sparse problem, the recently proposed user-parameter free algorithms including block sparse learning via iterative minimization (BSLIM), iterative adaptive approach (IAA), sparse iterative covariance-based estimation (SPICE), likelihood-based estimation of sparse parameters (LIKES), and orthogonal matching pursuit (OMP) are applied which achieve excellent parameter estimation performance. However,... 

We study the problem of experiment design to learn causal structures from interventional data. We consider an active learning setting in which the experimenter decides to intervene on one of the variables in the system in each step and uses the results of the intervention to recover further causal relationships among the variables. The goal is to fully identify the causal structures with minimum number of interventions. We present the first deep reinforcement learning based solution for the problem of experiment design. In the proposed method, we embed input graphs to vectors using a graph neural network and feed them to another neural network which outputs a variable for performing... 

Increasing usage of Solid-State Drives (SSDs) has greatly boosted the performance of storage backends. SSDs perform many internal processes such as out-of-place writes, wear-leveling, and garbage collection. These operations are complex and not well documented which make it difficult to create accurate SSD simulators. Our survey indicates that aside from complex configuration, available SSD simulators do not support both sync and discard requests. Past performance models also ignore the long term effect of I/O requests on SSD performance, which has been demonstrated to be significant. In this article, we utilize a methodology based on machine learning that extracts history-aware features at... 

The growing environmental concerns, governmental regulations, and significant cost savings are the primary motivations for companies to consider the reuse and recovery of products in their inventory system. The previous research ignored several realistic features of reusable items inventory systems, such as the presence of multiple products and operational constraints. For the first time, this paper presents a new multiproduct economic order quantity inventory model for an inventory system of reusable products. The goal of the model is to determine the optimal replenishment quantity and reuse quantity of each item so that the system's total cost is minimized. Several operational constraints... 

Tomato is an agricultural product of great economic importance because it is one of the most consumed vegetables in the world. The most crucial chemical element for the growth and development of tomato is nitrogen (N). However, incorrect nitrogen usage can alter the quality of tomato fruit, rendering it undesirable to customers. Therefore, the goal of the current study is to investigate the early detection of excess nitrogen application in the leaves of the Royal tomato variety using a non-destructive hyperspectral imaging system. Hyperspectral information in the leaf images at different wavelengths of 400–1100 nm was studied; they were taken from different treatments with normal nitrogen... 

The rapid growth in the supply chain of electronic devices has led companies to purchase Intellectual Property or Integrated Circuits from unreliable sources. This dispersion in the design to fabrication stages of IP/IC has led to new attacks called hardware Trojans. Hardware Trojans can bargain information, reduce performance, or cause failure. Various methods have been introduced to detect or prevent hardware Trojans. Machine learning methods are one of these. Selecting the type and number of input variables in the learning algorithm has an important role in the performance of the learning model. Some previous hardware Trojan detection studies have used structural gate-level features to... 

This brief proposes a joint graph signal recovery and topology learning algorithm using a Variational Bayes (VB) framework in the case of non-Gaussian measurement noise. It is assumed that the graph signal is Gaussian Markov Random Field (GMRF) and the graph weights are considered statistical with the Gaussian prior. Moreover, the non-Gaussian noise is modeled using two distributions: Mixture of Gaussian (MoG), and Laplace. All the unknowns of the problem which are graph signal, Laplacian matrix, and the (Hyper)parameters are estimated by a VB framework. All the posteriors are calculated in closed forms and the iterative VB algorithm is devised to solve the problem. The efficiency of the... 

Software repositories such as GitHub host a large number of software entities. Developers collaboratively discuss, implement, use, and share these entities. Proper documentation plays an important role in successful software management and maintenance. Users exploit Issue Tracking Systems, a facility of software repositories, to keep track of issue reports, to manage the workload and processes, and finally, to document the highlight of their team’s effort. An issue report is a rich source of collaboratively-curated software knowledge, and can contain a reported problem, a request for new features, or merely a question about the software product. As the number of these issues increases, it... 

Reinforcement learning methods such as Q-learning have shown promising results in the model-free design of linear quadratic regulator (LQR) controllers for linear time-invariant (LTI) systems. However, challenges such as sample-efficiency, sensitivity to hyper-parameters, and compatibility with classical control paradigms limit the integration of such algorithms in critical control applications. This paper aims to take some steps towards bridging the well-known classical control requirements and learning algorithms by using optimization frameworks and properties of conic constraints. Accordingly, a new off-policy model-free approach is proposed for learning the Q-function and designing the... 

This paper adopts a holistic approach to stress detection issues in software and hardware phases and aims to develop and evaluate a specific low-power and low-cost sensor using physiological signals. First, a stress detection model is presented using a public data set, where four types of signals, temperature, respiration, electrocardiogram (ECG), and electrodermal activity (EDA), are processed to extract 65 features. Using Kruskal-Wallis analysis, it is shown that 43 out of 65 features demonstrate a significant difference between stress and relaxed states. K nearest neighbor (KNN) algorithm is implemented to distinguish these states, which yields a classification accuracy of 96.0 ± 2.4%. It... 

Demand forecasting has always been a concern for business owners as one of the main activities in supply chain management. Unlike the past, that forecasting was done with the help of a limited amount of information, today, using advanced technologies and data analytics, forecasting is performed with machine learning algorithms and data-driven methods. Patterns and trends of demand, customer information, preferences, suggestions, and post-consumption feedbacks are some types of data that are used in various demand forecasting efforts. Traditional statistical methods and techniques are biased in demand prediction and are not accurate; so, machine learning algorithms as more popular techniques... 

Ground granulated blast furnace slag is a sustainable material and supplementary for cement in the concrete industry. Different behavioral aspects must be assessed to achieve reliable sustainable materials, including post-fire mechanical properties. One robust tool is the machine learning approach to train prediction models. This study proposes a novel machine learning algorithm, hybrid support vector regression and dolphin echolocation algorithm (SVR-DE), to predict the post-fire compressive strength ratio of slag-based concrete. In this regard, SVR hyper-parameters were tuned by the DE optimization algorithm. Four kernel functions were implemented in SVR formulation: linear, sigmoid,... 

To understand how aerial accidents occur, the installation of flight data recorders (FDR) and cockpit voice recorders (CVR) have become mandatory by law. However, such devices play a passive role and are used once an accident has occurred. Recent advances in machine learning techniques and their application in solving engineering problems are the keys to creating a more active role for both FDR as well as CVR. Here, we investigate a new approach to bringing intelligence to an FDR (called I-FDR). Through a continuous data-mining process, an I-FDR could bring better situational awareness to the flight crew. An I-FDR, similar to the FDR, records all pertinent flying parameters. In addition,... 

Vehicular edge computing is a progressing technology which provides processing resources to the internet of vehicles using the edge servers deployed at roadside units. Vehicles take advantage by offloading their computationintensive tasks to this infrastructure. However, concerning time-sensitive applications and the high mobility of vehicles, cost-efficient task offloading is still a challenge. This paper establishes a computation offloading strategy based on deep Q-learning algorithm for vehicular edge computing networks. To jointly minimize the system cost including offloading failure rate and the total energy consumption of the offloading process, the vehicle tasks offloading problem is... 

This letter develops an adaptive actuator failure compensation method for nonlinear systems with unmatched parametric uncertainty based on contraction metrics. The proposed method, which is constructed by benefiting from the recent achievements on contraction metrics based adaptive control techniques, ensures the closed-loop stability and asymptotic tracking of the desired trajectory in the presence of actuator failures. In particular, a sufficient convex condition is derived for constructing a valid metric, by which a quadratic program-based controller is obtained to determine the inputs of the actuators. The introduced method is more general than the common adaptive actuator failure... 

Algorithmic trading based on machine learning is a developing and promising field of research. Financial markets have a complex, uncertain, and dynamic nature, making them challenging for trading. Some financial theories, such as the fractal market hypothesis, believe that the markets behave based on the collective psychology of investors who trade with different investment horizons and interpretations of information. Accordingly, a multi-agent deep reinforcement learning framework is proposed in this paper to trade on the collective intelligence of multiple agents, each of which is an expert trader on a specific timeframe. The proposed framework works in a hierarchical structure in which... 

Glioma is a common type of tumor that develops in the brain. Due to many differences in the shape and appearance, accurate segmentation of glioma for identifying all parts of the tumor and its surrounding tissues in cancer detection is a challenging task in cancer detection. In recent researches, the combination of atlas-based segmentation and machine learning methods have presented superior performance over other automatic brain MRI segmentation algorithms. To overcome the side effects of limited existing information on atlas-based segmentation, and the long training and the time consuming phase of learning methods, we proposed a semi-supervised learning framework by introducing a... 

The spatiotemporal dynamic of salinity concentration (SC) in saline lakes is strongly dependent on the rate of water flow into the lake, water circulation, wind speed, evaporation rate, and the phenomenon of salt precipitation and dissolution. Although in-situ observations most reliably quantify water quality metrics, the spatiotemporal distribution of such data are typically limited and cannot be readily extrapolated for either long-term projections or extensive areas. Alternatively, remotely sensed imagery has facilitated less expensive and a stronger ability to estimate water quality over a wide range of spatiotemporal resolutions. This study introduces an adaptive learning model that...