Loading...
Search for: convergence-rates
0.004 seconds
Total 42 records

    Theoretical analysis of flocking algorithms in networks of second order dynamic agents with switching topologies

    , Article Journal of Dynamic Systems, Measurement and Control, Transactions of the ASME ; Vol. 136, Issue 1 , 2014 ; ISSN: 00220434 Atrianfar, H ; Haeri, M ; Sharif University of Technology
    Abstract
    This paper deals with a refined analysis and modification of existing results on the flocking algorithms proposed for the second order dynamic agents. In the present work, the limiting condition of ever connectivity is removed and it is proved that the flocking can be reached if only the union of the network proximity graphs during nonoverlapping time intervals becomes connected frequently enough. Also, it is proved that including a static virtual leader cannot model the group objective of achieving the desired velocity and it will stop eventually at a predefined point in the space. The convergence rate to this fixed point is determined too. The last contribution of this paper is definition... 

    On the performance of polar codes for lossy compression of Gaussian sources

    , Article 2013 Iran Workshop on Communication and Information Theory, IWCIT 2013 ; 2013 ; 9781467350235 (ISBN) Eghbalian Arani, S ; Behroozi, H ; Sharif University of Technology
    2013
    Abstract
    In this work, we study the lossy source coding of a Gaussian source with polar codes. We show through two distributions on discrete alphabet, quantized approach as well as Central Limit Theorem (CLT) approach, when the alphabet size grows to infinity, polar codes can achieve the rate distortion bound for a Gaussian source. By comparing the rate of convergence on two distributions, we show that the quantized approach have a better convergence rate than the CLT approach  

    On exponential flocking to the virtual leader in network of agents with double-integrator dynamics

    , Article Journal of Dynamic Systems, Measurement and Control, Transactions of the ASME ; Volume 135, Issue 3 , 2013 ; 00220434 (ISSN) Jahromi, H. T ; Haeri, M ; Sharif University of Technology
    2013
    Abstract
    This paper considers flocking to the virtual leader in network of agents with double-integrator. A locally linear algorithm is employed which guarantees exponential flocking to the virtual leader. A lower bound for flocking rate is calculated which is independent of the initial conditions. Simulations are provided to validate the result and it is shown that the calculated rate is not over bound the actual convergence rate. The effect of coefficients of algorithm is investigated and it is shown that the similar results can be inferred from the calculated formula for the convergence rate. Copyright  

    A new algorithm for dictionary learning based on convex approximation

    , Article 27th European Signal Processing Conference, EUSIPCO 2019, 2 September 2019 through 6 September 2019 ; Volume 2019-September , 2019 ; 22195491 (ISSN); 9789082797039 (ISBN) Parsa, J ; Sadeghi, M ; Babaie Zadeh, M ; Jutten, C ; et al.; National Science Foundation (NSF); Office of Naval Research Global (ONR); Turismo A Coruna, Oficina de Informacion Turismo de A Coruna; Xunta de Galicia, Centro de Investigacion TIC (CITIC); Xunta de Galicia, Conselleria de Cultura, Educacion e Ordenacion Universitaria ; Sharif University of Technology
    European Signal Processing Conference, EUSIPCO  2019
    Abstract
    The purpose of dictionary learning problem is to learn a dictionary D from a training data matrix Y such that Y ≈ DX and the coefficient matrix X is sparse. Many algorithms have been introduced to this aim, which minimize the representation error subject to a sparseness constraint on X. However, the dictionary learning problem is non-convex with respect to the pair (D,X). In a previous work [Sadeghi et al., 2013], a convex approximation to the non-convex term DX has been introduced which makes the whole DL problem convex. This approach can be almost applied to any existing DL algorithm and obtain better algorithms. In the current paper, it is shown that a simple modification on that approach... 

    Efficiency of Spectral Gradient Method in Solving Optimization Problems

    , M.Sc. Thesis Sharif University of Technology Mirzaii, Mohammad (Author) ; Mahdavi Amiri, Nezamoddin (Supervisor)
    Abstract
    In a recent paper, Barzilai and Borwein presented a new choice of steplength for the gradient method. Their choice does not guarantee descent in the objective function and greatly speeds up the convergence of the method. Later, Raydan derived an interesting relationship between a gradient method and the shifted power method. This relationship allows one to establish the convergence of the Barzilai and Borwein method when applied to the problem of minimizing any strictly convex quadratic function. With this point of view, he explained the remarkable improvement obtained by using this new choice of steplength. For some special cases, he presented some very interesting convergence rate results.... 

    A First-Order Interior-Point Method For Linearly Constrained Smooth Optimization

    , M.Sc. Thesis Sharif University of Technology Ebadi Zadeh, Monireh (Author) ; Peyghami, Mohammad Reza (Supervisor) ; Fotouhi, Morteza (Supervisor)
    Abstract
    In this thesis, we propose a first-order interior-point method for linearly constrained smooth optimization which was recently proposed in the literatuare that unifies and extends first-order affine-scaling method and replicator dynamics method for standard quadratic programming. Global convergence and, in the case of quadratic program, the (sub)linear convergence rate and iterate convergence results are derived.The method is implemented and numerical experiments on simplex onstrained problems with 1000 variables is reported  

    A preconditioned euler flow solver for simulation of helicopter rotor flow in hover

    , Article Computational Fluid Dynamics 2010 - Proceedings of the 6th International Conference on Computational Fluid Dynamics, ICCFD 2010 ; 2011 , Pages 479-484 ; 9783642178832 (ISBN) Hejranfar, K ; Moghadam, R. K ; National Aeronautics and Space Administration; European Office for Aerospace Research and Development ; Sharif University of Technology
    Abstract
    In the present study, a preconditioned Euler flow solver is developed to accurately and efficiently compute the inviscid flowfield around hovering helicopter rotor. The preconditioning method proposed by Eriksson is applied. The three-dimensional preconditioned Euler equations written in a rotating coordinate frame are solved by using a cell-centered finite volume Roe's method on unstructured meshes. High-order accuracy is achieved via the reconstruction of flow variables using the MUSCL interpolation technique. Calculations are carried out for an isolated rotor in hover for different conditions and the computed surface pressure distributions are compared with the experimental data. The... 

    Accelerated dictionary learning for sparse signal representation

    , Article 13th International Conference on Latent Variable Analysis and Signal Separation, LVA/ICA 2017, 21 February 2017 through 23 February 2017 ; Volume 10169 LNCS , 2017 , Pages 531-541 ; 03029743 (ISSN); 9783319535463 (ISBN) Ghayem, F ; Sadeghi, M ; Babaie Zadeh, M ; Jutten, C ; Sharif University of Technology
    Springer Verlag  2017
    Abstract
    Learning sparsifying dictionaries from a set of training signals has been shown to have much better performance than pre-designed dictionaries in many signal processing tasks, including image enhancement. To this aim, numerous practical dictionary learning (DL) algorithms have been proposed over the last decade. This paper introduces an accelerated DL algorithm based on iterative proximal methods. The new algorithm efficiently utilizes the iterative nature of DL process, and uses accelerated schemes for updating dictionary and coefficient matrix. Our numerical experiments on dictionary recovery show that, compared with some well-known DL algorithms, our proposed one has a better convergence... 

    Accelerating federated edge learning

    , Article IEEE Communications Letters ; Volume 25, Issue 10 , 2021 , Pages 3282-3286 ; 10897798 (ISSN) Nguyen, T. D ; Balef, A. R ; Dinh, C. T ; Tran, N. H ; Ngo, D. T ; Anh Le, T ; Vo, P. L ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2021
    Abstract
    Transferring large models in federated learning (FL) networks is often hindered by clients' limited bandwidth. We propose $ extsf {FedAA}$ , an FL algorithm which achieves fast convergence by exploiting the regularized Anderson acceleration (AA) on the global level. First, we demonstrate that FL can benefit from acceleration methods in numerical analysis. Second, $ extsf {FedAA}$ improves the convergence rate for quadratic losses and improves the empirical performance for smooth and strongly convex objectives, compared to FedAvg, an FL algorithm using gradient descent (GD) local updates. Experimental results demonstrate that employing AA can significantly improve the performance of FedAvg,... 

    A unified optimization-based framework to adjust consensus convergence rate and optimize the network topology in uncertain multi-agent systems

    , Article IEEE/CAA Journal of Automatica Sinica ; Volume 8, Issue 9 , 2021 , Pages 1539-1548 ; 23299266 (ISSN) Sarafraz, M. S ; Tavazoei, M. S ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2021
    Abstract
    This paper deals with the consensus problem in an uncertain multi-agent system whose agents communicate with each other through a weighted undirected (primary) graph. The considered multi-agent system is described by an uncertain state-space model in which the involved matrices belong to some matrix boxes. As the main contribution of the paper, a unified optimization-based framework is proposed for simultaneously reducing the weights of the edges of the primary communication graph (optimizing the network topology) and synthesizing a controller such that the consensus in the considered uncertain multi-agent system is ensured with an adjustable convergence rate. Considering the NP-hardness... 

    Local graph clustering with network lasso

    , Article IEEE Signal Processing Letters ; Volume 28 , 2021 , Pages 106-110 ; 10709908 (ISSN) Jung, A ; Sarcheshmehpour, Y ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2021
    Abstract
    We study the statistical and computational properties of a network Lasso method for local graph clustering. The clusters delivered by nLasso can be characterized elegantly via network flows between cluster boundaries and seed nodes. While spectral clustering methods are guided by a minimization of the graph Laplacian quadratic form, nLasso minimizes the total variation of cluster indicator signals. As demonstrated theoretically and numerically, nLasso methods can handle very sparse clusters (chain-like) which are difficult for spectral clustering. We also verify that a primal-dual method for non-smooth optimization allows to approximate nLasso solutions with optimal worst-case convergence... 

    A novel approach to coordination of large-scale systems; Part II - Interaction balance principle

    , Article 2005 IEEE International Conference on Industrial Technology, ICIT 2005, Hong Kong, 14 December 2005 through 17 December 2005 ; Volume 2005 , 2005 , Pages 648-654 ; 0780394844 (ISBN); 9780780394841 (ISBN) Sadati, N ; Sharif University of Technology
    2005
    Abstract
    In this part, similar to part I of this paper, a new approach for Goal Coordination is introduced that is more convergent than the previously suggested methods. This is mainly because of using the gradient of interaction errors; difference between the actual interactions and the optimum calculated interaction values, to improve the coordination parameters. The proposed scheme extremely improves the convergence rate of the solution in compare to the classical methods. The significance and applicability of the proposed approach is shown in controlling the excitation voltage of two coupled synchronous machines described by six coupled non-linear differential equations. © 2005 IEEE  

    Optimization of large-scale systems using gradient-type interaction prediction approach

    , Article Electrical Engineering ; Volume 91, Issue 4-5 , 2009 , Pages 301-312 ; 09487921 (ISSN) Sadati, N ; Ramezani, M. H ; Sharif University of Technology
    Abstract
    In this paper, a new decomposition-coordination framework is presented for two-level optimal control of large-scale nonlinear systems. In the proposed approach, decomposition is performed by defining an interaction vector, while coordination is based on a new interaction prediction approach. In the first level, sub-problems are solved for nonlinear dynamics using a gradient method, while in the second level, the coordination is done using the gradient of coordination errors. This is in contrast to the conventional gradient-type coordination schemes, where they use the gradient of Lagrangian function. It is shown that the proposed decomposition-coordination framework considerably reduces the... 

    Dual-mode global stabilization of high-order saturated integrator chains: LMI-based MPC combined with a nested saturated feedback

    , Article Nonlinear Dynamics ; Volume 102, Issue 1 , 2020 , Pages 211-222 Adelipour, S ; Ahi, B ; Haeri, M ; Sharif University of Technology
    Springer Science and Business Media B.V  2020
    Abstract
    This paper considers the problem of high-performance global stabilization of an integrator chain via a bounded control at the presence of input disturbance. While nested saturated feedback (NSF) is known as the most inspiring existing solution in the literature, we shall highlight the inherent shortcomings of this approach which cause a poor performance in terms of convergence rate. Then, a novel dual-mode control scheme combining an improved NSF law with a linear matrix inequality (LMI)-based model predictive controller (MPC) is developed to overcome the weaknesses of pure NSF. By offline calculations, a set of nested robust invariant attraction regions and their attributed feedback gains... 

    Application and Improvement of Preconditioning in Solution of Low Mach Number Flow, Using Compressible Flow Equation

    , M.Sc. Thesis Sharif University of Technology Motaghedolhagh, Kamyar (Author) ; Mazaheri, Karim (Supervisor)
    Abstract
    Upwind methods for forward time marching integration of compressible flow equations, suffer low accuracy and convergence rate for very low mach numbers. Here we have used a preconditioning scheme to address this challenge. A preconditioner matrix is multiplied in the Euler flow equations. First we investigate subsonic flow around an airfoil to validate the numerical scheme used here, and to show grid independence of our solutions. Then very low mach numbers between 0.1 and 0.001 is solved and increase in accuracy and convergence rate is demonstrated. The proposed algorithm has flow parameters, which are studied here to find their effect on accuracy and convergence rate. The found results are... 

    Over-complete Dictionary Learning for Sparse Representation

    , M.Sc. Thesis Sharif University of Technology Parsa, Javad (Author) ; Babaie-Zadeh, Massoud (Supervisor)
    Abstract
    Sparse representation has been an important problem in recent decade. The main idea in this problem is that natural signals have information contents much lower than their ambient dimensions and as such, they can be represented by using only a few atoms. For example, if the dimension of signal is n, the purpose in sparse representation is to achieve the representation of signal in terms of s atom (s ≪ n). In sparse coding, the dictionary depends on the used signal. In some of the problem, dictionary is specified and sparse representation is obtained by this dictionary. In this case, because the dictionary is known, maybe sparse representation is not suitable for this signal. For this reason,... 

    Two layers beamforming robust against direction-of-arrival mismatch

    , Article IET Signal Processing ; Volume 8, Issue 1 , 2014 , Pages 49-58 ; ISSN: 17519675 Rahmani, M ; Bastani, M. H ; Shahraini, S ; Sharif University of Technology
    Abstract
    The presence of the desired signal (DS) in the training snapshots makes the adaptive beamformer sensitive to any steering vector mismatch and dramatically reduces the convergence rate. The objective of the present study is to propose a new adaptive beamformer which is robust against direction-of-arrival (DOA) mismatch and its convergence rate is not sensitive to the presence of the DS. This method is applicable to the arrays with specific structure such as the linear array. Our approach is based on the DS elimination from the training snapshots and the sub-array beamforming technique. To accomplish this goal, a blocking matrix which converts the primary data to the DS-free data is... 

    Regularization of jump points in applying the adaptive spatial resolution technique

    , Article Optics Communications ; Volume 284, Issue 13 , June , 2011 , Pages 3211-3215 ; 00304018 (ISSN) Khavasi, A ; Mehrany, K ; Sharif University of Technology
    2011
    Abstract
    The performance of the adaptive spatial resolution technique is improved by making the resolution function of the coordinate transformation as smooth as possible. To this end, the smoothness of the resolution function is probed and a quantitative criterion is proposed to make the jump points; which were conventionally equidistant from each other, regularized. The here-proposed regularization is applied to two different recent formulations and its effects on the overall convergence rate and on the presence of numerical artifacts in analysis of highly conducting gratings are studied. Dielectric and metallic gratings at optical and microwave frequencies are considered and the helpfulness of the... 

    Globally exponential estimation of satellite attitude using a single vector measurement and gyro

    , Article Proceedings of the IEEE Conference on Decision and Control, 15 December 2010 through 17 December 2010, Atlanta, GA ; 2010 , Pages 364-369 ; 01912216 (ISSN) ; 9781424477456 (ISBN) Khosravian, A ; Namvar, M ; Sharif University of Technology
    2010
    Abstract
    This paper presents a dynamically smooth nonlinear observer for satellite attitude determination. The proposed observer uses a 3-axis gyro and a single vector measurement to estimate the attitude of a satellite. The proposed observer preserves orthogonality of the estimated attitude matrix for all time. Almost global and exponential convergence of the estimated attitude to its true value is proven without persistency of excitation conditions. The convergence rate is shown to depend on properties of certain time varying reference vectors expressed in inertial frame. A procedure for maximizing a lower bound of the convergence rate is also presented. Performance of the proposed observer is... 

    Novel interaction prediction approach to hierarchical control of large-scale systems

    , Article IET Control Theory and Applications ; Volume 4, Issue 2 , 2010 , Pages 228-243 ; 17518644 (ISSN) Sadati, N ; Ramezani, M. H ; Sharif University of Technology
    2010
    Abstract
    In this paper, a new interaction prediction approach for hierarchical control of non-linear large-scale systems is presented. The proposed approach uses a new gradient-type coordination scheme which is robust with respect to the parameters' variation, and also has a good convergence rate. In classical coordination strategies, which can be divided into the gradient-type and substitution-type approaches, it is not possible to improve the robustness and the convergence rate at the same time, since by increasing one the other decreases. The proposed approach has the main advantages of the gradient-type algorithms in being independent of the parameter's variation and also the initial guess of the...