Loading...
Search for: markov-decision-process--mdp
0.011 seconds

    Dynamic pricing in a production system with multiple demand classes

    , Article Applied Mathematical Modelling ; Volume 39, Issue 8 , April , 2015 , Pages 2332-2344 ; 0307904X (ISSN) Ahmadi, M ; Shavandi, H ; Sharif University of Technology
    Elsevier Inc  2015
    Abstract
    This paper considers dynamic pricing in a production system with a single product which is demanded by several customer classes. We seek the structure of the optimal policy assuming m available prices and n demand classes that differ based on the lost sales cost they impose on the system. The assumption of different available prices leads to dynamic pricing structure and the assumption of several demand classes leads to rationing which is proposed in the literature of revenue management. We found that an optimal policy structure exists for this combined problem. The optimal policy has a threshold form which lower thresholds are related to the rationing decision and upper thresholds are... 

    Minimizing uplink delay in delay-sensitive 5G CRAN platforms

    , Article 2nd IEEE 5G World Forum, 5GWF 2019, 30 September 2019 through 2 October 2019 ; 2019 , Pages 154-160 ; 9781728136271 (ISBN) Ataie, A ; Kanaanian, B ; Khalaj, B. H ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2019
    Abstract
    In this paper, we consider the problem of minimizing the uplink delays of users in a 5G cellular network. Such cellular network is based on a Cloud Radio Access Network (CRAN) architecture with limited fronthaul capacity, where our goal is to minimize delays of all users through an optimal resource allocation. Earlier works minimize average delay of each user assuming same transmit power for all users. Combining Pareto optimization and Markov Decision Process (MDP), we show that every desired balance in the trade-off among infinite-horizon average-reward delays, is achievable by minimizing a properly weighted sum delays. In addition, we solve the problem in two realistic scenarios;... 

    Application of Markov decision process in generating units maintenance scheduling

    , Article 2006 9th International Conference on Probabilistic Methods Applied to Power Systems, PMAPS, Stockholm, 11 June 2006 through 15 June 2006 ; 2006 ; 9171783520 (ISBN); 9789171783523 (ISBN) Rajabi Ghahnavie, A ; Fotuhi Firuzabad, M ; Sharif University of Technology
    2006
    Abstract
    An important issue in power system planning is maintenance scheduling of generating units. In a traditional power system, the problem of maintenance scheduling is of high importance and has various technical and economical constraints. Different methods have been used to solve the problem. On the other hand, changes in legal environment of electricity industry poses new bound and requirements on the maintenance scheduling problem. This paper presents a new approach on maintenance scheduling of generating units in a generating company (GENCO). The proposed approach uses Markov Decision Process (MDP) to minimize total costs of unserved energy and reserve. The impacts on maintenance scheduling...