Design and Implementation of an Offline Scheduling and Resource Allocating Algorithm for Distributed Big Data Stream Processing Systems

, M.Sc. Thesis Sharif University of Technology Divband, Arman (Author) ; Goudarzi, Maziar (Supervisor)

Abstract

One of the most important categories of big data processing is stream processing. In stream processing, processing of data is performed simultaneously with the production of data. one of the most well-known frameworks used for stream processing is Apache Storm. By default, Storm uses a round-robin scheduler to allocate tasks to physical machines. This scheduler randomly performs scheduling and assignment of tasks to physical machines without considering the processing power of physical machines and processing tasks, which makes it impossible to properly utilize the processing resources. In this paper, a scheduling algorithm and resource allocation have been proposed based on the processing...

A scheduling algorithm to maximize storm throughput in heterogeneous cluster

, Article Journal of Big Data ; Volume 10, Issue 1 , 2023 ; 21961115 (ISSN) Nasiri, H ; Nasehi, S ; Divband, A ; Goudarzi, M ; Sharif University of Technology

Springer Science and Business Media Deutschland GmbH 2023

Abstract

In the most popular distributed stream processing frameworks (DSPFs), programs are modeled as a directed acyclic graph. Using this model, a DSPF can benefit from the parallelism capabilities of distributed clusters. Choosing a reasonable number of vertices for each operator and mapping the vertices to the appropriate processing resources significantly affect the overall system performance. Due to the simplicity of the current DSPF schedulers, these frameworks perform poorly on large-scale clusters. In this paper, we present a heterogeneity-aware scheduling algorithm that finds the proper number of the vertices of an application graph and maps them to the most suitable cluster node. We begin...

Sustainable-Resilient Supplier Selection Through Fuzzy Multi-Criteria Decision Making Approaches

, M.Sc. Thesis Sharif University of Technology Varchandi, Sahar (Author) ; Akbari Jokar, Mohammad Resa (Supervisor) ; Memari, Ashkan (Co-Supervisor)

Abstract

Today, with the expansion of business relations at international levels, there are many organizations that operate in global supply chains. Activities at such levels face new types of challenges in various fields of "supply chain management" pillars, of which "supplier selection" is one of them. The possibility of unexpected events, the need to comply with environmental protection laws, as well as the need to take into account social considerations, are among the things that have increased by being in larger supply chains, making it challenging to provide the basic resources needed in such chains and forcing their managers to considering considerations other than what they have always...

Analysis and Improvement of Information Theoretic Secrecy Metrics

, M.Sc. Thesis Sharif University of Technology Divband, Ashkan (Author) ; Aref, Mohammad Reza (Supervisor) ; Aminzadeh Gohari, Amin (Co-Advisor)

Abstract

Security in operational cryptography systems is expressed as computational, in the sense that breaking these systems is not possible in polynomial time. Nowadays, advances in computing power of processors and the development of quantum computers, has incresed concerns about the security of cryptographic systems. This is the cause of proposing the information theoretic secrecy in recent decades. In information theoretic secrecy topics, recovering data at target receiver side with zero error should be acomplished along side with defining security criterias. Information leakage is one of the most common security measures. there are another security measures such as rate-distortion, maximal...