A Dynamic Multi-Threaded Queuing Mechnism for Reducing the Inter-Process Communication Latency on Multi-Core Chips
View/ Open
Date
2019-08-12Author
Mishra, Rohitshankar Vijay Shankar V
0000-0002-5754-6894
Metadata
Show full item recordAbstract
Reducing latency in Inter-Process Communication (IPC) is one of the key challenges in multi-threaded applications in multi-core environments. High latencies can have serious impact on the performance of an application when many threads queue up for memory access. Often lower latencies are achieved by using lock-free algorithms that keep threads spinning but incur high CPU usage as a result. Blocking synchronization primitives such as mutual exclusion locks or semaphores achieve resource efficiency but yield lower performance. In this paper, we take a different approach of combining a lock-free algorithm with resource efficiency of blocking synchronization primitives. We propose a queueing scheme named eLCRQ that uses the lightweight Linux Futex system call to construct a block-when-necessary layer on top of the popular lock-free LCRQ. Owing to the block-when-necessary feature, eLCRQ produces close to lock-free performance when under contention. Under no contention, we use the Futex System call for conditional blocking instead of spinning in a retry loop, which releases the CPU to perform other tasks. When compared with existing IPC mechanisms, eLCRQ yields 2.3 times reduction in CPU usage while lowering the average message latency 1.7 times. When comparing the proposed scheme with industry standard non-blocking lock-free DPDK RTE_RING, the results show a 3.4 times reduction in CPU Usage while maintaining comparable message latency. We also propose a fixed-spinning based variation of the proposed scheme, called eLCRQ-spin, which allows us to make tradeoffs between CPU usage efficiency and message latency.
Related items
Showing items related by title, author, creator and subject.
-
PLANNING AND OPTIMIZATION OF A STOCHASTIC MULTI-PHASE MULTI- CRITERIA MULTI-ECHELON HUMANITARIAN LOGISTICS NETWORK
Bari, A B M Mainul; 0000-0002-3075-4247 (2019-11-12)Disasters, may that be anthropogenic or natural, cause much havoc to vast area and population. Property and infrastructures get destroyed. People are often in need of urgent relief like dry foods and water to survive. In ... -
IMPROVING OPERATIONAL HYDROLOGIC FORECASTING VIA CONDITIONAL BIAS-PENALIZED MULTI-SENSOR PRECIPITATION ESTIMATION AND MULTI-MODEL STREAMFLOW PREDICTION
Jozaghi, Ali (2021-05-09)Many multivariate analysis techniques involve minimizing mean square error (MSE) or error variance under unbiasedness. In the presence of observation error, variance minimization tends to introduce negative and positive ... -
MULTI-SCALE AND MULTI-APPROCH INVESTIGATIONS OF PETROPHYSICAL PROPERTIES AND FLUID FLOW IN NATURAL ROCKS
Wang, Qiming (2022-05-09)Natural rock is one of the most important geological attributes on the Earth that have been widely related to human daily life in various aspects. Rocks are usually utilized with respect to their petrophysical properties ...