References & Citations
Computer Science > Data Structures and Algorithms
Title: DxHash: A Scalable Consistent Hash Based on the Pseudo-Random Sequence
(Submitted on 16 Jul 2021 (this version), latest version 18 Nov 2023 (v2))
Abstract: Consistent hasing has played a fundamental role as a data router and a load balancer in various fields, such as distributed database, cloud infrastructure, and peer-to-peer network. However, the existing consistent hashing schemes can't meet the requirements simultaneously, including full consistency, scalability, small memory footprint, low update time and low query complexity. Thus, We propose DxHash, a scalable consistent hashing algorithm based on the pseudo-random sequence. For the scenario of distributed storage, there are two optimizations based on DXHash are proposed. First, the Weighted DxHash can adjust the workloads on arbitrary nodes. Second, the Asymmetric Replica Strategy (ARS) is combining the replica strategy in distributed storage with the scaleup process to improve the availability of the system and reduce the remapping rate. The evaluation indicates that compared with the state-of-art works, DxHash achieves significant improvements on the 5 requirements. Even with 50% failure ratio, DxHash still can complete 16.5 million queries per second. What's more, the two optimizations both achieve their own results.
Submission history
From: Chaos Dong [view email][v1] Fri, 16 Jul 2021 14:45:57 GMT (1277kb,D)
[v2] Sat, 18 Nov 2023 12:48:20 GMT (2690kb,D)
Link back to: arXiv, form interface, contact.