HAMBAND: RDMA Replicated Data Types

Data centers are increasingly equipped with RDMAs. These network interfaces mark the advent of a new distributed system model where a node can directly access the remote memory of another. They have enabled microsecond-scale replicated services. The underlying replication protocols of these systems execute all operations under strong consistency. However, strong consistency can hinder response time and availability, and recent replication models have turned to a hybrid of strong and relaxed consistency. This paper presents RDMA well-coordinated replicated data types, the first hybrid replicated data types for the RDMA network model. It presents a novel operational semantics for these data types that considers three distinct categories of methods and captures their required coordination, and formally proves that they preserve convergence and integrity. It implements these semantics in a system called HAMBAND that leverages direct remote accesses to efficiently implement the required coordination protocols. The empirical evaluation shows that HAMBAND outperforms the throughput of existing message-based and strongly consistent implementations by more than 17x and 2.7x respectively.