A scalable reliable instant messenger using the SD Erlang libraries

Chechina, N., Moro Hernandez, M. and Trinder, P. (2016) A scalable reliable instant messenger using the SD Erlang libraries. In: Fifteenth ACM SIGPLAN Erlang Workshop, Nara, Japan, 23 Sep 2016, pp. 33-41. ISBN 9781450344319 (doi: 10.1145/2975969.2975973)

[img]
Preview
Text
121665.pdf - Accepted Version

1MB

Abstract

Erlang has world leading reliability capabilities, but while it scales extremely well within a single node, distributed Erlang has some scalability issues. The Scalable Distributed (SD) Erlang libraries have been designed to address the scalability limitations while preserving the reliability model, and shown to deliver significant performance benefits above 40 hosts using some relatively simple benchmarks. This paper compares the reliability and scalability of SD Erlang and distributed Erlang using an Instant Messaging (IM) server benchmark that is a far more typical Erlang application; a relatively large and sophisticated benchmark; has throughput as the key performance metric; and uses non-trivial reliability mechanisms. We provide a careful reliability evaluation using chaos monkey. The key performance results consider scenarios with and without failures on up to 17 server hosts (272 cores). We show that SD Erlang adds no performance overhead when all nodes are grouped in a single s_group. However, either adding redundant router nodes in distributed Erlang applications, or dividing a set of nodes into small s_groups in SD Erlang applications, have small negative impact. Both the distributed Erlang and SD Erlang IM tolerate failures and, up to the failure rates measured, the failures have no impact on throughput. The IM implementations show that SD Erlang preserves the distributed Erlang reliability properties and mechanisms.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Chechina, Dr Natalia and Trinder, Professor Phil
Authors: Chechina, N., Moro Hernandez, M., and Trinder, P.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781450344319
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
644791Adaptive Just-In-Time Parallelisation (AJITPar)Phil TrinderEngineering & Physical Sciences Research Council (EPSRC)EP/L000687/1COM - COMPUTING SCIENCE