When eXtended Para-Virtualization (XPV) meets NUMA

Vo Quoc Bao Bui (1) , Djob Mvondo (2) , Boris Teabe (1, 3) , Kevin Jiokeng (4) , Lavoisier Wapet (1) , Alain Tchana (5) , Gaël Thomas (6, 7, 8, 9) , Daniel Hagimont (1, 3) , Gilles Muller (10) , Noel Depalma (2)

1 IRIT-SEPIA - Système d’exploitation, systèmes répartis, de l’intergiciel à l’architecture
2 LIG - Laboratoire d'Informatique de Grenoble
3 Toulouse INP - Institut National Polytechnique (Toulouse)
4 IRIT-RMESS - Réseaux, Mobiles, Embarqués, Sans fil, Satellites
5 I3S - Laboratoire d'Informatique, Signaux, et Systèmes de Sophia Antipolis
6 TSP - INF - Département Informatique
7 ACMES-SAMOVAR - Architecture, Cloud continuum, formal Models, artificial intElligence and Services in distributed computing
8 CNRS - Centre National de la Recherche Scientifique
9 Benagil-Samovar - Efficient and safe distributed systems
10 Whisper - Well Honed Infrastructure Software for Programming Environments and Runtimes

This paper addresses the problem of efficiently virtualizing NUMA architectures. The major challenge comes from the fact that the hypervisor regularly reconfigures the placement of a virtual machine (VM) over the NUMA topology. However, neither guest operating systems (OSes) nor system runtime libraries (e.g., Hotspot) are designed to consider NUMA topology changes at runtime, leading end user applications to unpredictable performance. This paper presents eXtended Para-Virtualization (XPV), a new principle to efficiently virtualize a NUMA architecture. XPV consists in revisiting the interface between the hypervisor and the guest OS, and between the guest OS and system runtime libraries (SRL) so that they can dynamically take into account NUMA topology changes. The paper presents a methodology for systematically adapting legacy hypervisors, OSes, and SRLs. We have applied our approach with less than 2k line of codes in two legacy hypervisors (Xen and KVM), two legacy guest OSes (Linux and FreeBSD), and three legacy SRLs (Hotspot, TCMalloc, and jemalloc). The evaluation results showed that XPV outperforms all existing solutions by up to 304%.

Mots clés: NUMA; Virtualization

Domaines: Architectures Matérielles [cs.AR]

Vo Quoc Bao Bui, Djob Mvondo, Boris Teabe, Kevin Jiokeng, Lavoisier Wapet, et al.. When eXtended Para-Virtualization (XPV) meets NUMA. EUROSYS 2019: 14th European Conference on Computer Systems, Mar 2019, Dresde, Germany. pp.7, ⟨10.1145/3302424.3303960⟩. ⟨hal-02333640v2⟩