Wide-Area Communication for Grids: An Integrated Solution to Connectivity, Performance and Security Problems

Alexandre Denis (1) , Olivier Aumage (2) , Rutger Hofman (3) , Kees Verstoep (3) , Thilo Kielmann (3) , Henri E. Bal (3)

1 PARIS - Programming distributed parallel systems for large scale numerical simulation
2 RUNTIME - Efficient runtime systems for parallel architectures
3 IBIS - IBIS

Grid computing applications are challenged by current wide-area networks: firewalls, private IP addresses and network address translation (NAT) hamper connectivity, the TCP protocol can hardly exploit the available bandwidth, and security features like authentication and encryption are usually difficult to integrate. Existing systems (like GridFTP, JXTA, SOCKS) each address only one of these issues. However, applications need to cope with all of them, at the same time. Unfortunately, existing solutions are often not easy to combine, and a particular solution for one subproblem may reduce the applicability or performance of another. In this paper, we identify the building blocks that are needed for connection establishment and efficient link utilization. We present an integrated solution, implemented within the Java-based Ibis runtime system. Our NetIbis implementation lets applications span multiple sites of a grid, and copes with firewalls, local IP addresses, secure communication, and TCP bandwidth problems.

Mots clés: NetIbis; Grid computing; network communication; firewall; TCP splicing

Domaines: Réseaux et télécommunications [cs.NI]

Alexandre Denis, Olivier Aumage, Rutger Hofman, Kees Verstoep, Thilo Kielmann, et al.. Wide-Area Communication for Grids: An Integrated Solution to Connectivity, Performance and Security Problems. the Thirteenth IEEE International Symposium on High-Performance Distributed Computing (HPDC'13), Jun 2004, Honolulu/Hawaii, United States. ⟨inria-00000126⟩