Think Unlimited and Compress Data Automatically

Maxime Schmitt (1, 2) , Philippe Helluy (3, 4) , Cédric Bastoul (1, 2)

1 ICube - Laboratoire des sciences de l'ingénieur, de l'informatique et de l'imagerie
2 CAMUS - Compilation pour les Architectures MUlti-coeurS
3 IRMA - Institut de Recherche Mathématique Avancée
4 TONUS - TOkamaks and NUmerical Simulations

Developing an application which, when unoptimized, consumes more memory resources than physically or financially available demands a lot of expertise. In this work, we show that with the right tools and language abstractions, writing such programs for a given class of applications can stay within reach of non-expert developers. We explore the potential of a compiler-based data layout transformation from dense array to a compressed tree data structure. This transformation allows easy application prototyping, provides compression and carries information that can be used with more advanced optimization, e.g., adaptive and approximate computing techniques. We are primarily targeting partial differential equation solvers and signal processing applications. We evaluate the compression ratio and error originating from this compressed representation. We suggest multiple exploration paths to produce an automatic adaptive code transformation with compressing capabilities from the multiresolution information produced during the transformation.

Domaines: Performance et fiabilité [cs.PF]; Calcul parallèle, distribué et partagé [cs.DC]

Maxime Schmitt, Philippe Helluy, Cédric Bastoul. Think Unlimited and Compress Data Automatically. COMPAS 2019 - Conférence d'informatique en Parallélisme, Architecture et Système, Jun 2019, Anglet, France. ⟨hal-02456534⟩