Capturing Provenance to Improve the Model Training of PINNs: first handon experiences with Grid5000

Rômulo M. Silva (1) , Débora Pina (1) , Liliane Kunstmann (1) , Daniel de Oliveira (2) , Patrick Valduriez (3) , Alvaro L. G. A. Coutinho (1) , Marta Mattoso (1)

1 UFRJ - Universidade Federal do Rio de Janeiro [Brasil] = Federal University of Rio de Janeiro [Brazil] = Université fédérale de Rio de Janeiro [Brésil]
2 UFF - Universidade Federal Fluminense [Rio de Janeiro]
3 ZENITH - Scientific Data Management

The growing popularity of Neural Networks in computational science and engineering raises several challenges in configuring training parameters and validating the models. Machine learning has been used to approximate costly computational problems in computational mechanics, discover equations by coefficient estimation, and build surrogates. Those applications are outside of the common usage of neural networks. They require a different set of techniques generally encompassed by Physics-Informed Neural Networks (PINNs), which appear to be a good alternative for solving forward and inverse problems governed by PDEs in a small data regime, especially when it comes to Uncertainty Quantification. PINNs have been successfully applied for solving problems in fluid dynamics, inference of hydraulic conductivity, velocity inversion, phase separation, and many others. Nevertheless, we still need to investigate its computational aspects, especially its scalability, when running in large-scale systems. Several hyperparameter configurations have to be evaluated to reach a trained model, often requiring fine-tuning hyperparameters, despite the existence of a few setting recommendations. In PINNs, this fine-tuning requires analyzing configurations and how they relate to the loss function evaluation. We propose provenance data capture and analysis techniques to improve the model training of PINNs. We also report our first experiences on running PINNs in Grid5000 using hybrid CPU-GPU computing.

Mots clés: Physics-informed Neural Networks; Eikonal Equation; Provenance; Hybrid Computing

Domaines: Base de données [cs.DB]; Intelligence artificielle [cs.AI]

Rômulo M. Silva, Débora Pina, Liliane Kunstmann, Daniel de Oliveira, Patrick Valduriez, et al.. Capturing Provenance to Improve the Model Training of PINNs: first handon experiences with Grid5000. CILAMCE-PANACM 2021 - XLII Ibero-Latin-American Congress on Computational Methods in Engineering - III Pan-American Congress on Computational Mechanics, Nov 2021, Rio de Janeiro, Brazil. pp.1-7. ⟨lirmm-03443548⟩