Line rendering of 3D meshes for data-driven sketch-based modeling

Bastien Wailly (1) , Adrien Bousseau (2)

1 CRISAM - Inria Sophia Antipolis - Méditerranée
2 GRAPHDECO - GRAPHics and DEsign with hEterogeneous COntent

Deep learning recently achieved impressive successes on various computer vision tasks for which large amounts of training data is available, such as image classification. These successes have motivated the use of computer graphics to generate synthetic data for tasks where real data is difficult to collect. We present SynDraw, a non-photorealistic rendering system designed to ease the generation of synthetic drawings to train data-driven sketch-based modeling systems. SynDraw processes triangular meshes and extracts various types of synthetic lines, including occluding contours, suggestive contours, creases, and demarcating curves. SynDraw exports these lines as vector graphics to allow subsequent stylization. Finally, SynDraw can also export attributes of the lines, such as their 3D coordinates and their types, which can serve as ground truth for depth prediction or line labeling tasks. We provide both a command-line interface for batch processing, as well as an interactive viewer to explore and save line extraction parameters. We will release SynDraw as an open source library to support research in non-photorealistic rendering and sketch-based modeling.

Mots clés: vector graphics; deep learning; geometry processing; sketch-based modeling; non- photorealistic rendering

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Géométrie algorithmique [cs.CG]; Apprentissage [cs.LG]; Modélisation et simulation

Bastien Wailly, Adrien Bousseau. Line rendering of 3D meshes for data-driven sketch-based modeling. Journées Francaises d'Informatique Graphique et de Réalité virtuelle, AFIG, Nov 2019, Marseille, France. ⟨hal-02391655⟩