Jacobi Algorithm for Nonnegative Matrix Factorization with Transform Learning

Herwig Wendt (1, 2) , Dylan Fagot (3) , Cédric Févotte (3, 2)

1 IRIT-MINDS - CoMputational imagINg anD viSion
2 CNRS - Centre National de la Recherche Scientifique
3 IRIT-SC - Signal et Communications

Nonnegative matrix factorization (NMF) is the state-of-the-art approach to unsupervised audio source separation. It relies on the factorization of a given short-time frequency transform into a dictionary of spectral patterns and an activation matrix. Recently, we introduced transform learning for NMF (TL-NMF), in which the short-time transform is learnt together with the nonnegative factors. We imposed the transform to be orthogonal likewise the usual Fourier or Cosine transform. TLNMF yields an original non-convex optimization problem over the manifold of orthogonal matrices, for which we proposed a projected gradient descent algorithm in our previous work. In this contribution we describe a new Jacobi approach in which the orthogonal matrix is represented as a randomly chosen product of elementary Givens matrices. The new approach performs favorably as compared to the gradient approach, in particular in terms of robustness with respect to initialization, as illustrated with synthetic and audio decomposition experiments.

Mots clés: Single-channel source separation; Transform learning; Nonnegative matrix factorization (NMF)

Domaines: Traitement du signal et de l'image [eess.SP]

Herwig Wendt, Dylan Fagot, Cédric Févotte. Jacobi Algorithm for Nonnegative Matrix Factorization with Transform Learning. 26th European Signal and Image Processing Conference (EUSIPCO 2018), Sep 2018, Rome, Italy. pp.1607-1701. ⟨hal-02283162⟩