Semi-Supervised Probabilistic Learning Network for Soft Sensor Modeling With Partially Labeled Data

Abstract

Deep probabilistic learning networks have been applied in industrial soft sensors. However, they face significant challenges in latent variable inference, deep learning backend implementation, and labeled data scarcity. The first challenge arises when covariates directly infer the latent variable, potentially leading to inaccuracies. The second stems from discrepancies between the theoretical probabilistic distribution and practical instance-based deep learning backends. The third is commonly encountered in soft sensor applications, where unlabeled data often go unused, reducing accuracy. To address these challenges, this work proposes a novel semi-supervised probabilistic learning network (SS-PLN) for soft sensor modeling with partially labeled data. The first issue is addressed by formulating an optimization problem as the model’s learning objective. This optimization is efficiently solved by investigating the input of inference network through analyzing the optimal solution’s structure. For the second issue, mean and covariance equations are used to represent probabilistic distributions, ensuring effective deep learning backends. The third issue is addressed by integrating supervised and unsupervised probabilistic learning networks to form the SS-PLN model, thereby maximizing the use of unlabeled data and enhancing the soft sensing performance. The feasibility and effectiveness of the proposed SS-PLN are validated through comparisons with recent semi-supervised learning methods, using data from two industrial processes.