Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: Understanding SSIM
(Submitted on 24 Jun 2020 (v1), last revised 29 Jun 2020 (this version, v2))
Abstract: The use of the structural similarity index (SSIM) is widespread. For almost two decades, it has played a major role in image quality assessment in many different research disciplines. Clearly, its merits are indisputable in the research community. However, little deep scrutiny of this index has been performed. Contrary to popular belief, there are some interesting properties of SSIM that merit such scrutiny. In this paper, we analyze the mathematical factors of SSIM and show that it can generate results, in both synthetic and realistic use cases, that are unexpected, sometimes undefined, and nonintuitive. As a consequence, assessing image quality based on SSIM can lead to incorrect conclusions and using SSIM as a loss function for deep learning can guide neural network training in the wrong direction.
Submission history
From: Jim Nilsson [view email][v1] Wed, 24 Jun 2020 16:19:30 GMT (5996kb,D)
[v2] Mon, 29 Jun 2020 23:15:28 GMT (5996kb,D)
Link back to: arXiv, form interface, contact.