We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: An Information Maximization Based Blind Source Separation Approach for Dependent and Independent Sources

Abstract: We introduce a new information maximization (infomax) approach for the blind source separation problem. The proposed framework provides an information-theoretic perspective for determinant maximization-based structured matrix factorization methods such as nonnegative and polytopic matrix factorization. For this purpose, we use an alternative joint entropy measure based on the log-determinant of covariance, which we refer to as log-determinant (LD) entropy. The corresponding (LD) mutual information between two vectors reflects a level of their correlation. We pose the infomax BSS criterion as the maximization of the LD-mutual information between the input and output of the separator under the constraint that the output vectors lie in a presumed domain set. In contrast to the ICA infomax approach, the proposed information maximization approach can separate both dependent and independent sources. Furthermore, we can provide a finite sample guarantee for the perfect separation condition in the noiseless case.
Subjects: Information Theory (cs.IT); Signal Processing (eess.SP)
MSC classes: 15A23, 15A29, 68T05, 68Q32, 94A15, 94A16, 94A17,
ACM classes: H.1.1; I.2.6
Journal reference: 2022 IEEE Conference on Acoustics, Speech and Signal Processing
Cite as: arXiv:2205.00794 [cs.IT]
  (or arXiv:2205.00794v1 [cs.IT] for this version)

Submission history

From: Alper Erdogan [view email]
[v1] Mon, 2 May 2022 10:25:44 GMT (525kb)

Link back to: arXiv, form interface, contact.