References & Citations
Computer Science > Artificial Intelligence
Title: Recursive Binding for Similarity-Preserving Hypervector Representations of Sequences
(Submitted on 27 Jan 2022 (v1), last revised 17 May 2022 (this version, v2))
Abstract: Hyperdimensional computing (HDC), also known as vector symbolic architectures (VSA), is a computing framework used within artificial intelligence and cognitive computing that operates with distributed vector representations of large fixed dimensionality. A critical step for designing the HDC/VSA solutions is to obtain such representations from the input data. Here, we focus on sequences and propose their transformation to distributed representations that both preserve the similarity of identical sequence elements at nearby positions and are equivariant to the sequence shift. These properties are enabled by forming representations of sequence positions using recursive binding and superposition operations. The proposed transformation was experimentally investigated with symbolic strings used for modeling human perception of word similarity. The obtained results are on a par with more sophisticated approaches from the literature. The proposed transformation was designed for the HDC/VSA model known as Fourier Holographic Reduced Representations. However, it can be adapted to some other HDC/VSA models.
Submission history
From: Denis Kleyko [view email][v1] Thu, 27 Jan 2022 17:41:28 GMT (493kb,D)
[v2] Tue, 17 May 2022 03:31:47 GMT (1227kb,D)
Link back to: arXiv, form interface, contact.