Information Theory
New submissions
[ showing up to 2000 entries per page: fewer | more ]
New submissions for Thu, 28 Mar 24
- [1] arXiv:2403.18146 [pdf, ps, other]
-
Title: Adaptive TTD Configurations for Near-Field Communications: An Unsupervised Transformer ApproachSubjects: Information Theory (cs.IT); Signal Processing (eess.SP)
True-time delayers (TTDs) are popular analog devices for facilitating near-field wideband beamforming subject to the spatial-wideband effect. In this paper, an adaptive TTD configuration is proposed for short-range TTDs. Compared to the existing TTD configurations, the proposed one can effectively combat the spatial-widebandd effect for arbitrary user locations and array shapes with the aid of a switch network. A novel end-to-end deep neural network is proposed to optimize the hybrid beamforming with adaptive TTDs for maximizing spectral efficiency. 1) First, based on the U-Net architecture, a near-field channel learning module (NFC-LM) is proposed for adaptive beamformer design through extracting the latent channel response features of various users across different frequencies. In the NFC-LM, an improved cross attention (CA) is introduced to further optimize beamformer design by enhancing the latent feature connection between near-field channel and different beamformers. 2) Second, a switch multi-user transformer (S-MT) is proposed to adaptively control the connection between TTDs and phase shifters (PSs). In the S-MT, an improved multi-head attention, namely multi-user attention (MSA), is introduced to optimize the switch network through exploring the latent channel relations among various users. 3) Third, a multi feature cross attention (MCA) is introduced to simultaneously optimize the NFC-LM and S-MT by enhancing the latent feature correlation between beamformers and switch network. Numerical simulation results show that 1) the proposed adaptive TTD configuration effectively eliminates the spatial-wideband effect under uniform linear array (ULA) and uniform circular array (UCA) architectures, and 2) the proposed deep neural network can provide near optimal spectral efficiency, and solve the multi-user bemformer design and dynamical connection problem in real-time.
- [2] arXiv:2403.18231 [pdf, ps, other]
-
Title: The Dimensions of the Hulls of Conorm Codes from Algebraic Geometry CodesSubjects: Information Theory (cs.IT)
Chara et al. introduced conorm codes defined over algebraic geometry codes, but the hulls of conorm codes were not determined yet. In this paper, we study the dimension of the hull of conorm codes using the method introduced by Camps et al. For an algebraic geometry code $\mathcal{C}:=C_\mathscr{L}(D, G)$, we consider the divisor $\gcd(G, H)$, where $H$ is the divisor satisfying \[C_\mathscr{L}(D, G)^\perp=C_\mathscr{L}(D, H).\] Given an extension $F'/\mathbb{F}_{q^t}$ of an algebraic function field $F/\mathbb{F}_q$, we assume that the divisor $\gcd(G, H)$ is non-special. If the degree of $\gcd(G, H)$ is greater than $2g-2+{t\over [F':F]}\deg\text{Diff}(F'/F)$, then we have determined the exact dimension of the hull of the conorm of $\mathcal{C}$. If not, we have determined the lower bound of the dimension of the hull of the conorm of $\mathcal{C}$. We provide some examples for the dimension of the hull of certain conorm codes of AG codes defined over a rational function field.
- [3] arXiv:2403.18307 [pdf, ps, other]
-
Title: Mutual Information Optimization for SIM-Based Holographic MIMO SystemsComments: 5 pages, 2 figuresSubjects: Information Theory (cs.IT); Signal Processing (eess.SP)
In the context of emerging stacked intelligent metasurface (SIM)-based holographic MIMO (HMIMO) systems, a fundamental problem is to study the mutual information (MI) between transmitted and received signals to establish their capacity. However, direct optimization or analytical evaluation of the MI, particularly for discrete signaling, is often intractable. To address this challenge, we adopt the channel cutoff rate (CR) as an alternative optimization metric for the MI maximization. In this regard, we propose an alternating projected gradient method (APGM), which optimizes the CR of a SIM-based HMIMO system by adjusting signal precoding and the phase shifts across the transmit and receive SIMs in a layer-by-layer basis. Simulation results indicate that the proposed algorithm significantly enhances the CR, achieving substantial gains proportional to those observed for the corresponding MI. This justifies the effectiveness of using the channel CR for the MI optimization. Moreover, we demonstrate that the integration of digital precoding, even on a modest scale, has a significant impact on the ultimate performance of SIM-aided systems.
- [4] arXiv:2403.18364 [pdf, other]
-
Title: Intent-Aware DRL-Based Uplink Dynamic Scheduler for 5G-NRSubjects: Information Theory (cs.IT); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
We investigate the problem of supporting Industrial Internet of Things user equipment (IIoT UEs) with intent (i.e., requested quality of service (QoS)) and random traffic arrival. A deep reinforcement learning (DRL) based centralized dynamic scheduler for time-frequency resources is proposed to learn how to schedule the available communication resources among the IIoT UEs. The proposed scheduler leverages an RL framework to adapt to the dynamic changes in the wireless communication system and traffic arrivals. Moreover, a graph-based reduction scheme is proposed to reduce the state and action space of the RL framework to allow fast convergence and a better learning strategy. Simulation results demonstrate the effectiveness of the proposed intelligent scheduler in guaranteeing the expressed intent of IIoT UEs compared to several traditional scheduling schemes, such as round-robin, semi-static, and heuristic approaches. The proposed scheduler also outperforms the contention-free and contention-based schemes in maximizing the number of successfully computed tasks.
- [5] arXiv:2403.18488 [pdf, ps, other]
-
Title: The Guesswork of Ordered Statistics Decoding: Complexity and Practical DesignComments: Submitted for peer review;19 pages;15 figuresSubjects: Information Theory (cs.IT)
This paper investigates guesswork over ordered statistics and formulates the complexity of ordered statistics decoding (OSD) in binary additive white Gaussian noise (AWGN) channels. It first develops a new upper bound of guesswork for independent sequences, by applying the Holder's inequity to Hamming shell-based subspaces. This upper bound is then extended to the ordered statistics, by constructing the conditionally independent sequences within the ordered statistics sequences. We leverage the established bounds to formulate the best achievable decoding complexity of OSD that ensures no loss in error performance, where OSD stops immediately when the correct codeword estimate is found. We show that the average complexity of OSD at maximum decoding order can be accurately approximated by the modified Bessel function, which increases near-exponentially with code dimension. We also identify a complexity saturation threshold, where increasing the OSD decoding order beyond this threshold improves error performance without further raising decoding complexity. Finally, the paper presents insights on applying these findings to enhance the efficiency of practical decoder implementations.
- [6] arXiv:2403.18621 [pdf, other]
-
Title: Performance Analysis of Integrated Sensing and Communication Networks with Blockage EffectsSubjects: Information Theory (cs.IT); Signal Processing (eess.SP)
Communication-sensing integration represents an up-and-coming area of research, enabling wireless networks to simultaneously perform communication and sensing tasks. However, in urban cellular networks, the blockage of buildings results in a complex signal propagation environment, affecting the performance analysis of integrated sensing and communication (ISAC) networks. To overcome this obstacle, this paper constructs a comprehensive framework considering building blockage and employs a distance-correlated blockage model to analyze interference from line of sight (LoS), non-line of sight (NLoS), and target reflection cascading (TRC) links. Using stochastic geometric theory, expressions for signal-to-interference-plus-noise ratio (SINR) and coverage probability for communication and sensing in the presence of blockage are derived, allowing for a comprehensive comparison under the same parameters. The research findings indicate that blockage can positively impact coverage, especially in enhancing communication performance. The analysis also suggests that there exists an optimal base station (BS) density when blockage is of the same order of magnitude as the BS density, maximizing communication or sensing coverage probability.
- [7] arXiv:2403.18685 [pdf, other]
-
Title: Representatividad Muestral en la Incertidumbre Simétrica Multivariada para la Selección de AtributosAuthors: Gustavo Sosa-CabreraComments: 52 pages, in Spanish. Advisors: Miguel Garc\'ia-Torres, Santiago G\'omez-Guerrero, Christian E. Schaerer SerraSubjects: Information Theory (cs.IT); Machine Learning (cs.LG); Statistics Theory (math.ST)
In this work, we analyze the behavior of the multivariate symmetric uncertainty (MSU) measure through the use of statistical simulation techniques under various mixes of informative and non-informative randomly generated features. Experiments show how the number of attributes, their cardinalities, and the sample size affect the MSU. In this thesis, through observation of results, it is proposed an heuristic condition that preserves good quality in the MSU under different combinations of these three factors, providing a new useful criterion to help drive the process of dimension reduction.
--
En el presente trabajo hemos analizado el comportamiento de una versi\'on multivariada de la incertidumbre sim\'etrica a trav\'es de t\'ecnicas de simulaci\'on estad\'isticas sobre varias combinaciones de atributos informativos y no-informativos generados de forma aleatoria. Los experimentos muestran como el n\'umero de atributos, sus cardinalidades y el tama\~no muestral afectan al MSU como medida. En esta tesis, mediante la observaci\'on de resultados hemos propuesto una condici\'on que preserva una buena calidad en el MSU bajo diferentes combinaciones de los tres factores mencionados, lo cual provee un nuevo y valioso criterio para llevar a cabo el proceso de reducci\'on de dimensionalidad. - [8] arXiv:2403.18713 [pdf, other]
-
Title: Characterization of Spatial-Temporal Channel Statistics from Indoor Measurement Data at D BandAuthors: Chathuri Weragama, Joonas Kokkoniemi, Mar Francis De Guzman, Katsuyuki Haneda, Pekka Kyosti, Markku JunttiComments: 6 pages, 22 figuresSubjects: Information Theory (cs.IT); Signal Processing (eess.SP)
Millimeter-wave (mmWave) and D Band (110--170~GHz) frequencies are poised to play a pivotal role in the advancement of sixth-generation (6G) systems and beyond, owing to their ability to enhance performance metrics such as capacity, ultra-low latency, and spectral efficiency. This paper concentrates on deriving statistical insights into power, delay, and the number of paths based on measurements conducted across four distinct locations at a center frequency of 143.1 GHz. The findings underscore the suitability of various distributions in characterizing power behavior in line-of-sight (LOS) scenarios, including lognormal, Nakagami, gamma, and beta distributions, whereas the loglogistic distribution gives the optimal fit for power distribution in non-line-of-sight (NLOS) scenarios. Moreover, the exponential distribution shows to be the most appropriate model for the delay distribution in both LOS and NLOS scenarios. In terms of the number of paths, observations indicate a tendency for the highest concentration within the 10 m to 30 m distance range between the transmitter (Tx) and receiver (Rx). These insights shed light on the statistical nature of D band propagation characteristics, which are vital for informing the design and optimization of future 6G communication systems
Cross-lists for Thu, 28 Mar 24
- [9] arXiv:2403.17946 (cross-list from math.FA) [pdf, ps, other]
-
Title: Nonlinear Heisenberg-Robertson-Schrodinger Uncertainty PrincipleAuthors: K. Mahesh KrishnaComments: 4 Pages, 0 FiguresSubjects: Functional Analysis (math.FA); Information Theory (cs.IT); Mathematical Physics (math-ph)
We derive an uncertainty principle for Lipschitz maps acting on subsets of Banach spaces. We show that this nonlinear uncertainty principle reduces to the Heisenberg-Robertson-Schrodinger uncertainty principle for linear operators acting on Hilbert spaces.
- [10] arXiv:2403.18087 (cross-list from eess.SP) [pdf, other]
-
Title: Channel Estimation and Beamforming for Beyond Diagonal Reconfigurable Intelligent SurfacesComments: 12 pages, 10 figures, submitted to IEEE journalSubjects: Signal Processing (eess.SP); Information Theory (cs.IT)
Beyond diagonal reconfigurable intelligent surface (BD-RIS) is a new advance and generalization of the RIS technique. BD-RIS breaks through the isolation between RIS elements by creatively introducing inter-element connections, thereby enabling smarter wave manipulation and enlarging coverage. However, exploring proper channel estimation schemes suitable for BD-RIS aided communication systems still remains an open problem. In this paper, we study channel estimation and beamforming design for BD-RIS aided multi-antenna systems. We first describe the channel estimation strategy based on the least square (LS) method, derive the mean square error (MSE) of the LS estimation, and formulate the joint pilot sequence and BD-RIS design problem with unique constraints induced by BD-RIS architectures. Specifically, we propose an efficient pilot sequence and BD-RIS design which theoretically guarantees to achieve the minimum MSE. With the estimated channel, we then consider two BD-RIS scenarios and propose beamforming design algorithms. Finally, we provide simulation results to verify the effectiveness of the proposed channel estimation scheme and beamforming design algorithms. We also show that more interelement connections in BD-RIS improves the performance while increasing the training overhead for channel estimation.
- [11] arXiv:2403.18102 (cross-list from math.CT) [pdf, ps, other]
-
Title: The operadic theory of convexityComments: 42 pagesSubjects: Category Theory (math.CT); Information Theory (cs.IT); Quantum Physics (quant-ph)
In this article, we characterize convexity in terms of algebras over a PROP, and establish a tensor-product-like symmetric monoidal structure on the category of convex sets. Using these two structures, and the theory of $\scr{O}$-monoidal categories, we state and prove a Grothendieck construction for lax $\scr{O}$-monoidal functors into convex sets. We apply this construction to the categorical characterization of entropy of Baez, Fritz, and Leinster, and to the study of quantum contextuality in the framework of simplicial distributions.
- [12] arXiv:2403.18130 (cross-list from math.OC) [pdf, other]
-
Title: Generalized Maximum Entropy Differential Dynamic ProgrammingComments: 7 pages, 5 figures, This paper is for CDC 2024Subjects: Optimization and Control (math.OC); Information Theory (cs.IT)
We present a sampling-based trajectory optimization method derived from the maximum entropy formulation of Differential Dynamic Programming with Tsallis entropy. This method can be seen as a generalization of the legacy work with Shannon entropy, which leads to a Gaussian optimal control policy for exploration during optimization. With the Tsallis entropy, the optimal control policy takes the form of $q$-Gaussian, which further encourages exploration with its heavy-tailed shape. Moreover, in our formulation, the exploration variance, which was scaled by a fixed constant inverse temperature in the original formulation with Shannon entropy, is automatically scaled based on the value function of the trajectory. Due to this property, our algorithms can promote exploration when necessary, that is, the cost of the trajectory is high, rather than using the same scaling factor. The simulation results demonstrate the properties of the proposed algorithm described above.
- [13] arXiv:2403.18247 (cross-list from cs.CR) [pdf, other]
-
Title: An Experimentally Validated Feasible Quantum Protocol for Identity-Based Signature with Application to Secure Email CommunicationAuthors: Tapaswini Mohanty, Vikas Srivastava, Sumit Kumar Debnath, Debasish Roy, Kouichi Sakurai, Sourav MukhopadhyaySubjects: Cryptography and Security (cs.CR); Information Theory (cs.IT)
Digital signatures are one of the simplest cryptographic building blocks that provide appealing security characteristics such as authenticity, unforgeability, and undeniability. In 1984, Shamir developed the first Identity-based signature (IBS) to simplify public key infrastructure and circumvent the need for certificates. It makes the process uncomplicated by enabling users to verify digital signatures using only the identifiers of signers, such as email, phone number, etc. Nearly all existing IBS protocols rely on several theoretical assumption-based hard problems. Unfortunately, these hard problems are unsafe and pose a hazard in the quantum realm. Thus, designing IBS algorithms that can withstand quantum attacks and ensure long-term security is an important direction for future research. Quantum cryptography (QC) is one such approach. In this paper, we propose an IBS based on QC. Our scheme's security is based on the laws of quantum mechanics. It thereby achieves long-term security and provides resistance against quantum attacks. We verify the proposed design's correctness and feasibility by simulating it in a prototype quantum device and the IBM Qiskit quantum simulator. The implementation code in qiskit with Jupyternotebook is provided in the Annexure. Moreover, we discuss the application of our design in secure email communication.
- [14] arXiv:2403.18269 (cross-list from stat.ML) [pdf, other]
-
Title: Clustering Change Sign Detection by Fusing Mixture ComplexityComments: 23 pagesSubjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)
This paper proposes an early detection method for cluster structural changes. Cluster structure refers to discrete structural characteristics, such as the number of clusters, when data are represented using finite mixture models, such as Gaussian mixture models. We focused on scenarios in which the cluster structure gradually changed over time. For finite mixture models, the concept of mixture complexity (MC) measures the continuous cluster size by considering the cluster proportion bias and overlap between clusters. In this paper, we propose MC fusion as an extension of MC to handle situations in which multiple mixture numbers are possible in a finite mixture model. By incorporating the fusion of multiple models, our approach accurately captured the cluster structure during transitional periods of gradual change. Moreover, we introduce a method for detecting changes in the cluster structure by examining the transition of MC fusion. We demonstrate the effectiveness of our method through empirical analysis using both artificial and real-world datasets.
Replacements for Thu, 28 Mar 24
- [15] arXiv:2109.00970 (replaced) [pdf, ps, other]
-
Title: A Construction of 2-D Z-Complementary Array Code Sets with Flexible Even Row Lengths and Applications in Massive MIMOSubjects: Information Theory (cs.IT)
- [16] arXiv:2305.12523 (replaced) [pdf, ps, other]
-
Title: Multi-Static Target Detection and Power Allocation for Integrated Sensing and Communication in Cell-Free Massive MIMOComments: 16 pages, 7 figuresSubjects: Information Theory (cs.IT); Signal Processing (eess.SP)
- [17] arXiv:2311.06373 (replaced) [pdf, other]
-
Title: Partial Information Decomposition for Continuous Variables based on Shared Exclusions: Analytical Formulation and EstimationAuthors: David A. Ehrlich, Kyle Schick-Poland, Abdullah Makkeh, Felix Lanfermann, Patricia Wollstadt, Michael WibralComments: 32 pages, 15 figuresSubjects: Information Theory (cs.IT); Probability (math.PR); Statistics Theory (math.ST); Computation (stat.CO)
- [18] arXiv:2401.13387 (replaced) [pdf, other]
-
Title: A Mathematical Theory of Semantic CommunicationComments: (version 2.0 updated) 96 pages, 18 figures. This paper is submitted to IEEE Transactions on Information Theory (TIT)Subjects: Information Theory (cs.IT)
- [19] arXiv:2401.16063 (replaced) [pdf, ps, other]
-
Title: Shannon Capacity of Channels with Markov Insertions, Deletions and SubstitutionsComments: 15 pages, 1 figureSubjects: Information Theory (cs.IT)
- [20] arXiv:2403.06629 (replaced) [pdf, other]
-
Title: Assembly Theory is an approximation to algorithmic complexity based on LZ compression that does not explain selection or evolutionComments: 15 pages + appendix, 2 figuresSubjects: Information Theory (cs.IT); Biomolecules (q-bio.BM)
- [21] arXiv:2403.06633 (replaced) [pdf, other]
-
Title: Fractal spatio-temporal scale-free messaging: amplitude modulation of self-executable carriers given by the Weierstrass function's componentsComments: 15 pages + appendix (21 pages total)Subjects: Information Theory (cs.IT)
- [22] arXiv:2403.12452 (replaced) [src]
-
Title: On the Salient Limitations of `On the Salient Limitations of the Methods of Assembly Theory and their Classification of Molecular Biosignatures'Authors: Leroy CroninComments: the arguments here are being discussed in more detail and will be ready laterSubjects: Information Theory (cs.IT); Adaptation and Self-Organizing Systems (nlin.AO); Biological Physics (physics.bio-ph)
- [23] arXiv:2309.04381 (replaced) [pdf, other]
-
Title: Generalization Bounds: Perspectives from Information Theory and PAC-BayesComments: 228 pagesSubjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)
- [24] arXiv:2403.03271 (replaced) [pdf, ps, other]
-
Title: Low-Complexity Linear Decoupling of Users for Uplink Massive MU-MIMO DetectionSubjects: Signal Processing (eess.SP); Information Theory (cs.IT)
- [25] arXiv:2403.16290 (replaced) [pdf, other]
-
Title: An Information Theoretic Treatment of Animal Movement TracksAuthors: Wayne M GetzComments: 20 pages, 2 tables, 1 figureSubjects: Populations and Evolution (q-bio.PE); Information Theory (cs.IT)
[ showing up to 2000 entries per page: fewer | more ]
Disable MathJax (What is MathJax?)
Links to: arXiv, form interface, find, cs, recent, 2403, contact, help (Access key information)