Info Theory
Coding theory, channel capacity, and data compression
20 papers indexed
AI Sovereignty as National Learning Capacity: A Human-Centered Learning Mechanics Viewpoint on France, the United States, and China
The paper proposes viewing national AI development, specifically in France, as a 'national AI learning system' governed by a controlled balance between information injection and entropy dissipation, a…
The 2026 Algorithmic Information Theory Data Compression Challenge
André Ribeiro, Rúben Garrido, Violeta Ramos, António Alberto +27 more
This paper presents the 2026 Algorithmic Information Theory Data Compression Challenge, evaluating lossless compressors under realistic constraints and revealing performance dependencies.
Secure Rate-Distortion-Perception: A Randomized Distributed Function Computation Approach for Realism
The paper characterizes the secure rate-distortion-perception (RDP) trade-off region for neural image compression over various noisy and noiseless channels, demonstrating that randomized distributed f…
STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models
Yuhang Han, Wenzheng Yang, Yujie Chen, Xiangqi Jin +3 more
STaR-KV introduces a novel, training-free KV cache compression framework that adaptively re-weights token importance across spatial, temporal, and distributional axes, significantly reducing GPU memor…
A Quantum Method of Types
The authors introduce a quantum empirical operator and use it to prove a universal achievability result for composite quantum hypothesis testing.
The Security Budget of Code LLMs: An Information-Theoretic Capacity-Security Bound
The paper establishes an information-theoretic upper bound on the combined functional capacity and perturbation retention of code LLMs, quantifying the security budget available for code generation.
Efficient Provably Secure Linguistic Steganography via Range Coding
The paper proposes an efficient and provably secure linguistic steganography method using range coding that achieves high embedding capacity and speed, outperforming existing methods.
Uncertainty-Aware Fusion for Resilient Distributed Radar Sensing
This paper derives the Cramer-Rao lower bound for target state estimation in a distributed radar sensing system, revealing a tradeoff between update rate and quantization fidelity.
Task-Oriented Precoding for Edge Inference over Large-Scale MIMO Systems
Hongru Li, Zeyan Zhuang, Zixin Wang, Hengtao He +3 more
This paper proposes a statistical framework for designing task-aware multiple-input multiple-output (MIMO) precoders in future wireless networks using statistical channel state information and trainin…
An Information-Geometric Framework for Stability Analysis of Large Language Models under Entropic Stress
The paper proposes a novel information-geometric framework to analyze LLM stability by integrating task utility, external entropy, and internal structural proxies, showing this composite score improve…
From Bit to Block: Capacity Achievement via Product Coding
This paper presents a product coding scheme that converts bit-level reliability into block-level reliability, achieving the same asymptotic rate.
Safety, Security, and Cognitive Risks in State-Space Models: A Systematic Threat Analysis with Spectral, Stateful, and Capacity Attacks
This paper provides the first systematic threat analysis of State-Space Models (SSMs) in safety-critical applications, introducing novel attack classes and formal metrics to quantify their security an…
Compositional Semantic Communication for Physical AI: Category Theory Meets Game Theory
This paper proposes a framework for compositional semantic communication (CSC) in physical AI systems, enabling heterogeneous devices to transmit semantic representations that compose meaningfully at…
Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models
The paper establishes a theoretical information-theoretic bound proving that for Vision-Language-Action (VLA) models, capability and robustness cannot both be arbitrarily high, quantifying the trade-o…
A Resource Estimation Model for the Hardware-Software Co-Design of Distributed Quantum Architectures
This paper proposes an economic model to optimize the trade-off between entanglement distribution latency and decoherence time in distributed quantum computing.
InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models
Xinxin Liu, Shiwei Gan, Xiao Liu, Yafeng Yin +2 more
InfoMerge is a novel, training-free method that significantly compresses visual tokens for Video-LLMs by estimating temporal redundancy and allocating tokens based on content richness, achieving high…
Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content
This paper compares the preservation of linguistic content in different text encodings (tokens, bytes, pixels) using a shared bottleneck, revealing their distinct strengths in surface form preservatio…
Provably Secure Steganography Based on List Decoding
The paper proposes a provably secure steganography scheme based on list decoding that significantly increases embedding capacity for Large Language Models (LLMs) compared to existing methods.
Soft-Constrained Optimization of Latent Space in Variational Autoencoders
This paper proposes methods to improve the encoding capacity and disentanglement of Variational Autoencoders (VAE) by imposing entropy-based constraints and a weight-filter method.
The Sword, Shield, and Achilles' Heel: Characterizing the Linguistic Inductive Bias of Large Language Models for Spatial Reasoning in Navigation Planning
Xudong Zhang, Jian Yang, Shengkai Wang, Jiangpeng Tian +4 more
The paper proposes a dual-interventional framework to characterize how linguistic structures and contextual cues influence LLMs' spatial reasoning for navigation, finding that topological information…