20 results for “Quantization”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
Hanna Foerster, Ilia Shumailov, Cheng Zhang, Yiren Zhao +2 more
This paper identifies a critical privacy vulnerability, termed Quantamination, where dynamic quantization in popular ML frameworks can leak sensitive user data across batch boundaries.
This paper proposes KroQuant, a post-training quantization method for diffusion transformers using learned Kronecker-structured invertible transforms, which reduces parameters, improves speed, and mai…
This paper systematically analyzes combining dimensionality reduction and quantization to compress text embeddings, showing that this combined approach achieves substantial compression (e.g., 0.1% siz…
This paper proposes a post-training quantization method called VLCQ that achieves competitive or improved performance while reducing bit-widths without requiring access to training data or model fine-…
This paper proposes a method for quantizing large language models with cross-layer error compensation and finite-sample feature-statistics matching.
The paper introduces Fast-TurboQuant, a multiplier-free projection architecture for large language models that uses a structured fast Johnson-Lindenstrauss transform instead of dense matrices, resulti…
This paper analyzes the effect of quantization on the Information Bottleneck framework and proposes task-oriented quantization designs for Gaussian and non-Gaussian settings.
AQ4SViT is a novel automated quantization framework for Spiking Vision Transformers that provides quick quantization settings with good trade-offs between accuracy and memory.
Songchen Xu, Ting Song, Shaohan Huang, Zhiliang Peng +6 more
The paper introduces VibeVoice-ASR-BitNet, a compressed real-time speech recognition model optimized for edge CPUs using heterogeneous quantization and custom SIMD kernels.
HARP introduces a novel, adaptive, learnable orthogonal processor that significantly improves the robustness and accuracy of extreme low-bit LLM quantization compared to fixed methods.
Kai Sun, Peibo Duan, Zhanglu Yan, Guowei Zhang +2 more
This paper proposes SpikeQ, a spike-guided post-training quantization framework for spiking neural networks.
Mingyu Zhao, Zijian Lin, Yutang Feng, Jiatao Chen +5 more
The paper proposes BAMU, a framework for dynamic RVQ allocation in pretrained neural speech codecs, achieving consistent improvements on EnCodec and DAC.
Derives the optimal quantizer of a real-valued random variable with a specified output distribution and minimum mean squared error.
The paper introduces HOPE, a mathematical framework for network compression that shifts representation deconstruction from the discrete domain to a Hilbert space, enabling unbiased architectural decis…
This paper introduces a provably sound runtime meter for KV-cache quantization to ensure compression does not damage the served request in real-time.
This study empirically benchmarks classical and quantum machine learning models for image recognition, finding that while quantum models offer superior accuracy and resource efficiency at high dimensi…
Establishes conditions for embedding documents as vectors for top-k retrieval and analyzes the required dimension and precision.