ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “real-time inference”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.NEcs.LGEmpiricalRecentJun 8, 2026

Spiking Neural Network inference on FPGAs with hls4ml

Barry M. Dillon

This paper extends hls4ml to deploy spiking neural networks on FPGA firmware for real-time inference.

View →
cs.AIcs.LGRecentJun 1, 2026

Extreme Low-Bit Inference in Reasoning Models: Failure Modes and Targeted Recovery

Ekaterina Alimaskina, Darya Rudas, Denis Shveykin, Gleb Molodtsov +2 more

The paper analyzes the failure modes of aggressive 2-bit quantization in large reasoning models, proposing lightweight controls like FP16 planning and loop rescue to restore accuracy and achieve pract…

View →
cs.IRcs.AIcs.LGEmpiricalRecentJun 26, 2026

End-to-End Dynamic Sparsity for Resource-Adaptive LLM Inference

Yuhang Chen, Jinhao Duan, Ruichen Zhang, Mingfu Liang +10 more

This paper proposes Learning to Allocate (L2A), an end-to-end framework for resource-adaptive inference in Large Language Models (LLMs) using budget-conditioned and input-aware gating networks.

View →
cs.AIEmpiricalRecentSep 29, 2026

Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning

Paras Dahal, Anton Bakhtin, Taco Cohen, Zhengxing Chen +8 more

The paper introduces agentic meta-reasoning, a structured reasoning process for controlling the execution of complex tasks.

View →
math.STcs.MScs.SEEmpiricalRecentOct 11, 2026

Separating Statistical Inference from Experimental Runtime: An Architecture for Sequential Scientific Analysis

Alexander Stepanov, Andrej Novikov

The paper proposes an architecture for sequential statistical procedures that can be used in various applications.

View →
cs.DCEmpiricalRecentJun 19, 2026

DPIFrame: A Dual-Level Parallelism Acceleration Framework for CTR Model Inference

Dezhi Yi, Huifeng Guo, Kunpeng Xie, Zhaolong Jian +5 more

This paper proposes DPIFrame, a dual parallelizable framework for accelerating Click-through rate (CTR) model inference on GPU, achieving state-of-the-art inference performance with significant speedu…

View →
cs.CLcs.AIcs.ITEmpiricalRecentAug 5, 2026

Chained Recursive Language Models for Multi-Iteration Reasoning

Purbesh Mitra, Sennur Ulukus

This paper proposes Chained Recursive Language Models (Chained RLM), an inference-time architecture for managing context in large language models, allowing for intermediate artifacts to be inspected,…

View →
cs.AIcs.LGstat.MERecentMay 29, 2026

Industrializing Prediction-Powered Inference: The GLIDE Library for Reliable GenAI and Agentic Systems Evaluation

Grégoire Martinon, Ibrahim Merad, Mohammed Raki

The paper introduces GLIDE, an open-source Python library that unifies multiple state-of-the-art Prediction-Powered Inference (PPI) estimators and samplers to provide reliable, debiased estimates and…

View →
cs.AIEmpiricalRecentNov 4, 2026

On Turn-Level Best-of-N Sampling for Scaling LLM Agents

Jalaj Bhandari, Dhawal Gupta, Hongli Zhan, Zhenting Wang +4 more

This paper evaluates a simple inference-time scaling approach for large language model agents on complex tasks.

View →
cs.ARcs.DCcs.LGEmpiricalRecentNov 4, 2026

Hardwired Distributed Processing Units for Inference: Neural Decisions at the Sensor that Free the Host

Raj Mali

A hardwired distributed processing unit (HDPU) is designed to make neural decisions at the sensor, reducing inference on the host.

View →
cs.CVEmpiricalRecentJun 18, 2026

TimeProVe: Propose, then Verify for Efficient Long Video Temporal Reasoning in Activities of Daily Living

Arkaprava Sinha, Dominick Reilly, Siddharth Krishnan, Hieu Le +1 more

The paper introduces TimeProVe, a cost-efficient framework for temporally grounded reasoning in long videos.

View →
cs.LGcs.DScs.PFEmpiricalRecentOct 16, 2026

Peak-Memory Schedules You Can Trust: Exact Realization, Certified Optimality, and the Limits of Recomputation for Inference

Ivan Fomin, Ivan Koryabkin, Boris Sheludko

This paper proposes a method to optimize operator order for real-time inference on small devices without extra latency.

View →
cs.SEcs.CLSurveyRecentJun 18, 2026

Token-Operations-Oriented Inference Optimization Techniques for Large Models

Shiguo Lian, Kai Wang, Zhaoxiang Liu, Wen Liu +21 more

This paper proposes a four-layer technical architecture for large model inference optimization, including Multi-model Fusion, Model Optimization, Compute-Model Fusion, and Compute-Network-Model Fusion…

View →