Yunfei Chu
3 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper proposes OmniAgent, a native omni-modal agent that formulates video understanding as a POMDP-based iterative Observation-Thought-Action cycle, enabling active perception and improving performance with increasing reasoning turns.
This paper introduces Omni Demand Understanding (ODU), a benchmark for evaluating AI assistants' ability to infer user demands from multimodal interaction.
The paper presents OmniVChat-Studio, a multi-agent data engine for synthesizing audio-visual dialogues, and OmniVChat-RL, a reinforcement learning reward design for evaluating omni models.
Papers
Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction
Qi Chen, Yunfei Chu, Haolin He, Yifan Yang +14 more
This paper introduces Omni Demand Understanding (ODU), a benchmark for evaluating AI assistants' ability to infer user demands from multimodal interaction.