Qize Yang
2 indexed papers
Research Timeline
The paper proposes OmniAgent, a native omni-modal agent that formulates video understanding as a POMDP-based iterative Observation-Thought-Action cycle, enabling active perception and improving performance with increasing reasoning turns.
The paper presents OmniVChat-Studio, a multi-agent data engine for synthesizing audio-visual dialogues, and OmniVChat-RL, a reinforcement learning reward design for evaluating omni models.
Papers
OmniVChat: Synthesizing, Benchmarking, and Training for Native Audio-Visual Dialogue
Haolin He, Yunfei Chu, Qi Chen, Wen Huang +14 more
The paper presents OmniVChat-Studio, a multi-agent data engine for synthesizing audio-visual dialogues, and OmniVChat-RL, a reinforcement learning reward design for evaluating omni models.