20 results for “Multimodal optimization”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
Zixin Zhang, Fan Qi, Shuai Li, Xiaoshan Yang +1 more
The paper proposes FedMChain, a novel federated learning framework that structures multimodal training into sequential phases to mitigate modality competition and improve model performance while reduc…
Haolin Deng, Xin Zou, Zhiwei Jin, Chen Chen +2 more
The paper proposes In-Context Visual Contrastive Optimization (IC-VCO) to rigorously mitigate multimodal hallucinations in Vision-Language Models by optimizing contrastive learning within a shared mul…
Jiawei Kong, Hao Fang, Shunxiang Liao, Jinyu Li +4 more
The paper proposes Reasoning-Conditioned Direct Preference Optimization (RC-DPO) to effectively mitigate hallucinations in multimodal large reasoning models by explicitly conditioning the preference o…
Laura Yao, Haochen Zhang, Jinhao Duan, Sijia Liu +1 more
This paper explores the representation of forget data in vision-language model unlearning and introduces a modality routing strategy to improve unlearning effectiveness.
This paper proposes a Multi-stage Constrained Optimization Framework (MCOF) for Variational Autoencoders (VAEs) to address challenges in sampling, identifying active decision variables, and enforcing…
Johanna Menn, Miriam Kober, Paul Brunzema, David Stenger +1 more
The paper introduces local Preferential Bayesian Optimization (PBO) methods that adapt high-dimensional Bayesian Optimization techniques, such as trust-region and derivative-informed local search, to…
The paper introduces a unified theoretical framework for gradient aggregation in multi-objective optimization, establishing convergence rates and sufficient conditions for achieving Pareto stationarit…
This paper proposes a simple and scalable post-training recipe called Modality Forcing for joint image-depth generation using a single DiT model.
Ilay Kamai, Hugues Van Assel, Aviv Regev, Hagai B. Perets +1 more
This paper develops a unified linear framework to diagnose when cross-modal alignment and prediction succeed or fail in multimodal representation learning.
The paper proposes a utility-aware multimodal contrastive learning framework that optimizes product image generation not just for semantic coherence, but also for maximizing consumer demand in online…
Cheng-Han Huang, Yongliang Sun, Chaoyan Huang, Ismail Alkhouri +1 more
The paper establishes conditions for QUBO formulations of combinatorial optimization problems that guarantee valid binary and feasible local minimizers using gradient-based methods.
The paper introduces a Conflict-aware Penalty (CP) and Statistical Loss (SL) framework to stabilize and balance the training of multimodal sentiment analysis models, achieving state-of-the-art perform…
The paper introduces Singularity-aware Adam (S-Adam), a novel optimizer that stabilizes deep learning training in non-smooth loss landscapes by dynamically damping updates based on local geometric ins…
This paper presents improved algorithms for an online item-allocation problem with budgets and a submodular objective.
This paper proposes a learning-based framework, CBA-BO, for solving expensive constrained optimization problems with continuously varying threshold settings by learning a parametric constraint model.
Hui Wang, Tianyu Ren, Joseph Butler, Christopher Baker +2 more
The paper proposes a framework for multimodal learning under missing modalities, called Latent World Recovery (LWR), which aligns modality-specific embeddings in a shared latent space and fuses availa…