Miles Yang
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
This paper introduces GEAR, a method for training a vector-quantized tokenizer and an autoregressive generator jointly and end-to-end, resolving the issue of non-differentiable VQ indices.
This paper proposes Twins, a unified continuous token space for multimodal models using ViT and VAE features, and addresses optimization imbalance with a focal regression objective.
Papers
Twins: Learn to Predict Unified Representations with Focal Loss
Kaixiong Gong, Xin Cai, Bin Lin, Hao Wang +8 more
This paper proposes Twins, a unified continuous token space for multimodal models using ViT and VAE features, and addresses optimization imbalance with a focal regression objective.