Beyond One-Size-Fits-All: Personalized and Culturally Adaptive Emotional TTS via Interactive Optimization of Individual Emotion Perception Spaces
This paper proposes a personalized and culturally adaptive emotional Text-to-Speech framework using an Interactive Genetic Algorithm for optimizing individualized arousal-valence perception spaces.
Introduces a personalized and culturally adaptive emotional TTS framework using an Interactive Genetic Algorithm for optimizing individualized A-V perception spaces.
Keywords
Before reading this…
Applications
- →Accessibility technology
- →Human-robot interaction
- →Virtual assistants
To understand this paper, make sure you know these concepts first:
- Understanding of Text-to-Speech systemsfind papers →
- Familiarity with emotional models and representationsfind papers →
Abstract
More Like ThisThe rise of conversational AI has increased interest in emotional Text-to-Speech (TTS). Most systems rely on discrete emotion labels, which fail to capture the nuanced nature of human affect. Recent models employ dimensional representations such as Russell's arousal-valence (A-V) model, offering finer control. However, emotional perception varies across individuals and cultures, which may cause mismatches between modeled and perceived emotions. We propose a personalized and culturally adaptive emotional TTS framework that performs interactive optimization of individualized A-V perception spaces using an Interactive Genetic Algorithm. By adapting emotion representations to each listener, the system produces speech with more perceptually aligned emotional expression than models using averaged A-V values. Evaluations with Japanese, Chinese, and Indonesian participants highlight the importance of personalization and cultural adaptation for moving beyond one-size-fits-all emotional TTS.