Soumya Vajjala
1 indexed paper
Recent (6 mo)
1With code
0Influential cites
0Benchmarked
0Publications per year
126
Top categories
NLP×1
Frequent co-authors
Research Timeline
2026
LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories
The paper evaluates the inconsistency of using LLMs as automated judges for multi-dimensional safety evaluations, finding that LLMs are unreliable for nuanced safety issues like financial advice but more reliable for overt harmful content.
Highlighted terms show continued research focus across papers