Alexey Shvets
2 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
The paper reframes LLM reliability from an impossible universal problem to a manageable, local patch-based problem, showing that sufficient interventions can be found by focusing on recurring failure modes within bounded operational domains.
The paper proposes PALS, a method for adjusting per-layer sparsity based on activation magnitudes in transformer models, achieving better performance than uniform one-shot pruning methods.
Papers
PALS: Percentile-Aware Layerwise Sparsity for LLM Pruning
The paper proposes PALS, a method for adjusting per-layer sparsity based on activation magnitudes in transformer models, achieving better performance than uniform one-shot pruning methods.